-- Logs begin at Thu 2022-05-26 20:11:10 UTC, end at Thu 2022-05-26 22:13:48 UTC. -- May 26 21:00:07.927039 dv-cinder-828807-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 26 21:00:07.934475 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 21:00:07.936475 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 21:00:07 2022] *** May 26 21:00:07.936475 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 21:00:07.936475 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 21:00:07.936475 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: nodename: dv-cinder-828807-3-iscsi May 26 21:00:07.936475 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: machine: x86_64 May 26 21:00:07.936475 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: clock source: unix May 26 21:00:07.936475 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: pcre jit disabled May 26 21:00:07.936475 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: detected number of CPU cores: 4 May 26 21:00:07.937037 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: current working directory: / May 26 21:00:07.937037 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: detected binary path: /usr/bin/uwsgi-core May 26 21:00:07.937037 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: your processes number limit is 47680 May 26 21:00:07.937037 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: your memory page size is 4096 bytes May 26 21:00:07.937037 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: detected max file descriptor number: 2048 May 26 21:00:07.937037 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: lock engine: pthread robust mutexes May 26 21:00:07.940675 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: thunder lock: enabled May 26 21:00:07.940675 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 21:00:07.940675 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 21:00:07.983973 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: Python main interpreter initialized at 0x55bfb243d9c0 May 26 21:00:07.983973 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: python threads support enabled May 26 21:00:07.983973 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: your server socket listen backlog is limited to 100 connections May 26 21:00:07.983973 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: your mercy for graceful operations on workers is 90 seconds May 26 21:00:07.984370 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: mapped 403077 bytes (393 KB) for 2 cores May 26 21:00:07.984446 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: *** Operational MODE: preforking *** May 26 21:00:07.984703 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: *** uWSGI is running in multiple interpreter mode *** May 26 21:00:07.984703 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: spawned uWSGI master process (pid: 80734) May 26 21:00:07.984919 dv-cinder-828807-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 26 21:00:07.988612 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: spawned uWSGI worker 1 (pid: 80747, cores: 1) May 26 21:00:07.988612 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: spawned uWSGI worker 2 (pid: 80748, cores: 1) May 26 21:00:07.988612 dv-cinder-828807-3-iscsi devstack@keystone.service[80734]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 21:00:13.621482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:00:13.621482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: from cryptography.utils import int_from_bytes May 26 21:00:13.622187 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:00:13.622187 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: from cryptography.utils import int_from_bytes May 26 21:00:13.638283 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:00:13.638283 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: from cryptography.utils import int_from_bytes May 26 21:00:13.638790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:00:13.638790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: from cryptography.utils import int_from_bytes May 26 21:00:13.671289 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 21:00:13.671480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 21:00:13.671674 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] command line args: [] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 21:00:13.671944 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 21:00:13.672123 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ================================================================================ {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 21:00:13.672376 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] admin_token = **** {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.672655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] config_dir = [] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.672848 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.673032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] config_source = [] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.673213 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] debug = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.673415 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.674332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.674528 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.674786 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.675038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.675273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] list_limit = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.675461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] log_config_append = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.675640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.675820 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] log_dir = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.676002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] log_file = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.676239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.676489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.676763 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.677012 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.677192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.677371 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.677616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.677863 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.678099 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.678335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.678570 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.678807 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.679054 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.679301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.679577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.680065 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.680252 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] publish_errors = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.680491 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.680749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.680932 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.681183 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.681421 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.681658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] standard_threads = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.681893 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.682137 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.682319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.682497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] use_journal = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.682675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] use_json = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.682853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] use_stderr = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.683032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] use_syslog = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.683266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.683524 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.683765 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.684028 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.684271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.684521 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.684786 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.685039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.685278 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.685534 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.685785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.686040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.686124 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 21:00:13.686268 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 21:00:13.686353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.686470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] command line args: [] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 21:00:13.686557 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.686743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 21:00:13.686827 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.686924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ================================================================================ {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 21:00:13.687013 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.687178 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] admin_token = **** {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.687265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.687426 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] config_dir = [] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.687510 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.687617 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.687703 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.687801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] config_source = [] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.688196 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.688285 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] debug = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.688434 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.688554 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.688702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.688783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.688883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.688967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.689146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.689234 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.689489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.689602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.689729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] list_limit = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.689837 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.689970 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] log_config_append = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.690058 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.690130 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.690199 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.690268 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] log_dir = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.690406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.690493 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] log_file = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.690640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.690723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.690890 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.690973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.691136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.691219 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.691351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.691434 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.691556 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.691635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.691735 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.691815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.691978 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.692058 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.692228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.692306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.692463 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.692542 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.692724 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.692803 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.692958 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.693035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.693192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.693278 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.693429 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.693512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.693664 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.693742 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.693895 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.693989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.694138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.694364 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.694445 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.694591 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] publish_errors = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.694664 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.694808 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.694888 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.695039 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.695124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.695201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.695272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.695451 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.695529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.695685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.695764 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.695917 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] standard_threads = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.695995 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.696149 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.696227 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.696392 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.696472 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.696576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.696699 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.696770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] use_journal = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.696883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.696974 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] use_json = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.697104 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] use_stderr = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.697181 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.697280 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] use_syslog = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.697364 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.697511 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:00:13.697597 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.697768 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.697848 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.698008 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.698085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.698249 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.698334 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.698483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.698562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.698879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.699003 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.699003 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.699196 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.699294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.699391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.699487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.699583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.699692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.699848 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.699934 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.700053 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.700130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.700246 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.700351 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.700481 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.700632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.700753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.700862 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.700954 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.701086 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.701179 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.701340 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.701458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.701548 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.701630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.701807 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.701898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.702048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.702199 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.702284 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.702358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.702514 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.702597 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.702753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.702876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.702990 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.703070 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.703228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.703308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.703467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.703552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.703706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.703787 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.703946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.704067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.704181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.704262 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.704419 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.704497 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.704685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.704770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.704930 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.705527 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.705694 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.705780 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.705927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.706006 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.706159 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.706239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.706392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.706477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.706643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.706768 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.706941 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.707029 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.707107 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.707178 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.707326 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.707406 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.707560 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.707639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.707791 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.707870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.708022 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.708101 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.708254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.708334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.708486 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.708564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.708775 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.708873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.708988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.709069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] auth.external = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.709219 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.709305 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.709457 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.709545 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.709688 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.709781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.709926 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.710010 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] auth.password = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.710165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.710245 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] auth.token = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.710411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.710498 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.710653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.710734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.710910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.710992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.711154 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.711283 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.711404 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.711657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.711735 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.711895 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.712090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.712193 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] credential.caching = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.712369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.712518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.712637 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.712889 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.712981 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.713130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.713379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.713459 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.713617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.713855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.713934 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.714129 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.714295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.714383 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.714610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.714741 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.714900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.715149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.715237 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.715414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.715659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.715738 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.715921 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.716107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.716188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] federation.caching = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.716452 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.716567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.716764 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.717064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.717155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.717338 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.717564 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.717650 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.717875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.718018 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.718136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.718375 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.718498 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.718634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.718874 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.718978 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.719126 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.719377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] identity.caching = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.719477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.719628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.719881 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.719962 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.720121 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.720361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.720451 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.721268 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.721415 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.721526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.721776 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.721866 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.722034 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.722248 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.722328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.722518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.722598 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.722754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.722847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.722989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.723192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.723271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.723478 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.723556 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.723720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.723802 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.723974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.724055 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.724224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.724312 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.724499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.724609 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.724766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.724846 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.725008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.725098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.725243 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.725324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.725483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.725568 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.725719 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.725798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.725958 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.726038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.726194 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.726272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.726429 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.726509 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.726664 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.726746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.726897 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.726976 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.727136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.727223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.727380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.727460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.727616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.727694 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.727863 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.727951 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.728103 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.728183 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.728334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.728412 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.728574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.728672 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.728825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.728904 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.729067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.729146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] auth.external = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.729309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.729401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.729554 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.729634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.729796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.729876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.730035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.730130 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] auth.password = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.730266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] auth.token = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.730345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.730508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.730591 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.730741 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.730827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.730974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.731054 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.731208 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.731288 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.731460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.731547 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.731697 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.731776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.731934 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.732019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.732170 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.732257 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] credential.caching = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.732403 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.732483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.732670 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.732754 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.732932 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.733023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.733168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.733248 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.733415 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.733493 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.733654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.733742 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.733901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.733980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.734139 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.734218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.734369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.734458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.734607 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.734687 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.734844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.734923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.735083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.735170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.735315 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.735395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.735563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.735642 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.735812 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.735899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.736065 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.736153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] federation.caching = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.736336 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.736417 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.736598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.736705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.736838 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.736917 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.737086 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.737165 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.737326 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.737413 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.737565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.737645 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.737804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.737883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.738043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.738130 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.738292 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.738372 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.738530 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.738609 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.738771 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.738851 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.739007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] identity.caching = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.739092 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.739252 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.739331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.739501 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.739581 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.739739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.739817 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.739974 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.740053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.740212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.740297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.740445 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.740524 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.740709 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.740790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.740961 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.741043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.741201 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.741280 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.741435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.741513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] resource.caching = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.741668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.741792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.741907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.742053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.742170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.742291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.742384 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.742546 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.742627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.742803 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.742884 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.743045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.743134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.743296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.743378 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.743539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.743619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.743782 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.743871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.744018 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.744098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] role.caching = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.744256 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.744337 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] role.driver = sql {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.744488 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.744595 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.744754 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.744837 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.744997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.745078 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.745239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.745332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.745488 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.745570 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.745721 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.745801 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.745967 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.746056 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.746214 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.746295 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.746449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.746529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.746689 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.746846 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.746924 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.746996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.747166 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.747246 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.747406 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.747494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.747637 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.747718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.747876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.748058 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.748137 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.748304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.748386 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.748562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.748657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.748839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.748944 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.749089 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.749172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.749339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.749420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.749572 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.749660 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.749803 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.749890 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.750052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.750133 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.750298 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.750386 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.750534 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.750614 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.750768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.750848 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.751003 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.751092 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.751233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.751313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.751474 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.751554 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.751735 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.751823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.751992 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.752073 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.752236 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.752316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.752473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.752566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.752739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] token.caching = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.752821 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.752974 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.753054 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.753205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.753301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.753441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.753522 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.753677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.753757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.753913 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.754002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.754162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.754243 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.754427 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.754509 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.754656 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.754745 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.754906 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.754987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.755147 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.755227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.755390 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.755479 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.755629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.755713 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.755881 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.755962 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.756120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.756208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.756353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.756433 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.756605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.756688 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.756852 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.756945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.757107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.757188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.connection = **** {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.757357 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.757448 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.757598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.757718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.757853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.757934 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.758085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.758165 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.758326 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.758405 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.758562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.758643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.758799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.758878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.759036 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.759115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.759282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.759364 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.759523 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.759603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.759768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.759847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.760006 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.760088 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.760255 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.760365 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] resource.caching = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.760496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.760673 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.760771 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.760961 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.761042 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.761230 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.761310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.761469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.761557 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.761632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 21:00:13.761774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.762013 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.762263 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.762503 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.762746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.763001 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] role.caching = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.763249 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] role.driver = sql {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.763483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.763734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.763983 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.764231 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.764480 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.764753 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.765004 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.765252 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.765500 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.765737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.765984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.766232 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.766489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.766738 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.767154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.767392 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.768175 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.768425 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.768700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.768955 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.769192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.769448 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.769701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.769943 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.770178 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.770413 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.770645 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.770897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.771151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.771401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.771640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.771878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.772112 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.772350 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] token.caching = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.772600 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.772857 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.773097 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.773354 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.773602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.773843 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.774086 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.774329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.774576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.774814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.775055 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.775292 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.775537 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.775785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.776015 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.776260 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.776554 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.776847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.connection = **** {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.777094 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.777343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.777588 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.777840 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.778079 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.778319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.778558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.778798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.779047 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.779285 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.779531 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.779769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.780017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.780253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.780500 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.780759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.781002 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.781241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:00:13.781413 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 21:00:13.793347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:13.793583 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:13.793807 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:13.802459 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:13.806739 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:13.806976 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:13.807206 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:13.817535 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:13.831613 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:13.831848 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:13.836377 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:13.836638 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:13.884596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:13.885286 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:13.936381 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:13.936637 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:13.937209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:13.937448 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.003261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.003494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.003724 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.003869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.003956 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.004105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.004188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.004333 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.004418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.004556 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.004803 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.005022 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.027948 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.028067 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.028180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.028355 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.028441 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.028604 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.028692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.028852 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.028935 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.029073 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.029156 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.029285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.029369 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.029500 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.041265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.041739 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.053831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.054067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.054291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.054376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.054517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.054620 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.054740 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.054823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.054959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.055041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.055177 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.055268 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.055394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.055614 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 21:00:14.074169 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.074327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 21:00:14.074423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.074554 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 21:00:14.074663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.074864 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 21:00:14.074945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.075089 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 21:00:14.075173 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.075365 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.075447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.075662 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.075798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.075936 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.076066 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.076217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.087809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.088089 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.088365 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.088674 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.089606 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.089886 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.090156 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.090439 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.096891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.098652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.100191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.100474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.100783 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.101071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.101356 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.101618 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.101967 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.102096 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.102230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.102357 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.102515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.102642 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.102788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.102914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.103056 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.103183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.103306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.103673 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.103952 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.104225 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.104500 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.104798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.130642 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.131715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.132390 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.132691 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.133480 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.133760 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.137980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.138264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.138550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.139037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.139318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.139597 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.146445 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.146728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.147476 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.147760 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.151244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.151652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.151942 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.152230 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.152359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.152510 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.152661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.152820 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.153045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.153181 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.153311 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.153442 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.153572 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.153711 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.153985 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.154259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.172038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.172315 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.172940 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.173227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.177053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.177929 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.180745 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.181044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.181609 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.181904 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.186118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.187102 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.190542 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.191548 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.194366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.194679 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.194970 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.195258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.195398 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.195556 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.195688 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.195827 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.195970 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.196183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.196473 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.196787 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.215433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.215718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.215990 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.216256 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.216384 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.216568 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.216859 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.217120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.224323 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.225175 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.226066 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.226345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.226887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.227172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.229445 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.229731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.230018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.230253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.230398 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.230530 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.230661 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.230806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.231077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.231352 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.244227 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.244512 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.244831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.244981 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.245128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.245261 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.245392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.245524 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.245660 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.245795 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.245922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.246053 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.246230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.246530 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.264469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.265151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.268314 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.268966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.271680 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.272273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.273313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.273936 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.274963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.275256 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.275527 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.275679 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.275829 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.276095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.283003 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.283634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.284684 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.285269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.287937 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.288237 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.288526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.288728 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.288871 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.289000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.289288 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.289594 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.297987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.298273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.298684 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.298826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.299001 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.299395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.306629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.306915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.307199 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.307330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 21:00:14.307474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.307613 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.307743 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.307873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.308000 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.308129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.308265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.308393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.308532 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.308686 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.308822 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.308966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.309101 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.309235 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.309369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.309501 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.309645 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.309776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.309919 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.310054 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.310186 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.310327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.310458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.310726 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 21:00:14.350411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55bfb243d9c0 pid: 80748 (default app) May 26 21:00:14.351048 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55bfb243d9c0 pid: 80747 (default app) May 26 21:00:14.353690 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556191d-34c3-4322-b45f-47ea99485adf None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:14.353983 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556191d-34c3-4322-b45f-47ea99485adf None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:14.354262 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556191d-34c3-4322-b45f-47ea99485adf None None] PATH_INFO: `/v3` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:14.358573 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 791 bytes} [Thu May 26 21:00:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:23.358761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cd688-a712-432d-8712-02e4f5b9e6e3 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:23.359335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cd688-a712-432d-8712-02e4f5b9e6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:23.359335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cd688-a712-432d-8712-02e4f5b9e6e3 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:23.364341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1/2] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:23.369752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c67948-a09e-42ba-868d-faeea445d109 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:23.370176 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c67948-a09e-42ba-868d-faeea445d109 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:23.370306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c67948-a09e-42ba-868d-faeea445d109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:23.439449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: INFO dbcounter [None req-d7c67948-a09e-42ba-868d-faeea445d109 None None] Registered counter for database keystone May 26 21:00:23.461254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG oslo_db.sqlalchemy.engines [None req-d7c67948-a09e-42ba-868d-faeea445d109 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:00:23.467660 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writer thread running {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:00:23.646582 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG passlib.handlers.bcrypt [None req-d7c67948-a09e-42ba-868d-faeea445d109 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80748) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 21:00:23.646927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG passlib.handlers.bcrypt [None req-d7c67948-a09e-42ba-868d-faeea445d109 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80748) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 21:00:23.701890 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-d7c67948-a09e-42ba-868d-faeea445d109 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:23.703507 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d7c67948-a09e-42ba-868d-faeea445d109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:23.826573 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 2/3] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 26 21:00:23.977879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cd688-a712-432d-8712-02e4f5b9e6e3 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:24.047044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: INFO dbcounter [None req-629cd688-a712-432d-8712-02e4f5b9e6e3 None None] Registered counter for database keystone May 26 21:00:24.067114 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG oslo_db.sqlalchemy.engines [None req-629cd688-a712-432d-8712-02e4f5b9e6e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:00:24.073219 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writer thread running {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:00:24.193653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cd688-a712-432d-8712-02e4f5b9e6e3 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:24.197924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27584b89-7873-4d92-8fd8-577d58a7549a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:24.198590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27584b89-7873-4d92-8fd8-577d58a7549a admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:24.199225 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27584b89-7873-4d92-8fd8-577d58a7549a admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:24.199512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27584b89-7873-4d92-8fd8-577d58a7549a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:24.208338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27584b89-7873-4d92-8fd8-577d58a7549a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:24.259104 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: WARNING keystone.common.rbac_enforcer.enforcer [None req-27584b89-7873-4d92-8fd8-577d58a7549a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 21:00:24.259451 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27584b89-7873-4d92-8fd8-577d58a7549a admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:24.269864 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 2/4] 10.222.0.66 () {58 vars in 1324 bytes} [Thu May 26 21:00:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:00:24.275863 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c67948-a09e-42ba-868d-faeea445d109 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:24.290658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c67948-a09e-42ba-868d-faeea445d109 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:24.295056 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6482844-5f93-4337-9322-5bc552dcca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:24.296159 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6482844-5f93-4337-9322-5bc552dcca01 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:24.296441 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6482844-5f93-4337-9322-5bc552dcca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:24.296742 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6482844-5f93-4337-9322-5bc552dcca01 admin admin] PATH_INFO: `/v3/projects/7b6a47aff4f04a489b501a19f68711d3` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:24.298255 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6482844-5f93-4337-9322-5bc552dcca01 admin admin] RBAC: Authorizing `identity:get_project(project_id=7b6a47aff4f04a489b501a19f68711d3)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:24.455919 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c6482844-5f93-4337-9322-5bc552dcca01 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 21:00:24.456624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6482844-5f93-4337-9322-5bc552dcca01 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:24.460913 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 3/5] 10.222.0.66 () {56 vars in 1207 bytes} [Thu May 26 21:00:24 2022] GET /identity/v3/projects/7b6a47aff4f04a489b501a19f68711d3 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:26.635551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d646e7-7bc5-439c-9d84-9b4e531ee9cd None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:26.636110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d646e7-7bc5-439c-9d84-9b4e531ee9cd None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:26.636110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d646e7-7bc5-439c-9d84-9b4e531ee9cd None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:26.640294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 3/6] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:26.645790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e53f3-c876-4ae0-9c5b-535ea72d569d None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:26.646215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e53f3-c876-4ae0-9c5b-535ea72d569d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:26.646399 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e53f3-c876-4ae0-9c5b-535ea72d569d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:26.665222 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-272e53f3-c876-4ae0-9c5b-535ea72d569d None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:26.666762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-272e53f3-c876-4ae0-9c5b-535ea72d569d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:26.675123 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 4/7] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 21:00:26.697705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d646e7-7bc5-439c-9d84-9b4e531ee9cd None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:26.709607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d646e7-7bc5-439c-9d84-9b4e531ee9cd None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:26.713746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c903eb-7d3f-42b0-af9b-226ab8fabcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:26.714374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c903eb-7d3f-42b0-af9b-226ab8fabcff admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:26.714656 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c903eb-7d3f-42b0-af9b-226ab8fabcff admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:26.714929 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c903eb-7d3f-42b0-af9b-226ab8fabcff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:26.722566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c903eb-7d3f-42b0-af9b-226ab8fabcff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:26.724315 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c903eb-7d3f-42b0-af9b-226ab8fabcff admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:26.732842 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 4/8] 10.222.0.66 () {58 vars in 1324 bytes} [Thu May 26 21:00:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:00:26.738642 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e53f3-c876-4ae0-9c5b-535ea72d569d None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:26.747609 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e53f3-c876-4ae0-9c5b-535ea72d569d None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:26.752613 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5593252-ffcc-43f6-96ee-fa1938daf47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:26.753494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5593252-ffcc-43f6-96ee-fa1938daf47f admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:26.753779 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5593252-ffcc-43f6-96ee-fa1938daf47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:26.754060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5593252-ffcc-43f6-96ee-fa1938daf47f admin admin] PATH_INFO: `/v3/users/360bd68e46a04911b5f7e4be275448d0` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:26.755460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5593252-ffcc-43f6-96ee-fa1938daf47f admin admin] RBAC: Authorizing `identity:get_user(user_id=360bd68e46a04911b5f7e4be275448d0)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:26.757334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5593252-ffcc-43f6-96ee-fa1938daf47f admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:26.758905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 5/9] 10.222.0.66 () {56 vars in 1198 bytes} [Thu May 26 21:00:26 2022] GET /identity/v3/users/360bd68e46a04911b5f7e4be275448d0 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:29.038097 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2be280-4dc7-4cae-b8c2-b97ed4a6b173 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:29.038649 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2be280-4dc7-4cae-b8c2-b97ed4a6b173 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:29.038649 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2be280-4dc7-4cae-b8c2-b97ed4a6b173 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:29.040015 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 5/10] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:00:29.045300 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a0073-cbfc-4957-b8ae-c8b7bc818eb3 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:29.045700 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a0073-cbfc-4957-b8ae-c8b7bc818eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:29.045861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a0073-cbfc-4957-b8ae-c8b7bc818eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:29.062877 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-1d1a0073-cbfc-4957-b8ae-c8b7bc818eb3 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:29.064658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1d1a0073-cbfc-4957-b8ae-c8b7bc818eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:29.065150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb643ef2-6dd5-4751-9ab6-07523c8e79f2 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:29.065443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb643ef2-6dd5-4751-9ab6-07523c8e79f2 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:29.065727 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb643ef2-6dd5-4751-9ab6-07523c8e79f2 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:29.067064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 6/11] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:00:29.072041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1b4ad-5688-4382-836b-99a4c0dcd069 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:29.072337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1b4ad-5688-4382-836b-99a4c0dcd069 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:29.072647 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1b4ad-5688-4382-836b-99a4c0dcd069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:29.112278 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG passlib.handlers.bcrypt [None req-62d1b4ad-5688-4382-836b-99a4c0dcd069 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80747) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 21:00:29.112721 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG passlib.handlers.bcrypt [None req-62d1b4ad-5688-4382-836b-99a4c0dcd069 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80747) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 21:00:29.142981 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 6/12] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:29.159217 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-62d1b4ad-5688-4382-836b-99a4c0dcd069 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:29.160844 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-62d1b4ad-5688-4382-836b-99a4c0dcd069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:29.165158 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a0073-cbfc-4957-b8ae-c8b7bc818eb3 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:29.188854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:29.258905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 7/13] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:00:29.269994 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a0073-cbfc-4957-b8ae-c8b7bc818eb3 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:29.281975 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1b4ad-5688-4382-836b-99a4c0dcd069 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:29.304384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f5b8a-a880-40e0-909d-5521dff09456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:29.305034 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f5b8a-a880-40e0-909d-5521dff09456 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:29.305322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f5b8a-a880-40e0-909d-5521dff09456 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:29.305617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f5b8a-a880-40e0-909d-5521dff09456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:29.377197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f5b8a-a880-40e0-909d-5521dff09456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:29.378685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f5b8a-a880-40e0-909d-5521dff09456 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:29.382554 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1b4ad-5688-4382-836b-99a4c0dcd069 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:29.384887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:29.401956 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:29.420406 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdd8fd-aa45-4d10-8e32-9e72cec8cbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:29.421565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdd8fd-aa45-4d10-8e32-9e72cec8cbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:29.425265 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdd8fd-aa45-4d10-8e32-9e72cec8cbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:29.425265 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdd8fd-aa45-4d10-8e32-9e72cec8cbd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:29.434439 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdd8fd-aa45-4d10-8e32-9e72cec8cbd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:29.445927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-0bfdd8fd-aa45-4d10-8e32-9e72cec8cbd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:00:29.445927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:29.445927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:29.445927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:29.445927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:29.445927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:29.445927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:29.445927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:29.445927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:29.445927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:29.445927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:29.445927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:29.445927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:29.445927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:29.445927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:29.445927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:29.446902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:29.446902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:29.446902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:29.446902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:29.446902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:29.446902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:29.446902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:29.446902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:29.446902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:29.446902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:29.446902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:29.446902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:00:29.446902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:29.446902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:29.446902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:29.446902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:29.447693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:29.447693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:29.447693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:29.447693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:29.447693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:29.447693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:29.447693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:29.447693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:29.447693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:29.447693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:29.447693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:00:29.447693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:00:29.447693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 8/14] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:00:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:00:29.453034 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdd8fd-aa45-4d10-8e32-9e72cec8cbd3 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:29.479228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 7/15] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:00:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 21:00:29.484782 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f5b8a-a880-40e0-909d-5521dff09456 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:29.553269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdd8fd-aa45-4d10-8e32-9e72cec8cbd3 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:29.582791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f5b8a-a880-40e0-909d-5521dff09456 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:29.590279 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d34ea-99d4-491c-8355-145b0931071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:29.590950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d34ea-99d4-491c-8355-145b0931071e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:29.591234 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d34ea-99d4-491c-8355-145b0931071e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:29.591517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d34ea-99d4-491c-8355-145b0931071e None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:29.592282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d34ea-99d4-491c-8355-145b0931071e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:29.592610 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d34ea-99d4-491c-8355-145b0931071e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:29.594093 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d34ea-99d4-491c-8355-145b0931071e None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:29.606126 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:29.606374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 9/16] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:00:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:00:29.612049 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d34ea-99d4-491c-8355-145b0931071e None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:29.617210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b6b3f-b6b8-4b87-a5fb-84f163a766f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:29.619452 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b6b3f-b6b8-4b87-a5fb-84f163a766f2 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:29.619452 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b6b3f-b6b8-4b87-a5fb-84f163a766f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:29.619452 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b6b3f-b6b8-4b87-a5fb-84f163a766f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:29.628616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b6b3f-b6b8-4b87-a5fb-84f163a766f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:29.630256 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b6b3f-b6b8-4b87-a5fb-84f163a766f2 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:29.639739 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:29.652136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-0d1b6b3f-b6b8-4b87-a5fb-84f163a766f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:00:29.652136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:29.652136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:29.652136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:29.652136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:29.652136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:29.652136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:29.652136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:29.652136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:29.652136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:29.652136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:29.652136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:29.652136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:00:29.652136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:00:29.652136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:00:29.654433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:00:29.654433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:29.654433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:29.654433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:29.654433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:29.654433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:29.654433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:29.654433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:29.654433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:00:29.654433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:29.654433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:29.654433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:29.654433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:29.654433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:29.654433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:29.654433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:29.654433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:29.655218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:00:29.655218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:00:29.655218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:00:29.655218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:00:29.655218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 8/17] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:00:29.660288 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b6b3f-b6b8-4b87-a5fb-84f163a766f2 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:29.712874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d34ea-99d4-491c-8355-145b0931071e None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:29.745979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd4ffa-ac88-43a6-b4ec-bec3097b4424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:29.746856 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd4ffa-ac88-43a6-b4ec-bec3097b4424 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:29.747140 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd4ffa-ac88-43a6-b4ec-bec3097b4424 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:29.747417 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd4ffa-ac88-43a6-b4ec-bec3097b4424 None admin] PATH_INFO: `/v3/users/360bd68e46a04911b5f7e4be275448d0` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:29.749070 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd4ffa-ac88-43a6-b4ec-bec3097b4424 None admin] RBAC: Authorizing `identity:get_user(user_id=360bd68e46a04911b5f7e4be275448d0)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:29.750526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd4ffa-ac88-43a6-b4ec-bec3097b4424 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:29.752167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 10/18] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:00:29 2022] GET /identity/v3/users/360bd68e46a04911b5f7e4be275448d0 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:00:29.757428 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd4ffa-ac88-43a6-b4ec-bec3097b4424 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:29.757829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b6b3f-b6b8-4b87-a5fb-84f163a766f2 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:29.791071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deaef19-ccb0-4771-84e3-b7b999948b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:29.791724 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaef19-ccb0-4771-84e3-b7b999948b6f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:29.792003 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaef19-ccb0-4771-84e3-b7b999948b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:29.792278 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaef19-ccb0-4771-84e3-b7b999948b6f None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:29.793032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deaef19-ccb0-4771-84e3-b7b999948b6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:29.793336 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deaef19-ccb0-4771-84e3-b7b999948b6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:29.794732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deaef19-ccb0-4771-84e3-b7b999948b6f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:29.811606 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 9/19] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:00:29.852746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:29.860020 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd4ffa-ac88-43a6-b4ec-bec3097b4424 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:29.898410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c9fbe-2eed-49d3-a660-4bc166d77628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:29.899438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c9fbe-2eed-49d3-a660-4bc166d77628 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:29.899885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c9fbe-2eed-49d3-a660-4bc166d77628 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:29.900504 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c9fbe-2eed-49d3-a660-4bc166d77628 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:29.901784 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c9fbe-2eed-49d3-a660-4bc166d77628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:29.903265 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c9fbe-2eed-49d3-a660-4bc166d77628 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:29.904948 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 11/20] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:00:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:00:29.910926 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deaef19-ccb0-4771-84e3-b7b999948b6f None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:29.946221 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:30.015573 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deaef19-ccb0-4771-84e3-b7b999948b6f None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:30.049332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e2ad8-940e-46d5-b66e-a44db76d1dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:30.049988 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e2ad8-940e-46d5-b66e-a44db76d1dfd None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:30.050262 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e2ad8-940e-46d5-b66e-a44db76d1dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:30.050536 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e2ad8-940e-46d5-b66e-a44db76d1dfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:30.051372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e2ad8-940e-46d5-b66e-a44db76d1dfd None admin] RBAC: Adding query filter params (role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.domain.id=default, user.id=360bd68e46a04911b5f7e4be275448d0) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:30.051680 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e2ad8-940e-46d5-b66e-a44db76d1dfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:30.053148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e2ad8-940e-46d5-b66e-a44db76d1dfd None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:30.060230 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 10/21] 10.222.0.66 () {56 vars in 1322 bytes} [Thu May 26 21:00:29 2022] GET /identity/v3/role_assignments?user.id=360bd68e46a04911b5f7e4be275448d0&scope.domain.id=default&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:32.510778 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53be4f-f7a3-4f0d-8f7a-140bfe8b21fa None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:32.511826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53be4f-f7a3-4f0d-8f7a-140bfe8b21fa None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:32.512346 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53be4f-f7a3-4f0d-8f7a-140bfe8b21fa None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:32.514086 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 12/22] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:32.521451 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b361b67-3d4e-4ffb-8350-71baa5d0234b None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:32.522375 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b361b67-3d4e-4ffb-8350-71baa5d0234b None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:32.522865 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b361b67-3d4e-4ffb-8350-71baa5d0234b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:32.546484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-0b361b67-3d4e-4ffb-8350-71baa5d0234b None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:32.548718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-0b361b67-3d4e-4ffb-8350-71baa5d0234b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:32.645059 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 11/23] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:32.683063 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53be4f-f7a3-4f0d-8f7a-140bfe8b21fa None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:32.685436 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc183f-629c-405f-931c-e4d3d640899f None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:32.685729 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc183f-629c-405f-931c-e4d3d640899f None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:32.686012 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc183f-629c-405f-931c-e4d3d640899f None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:32.687718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 12/24] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:32.701010 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603980b-dd72-4869-898d-d4383e28283a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:32.701304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603980b-dd72-4869-898d-d4383e28283a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:32.701588 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603980b-dd72-4869-898d-d4383e28283a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:32.727927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-f603980b-dd72-4869-898d-d4383e28283a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:32.729509 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f603980b-dd72-4869-898d-d4383e28283a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:32.781074 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:32.892956 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 13/25] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:00:32.935597 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603980b-dd72-4869-898d-d4383e28283a None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:33.029844 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53be4f-f7a3-4f0d-8f7a-140bfe8b21fa None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:33.083093 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81fce9-a317-4e08-8e90-56b055dc55b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:33.083824 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81fce9-a317-4e08-8e90-56b055dc55b0 None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:33.084602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81fce9-a317-4e08-8e90-56b055dc55b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:33.085100 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81fce9-a317-4e08-8e90-56b055dc55b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:33.086077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81fce9-a317-4e08-8e90-56b055dc55b0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:33.087674 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81fce9-a317-4e08-8e90-56b055dc55b0 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:33.104017 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603980b-dd72-4869-898d-d4383e28283a None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:33.141635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f78fe0-1bd7-4f75-b510-e988ed5c761b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:33.143315 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f78fe0-1bd7-4f75-b510-e988ed5c761b None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:33.143792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f78fe0-1bd7-4f75-b510-e988ed5c761b None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:33.144285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f78fe0-1bd7-4f75-b510-e988ed5c761b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:33.155032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f78fe0-1bd7-4f75-b510-e988ed5c761b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:33.156917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f78fe0-1bd7-4f75-b510-e988ed5c761b None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:33.175629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-f7f78fe0-1bd7-4f75-b510-e988ed5c761b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:00:33.175629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:33.175629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:33.175629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:33.175629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:33.175629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:33.175629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:33.175629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:33.175629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:33.175629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:33.175629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:33.175629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:33.175629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:00:33.175629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:00:33.175629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:00:33.176489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:00:33.176489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:33.176489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:33.176489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:33.176489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:33.176489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:33.176489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:33.176489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:33.176489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:00:33.176489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:33.176489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:33.176489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:33.176489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:33.176489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:33.176489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:33.176489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:33.176489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:33.177306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:00:33.177306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:00:33.177306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:00:33.177306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:00:33.177306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 14/26] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:00:33.179388 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7150f72-17a1-4042-9332-0a9c7fb06c89 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:33.179893 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7150f72-17a1-4042-9332-0a9c7fb06c89 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:33.180359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7150f72-17a1-4042-9332-0a9c7fb06c89 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:33.181847 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 15/27] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:33.183122 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78c047-67f7-4d8b-8c73-cdfc74549c08 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:33.183571 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78c047-67f7-4d8b-8c73-cdfc74549c08 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:33.188310 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78c047-67f7-4d8b-8c73-cdfc74549c08 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:33.188310 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 16/28] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:33.188310 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78c047-67f7-4d8b-8c73-cdfc74549c08 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:33.202024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:33.311511 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78c047-67f7-4d8b-8c73-cdfc74549c08 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:33.317854 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 13/29] 10.222.0.66 () {60 vars in 1131 bytes} [Thu May 26 21:00:32 2022] POST /identity/v3/roles => generated 219 bytes in 635 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:00:33.319624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4204d7-05ab-4dbe-ac3d-dc880d2baad7 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:33.320023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4204d7-05ab-4dbe-ac3d-dc880d2baad7 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:33.320424 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4204d7-05ab-4dbe-ac3d-dc880d2baad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:33.340963 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-fa4204d7-05ab-4dbe-ac3d-dc880d2baad7 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:33.342572 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-fa4204d7-05ab-4dbe-ac3d-dc880d2baad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:33.358216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920595c-ecb0-44f5-a458-1edb6e0f97f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:33.358905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920595c-ecb0-44f5-a458-1edb6e0f97f7 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:33.359757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920595c-ecb0-44f5-a458-1edb6e0f97f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:33.360047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920595c-ecb0-44f5-a458-1edb6e0f97f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:33.361622 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920595c-ecb0-44f5-a458-1edb6e0f97f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:33.361936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920595c-ecb0-44f5-a458-1edb6e0f97f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:33.363216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:33.365253 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920595c-ecb0-44f5-a458-1edb6e0f97f7 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:33.380374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 17/30] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:33.382002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e9f3b-c60a-4a08-a2f6-2d1c942b6e5e None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:33.382298 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e9f3b-c60a-4a08-a2f6-2d1c942b6e5e None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:33.382577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e9f3b-c60a-4a08-a2f6-2d1c942b6e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:33.404342 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-3d3e9f3b-c60a-4a08-a2f6-2d1c942b6e5e None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:33.405668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3d3e9f3b-c60a-4a08-a2f6-2d1c942b6e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:33.490991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:33.497035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 18/31] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:33.498078 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e9f3b-c60a-4a08-a2f6-2d1c942b6e5e None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:33.534436 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 14/32] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:33.566668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4204d7-05ab-4dbe-ac3d-dc880d2baad7 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:33.646657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e9f3b-c60a-4a08-a2f6-2d1c942b6e5e None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:33.696744 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f891cf-0eb0-421e-b8ab-3ffe03a60034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:33.697712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f891cf-0eb0-421e-b8ab-3ffe03a60034 None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:33.698303 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f891cf-0eb0-421e-b8ab-3ffe03a60034 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:33.698720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f891cf-0eb0-421e-b8ab-3ffe03a60034 None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:33.698960 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4204d7-05ab-4dbe-ac3d-dc880d2baad7 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:33.699588 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f891cf-0eb0-421e-b8ab-3ffe03a60034 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:33.701390 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f891cf-0eb0-421e-b8ab-3ffe03a60034 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:33.756520 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c95a8-bc84-4f43-b060-5488a6b3514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:33.757274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c95a8-bc84-4f43-b060-5488a6b3514a None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:33.757612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c95a8-bc84-4f43-b060-5488a6b3514a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:33.757897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c95a8-bc84-4f43-b060-5488a6b3514a None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:33.758677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c95a8-bc84-4f43-b060-5488a6b3514a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:33.760224 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c95a8-bc84-4f43-b060-5488a6b3514a None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:33.859793 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 15/33] 10.222.0.66 () {60 vars in 1131 bytes} [Thu May 26 21:00:33 2022] POST /identity/v3/roles => generated 225 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:00:33.864938 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c95a8-bc84-4f43-b060-5488a6b3514a None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:33.881172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:33.938926 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 19/34] 10.222.0.66 () {60 vars in 1141 bytes} [Thu May 26 21:00:33 2022] POST /identity/v3/projects => generated 301 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:00:33.940431 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f158b0f-8aca-46e6-b8d6-a9d1255e8128 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:33.940777 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f158b0f-8aca-46e6-b8d6-a9d1255e8128 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:33.941103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f158b0f-8aca-46e6-b8d6-a9d1255e8128 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:33.945882 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 20/35] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:33.948333 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3bcd2-f908-43b6-9dc9-06ee2ff0ba48 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:33.948673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3bcd2-f908-43b6-9dc9-06ee2ff0ba48 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:33.949160 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3bcd2-f908-43b6-9dc9-06ee2ff0ba48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:33.981439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-c2b3bcd2-f908-43b6-9dc9-06ee2ff0ba48 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:33.983134 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-c2b3bcd2-f908-43b6-9dc9-06ee2ff0ba48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:34.004151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c95a8-bc84-4f43-b060-5488a6b3514a None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:34.048513 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65c017-eb76-4543-ae69-4a94d75f155d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:34.049832 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65c017-eb76-4543-ae69-4a94d75f155d None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:34.050357 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65c017-eb76-4543-ae69-4a94d75f155d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:34.050848 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65c017-eb76-4543-ae69-4a94d75f155d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:34.064605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65c017-eb76-4543-ae69-4a94d75f155d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:34.074165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-1c65c017-eb76-4543-ae69-4a94d75f155d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:00:34.074165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:34.074165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:34.074165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:34.074165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:34.074165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:34.074165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:34.074165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:34.074165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:34.074165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:34.074165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:34.074165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:34.074165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:34.074165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:34.074165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:34.074165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:34.075080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:34.075080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:34.075080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:34.075080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:34.075080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:34.075080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:34.075080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:34.075080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:34.075080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:34.075080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:34.075080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:34.075080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:00:34.075080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:34.075080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:34.075080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:34.075080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:34.075911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:34.075911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:34.075911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:34.075911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:34.075911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:34.075911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:34.075911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:34.075911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:34.075911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:34.075911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:34.075911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:00:34.075911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:00:34.078595 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 16/36] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:00:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:00:34.084277 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:34.086629 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65c017-eb76-4543-ae69-4a94d75f155d None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:34.106998 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 21/37] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:00:34.142685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3bcd2-f908-43b6-9dc9-06ee2ff0ba48 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:34.196362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:34.234618 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65c017-eb76-4543-ae69-4a94d75f155d None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:34.269073 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598483d8-d168-41d8-a259-5a6624311732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:34.269755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598483d8-d168-41d8-a259-5a6624311732 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:34.270043 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598483d8-d168-41d8-a259-5a6624311732 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:34.270327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598483d8-d168-41d8-a259-5a6624311732 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:34.271086 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598483d8-d168-41d8-a259-5a6624311732 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:34.271398 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598483d8-d168-41d8-a259-5a6624311732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:34.272817 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598483d8-d168-41d8-a259-5a6624311732 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:34.273004 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3bcd2-f908-43b6-9dc9-06ee2ff0ba48 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:34.281068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 17/38] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:00:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:34.282910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70547c-2833-4b03-9599-6c6845c23ec9 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:34.283203 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70547c-2833-4b03-9599-6c6845c23ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:34.283484 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70547c-2833-4b03-9599-6c6845c23ec9 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:34.284761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 18/39] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:34.287512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70547c-2833-4b03-9599-6c6845c23ec9 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:34.307864 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb07ec8-3c72-4763-8826-926e4bb95881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:34.308542 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb07ec8-3c72-4763-8826-926e4bb95881 None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:34.308933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb07ec8-3c72-4763-8826-926e4bb95881 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:34.309219 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb07ec8-3c72-4763-8826-926e4bb95881 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:34.309974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb07ec8-3c72-4763-8826-926e4bb95881 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:34.311496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb07ec8-3c72-4763-8826-926e4bb95881 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:34.389148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70547c-2833-4b03-9599-6c6845c23ec9 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:34.390414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 22/40] 10.222.0.66 () {60 vars in 1131 bytes} [Thu May 26 21:00:34 2022] POST /identity/v3/roles => generated 223 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:00:34.392334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7478d9-0116-4c92-85e9-13c3d2fd5dd5 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:34.392652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7478d9-0116-4c92-85e9-13c3d2fd5dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:34.396235 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7478d9-0116-4c92-85e9-13c3d2fd5dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:34.410523 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-fd7478d9-0116-4c92-85e9-13c3d2fd5dd5 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:34.412102 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-fd7478d9-0116-4c92-85e9-13c3d2fd5dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:34.430340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f063b4-f6bd-4052-834b-0110fb2aad61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:34.431418 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f063b4-f6bd-4052-834b-0110fb2aad61 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:34.431709 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f063b4-f6bd-4052-834b-0110fb2aad61 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:34.432017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f063b4-f6bd-4052-834b-0110fb2aad61 None admin] PATH_INFO: `/v3/users/360bd68e46a04911b5f7e4be275448d0` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:34.433448 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f063b4-f6bd-4052-834b-0110fb2aad61 None admin] RBAC: Authorizing `identity:get_user(user_id=360bd68e46a04911b5f7e4be275448d0)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:34.435023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f063b4-f6bd-4052-834b-0110fb2aad61 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:34.436943 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 19/41] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:00:34 2022] GET /identity/v3/users/360bd68e46a04911b5f7e4be275448d0 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:00:34.443116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f063b4-f6bd-4052-834b-0110fb2aad61 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:34.446228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:34.461962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:34.497217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 23/42] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:34.522976 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7478d9-0116-4c92-85e9-13c3d2fd5dd5 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:34.555847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f063b4-f6bd-4052-834b-0110fb2aad61 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:34.593152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd33f3-3e85-4371-a341-9549991da3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:34.594302 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd33f3-3e85-4371-a341-9549991da3cf None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:34.594593 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd33f3-3e85-4371-a341-9549991da3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:34.594906 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd33f3-3e85-4371-a341-9549991da3cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:34.596196 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd33f3-3e85-4371-a341-9549991da3cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:34.599528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd33f3-3e85-4371-a341-9549991da3cf None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:34.601615 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 20/43] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:00:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:00:34.607939 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd33f3-3e85-4371-a341-9549991da3cf None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:34.643602 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7478d9-0116-4c92-85e9-13c3d2fd5dd5 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:34.678742 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5196da1-af76-439f-8649-740bd5a385bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:34.679546 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5196da1-af76-439f-8649-740bd5a385bb None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:34.679834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5196da1-af76-439f-8649-740bd5a385bb None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:34.680113 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5196da1-af76-439f-8649-740bd5a385bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:34.681315 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5196da1-af76-439f-8649-740bd5a385bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:34.682416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:34.682780 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5196da1-af76-439f-8649-740bd5a385bb None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:34.684392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 24/44] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:00:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:00:34.690878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5196da1-af76-439f-8649-740bd5a385bb None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:34.713452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd33f3-3e85-4371-a341-9549991da3cf None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:34.733666 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:34.747827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e231e-b509-4006-bf9f-2f21a9f102da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:34.748736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e231e-b509-4006-bf9f-2f21a9f102da None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:34.749018 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e231e-b509-4006-bf9f-2f21a9f102da None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:34.749306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e231e-b509-4006-bf9f-2f21a9f102da None admin] PATH_INFO: `/v3/domains/default/users/360bd68e46a04911b5f7e4be275448d0/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:34.751914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e231e-b509-4006-bf9f-2f21a9f102da None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=360bd68e46a04911b5f7e4be275448d0, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:34.753399 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e231e-b509-4006-bf9f-2f21a9f102da None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:34.790718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5196da1-af76-439f-8649-740bd5a385bb None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:34.818704 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 21/45] 10.222.0.66 () {58 vars in 1361 bytes} [Thu May 26 21:00:34 2022] PUT /identity/v3/domains/default/users/360bd68e46a04911b5f7e4be275448d0/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:00:34.823957 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1010b-77e1-4a1d-b9a8-8532e38763f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:34.824685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1010b-77e1-4a1d-b9a8-8532e38763f6 None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:34.824962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1010b-77e1-4a1d-b9a8-8532e38763f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:34.825242 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1010b-77e1-4a1d-b9a8-8532e38763f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:34.825971 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1010b-77e1-4a1d-b9a8-8532e38763f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:34.827480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1010b-77e1-4a1d-b9a8-8532e38763f6 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:34.911814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 25/46] 10.222.0.66 () {60 vars in 1141 bytes} [Thu May 26 21:00:34 2022] POST /identity/v3/projects => generated 312 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:00:37.033823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1365c7-8d8c-401e-9a04-8de5c6a6a62d None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:37.034343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1365c7-8d8c-401e-9a04-8de5c6a6a62d None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:37.034427 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1365c7-8d8c-401e-9a04-8de5c6a6a62d None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:37.036677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 22/47] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:37.042185 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd14bab-ceec-41f6-82f5-040ae7734962 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:37.042603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd14bab-ceec-41f6-82f5-040ae7734962 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:37.042859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd14bab-ceec-41f6-82f5-040ae7734962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:37.058971 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-7cd14bab-ceec-41f6-82f5-040ae7734962 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:37.060141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-7cd14bab-ceec-41f6-82f5-040ae7734962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:37.118924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29e549-75e3-46d2-a011-9d86ac447a2c None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:37.119217 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29e549-75e3-46d2-a011-9d86ac447a2c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:37.119506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29e549-75e3-46d2-a011-9d86ac447a2c None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:37.120954 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 23/48] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:00:37.124742 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 26/49] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:37.126114 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e2b71-e3e3-4ce1-a8ef-f1aecf3b3615 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:37.126409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e2b71-e3e3-4ce1-a8ef-f1aecf3b3615 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:37.126697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e2b71-e3e3-4ce1-a8ef-f1aecf3b3615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:37.144067 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-ea8e2b71-e3e3-4ce1-a8ef-f1aecf3b3615 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:37.145305 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ea8e2b71-e3e3-4ce1-a8ef-f1aecf3b3615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:37.148213 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd14bab-ceec-41f6-82f5-040ae7734962 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:37.171784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:37.211695 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 24/50] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:37.235634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e2b71-e3e3-4ce1-a8ef-f1aecf3b3615 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:37.246361 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd14bab-ceec-41f6-82f5-040ae7734962 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:37.280417 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b0f9f-872a-45c5-a124-7353a2e3906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:37.281263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b0f9f-872a-45c5-a124-7353a2e3906b None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:37.281554 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b0f9f-872a-45c5-a124-7353a2e3906b None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:37.281837 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b0f9f-872a-45c5-a124-7353a2e3906b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:37.302611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b0f9f-872a-45c5-a124-7353a2e3906b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:37.302774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:37.303228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-8b5b0f9f-872a-45c5-a124-7353a2e3906b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:00:37.303228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:37.303228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:37.303228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:37.303228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:37.303228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:37.303228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:37.303228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:37.303228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:37.303228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:37.303228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:37.303228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:37.303228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:37.303228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:37.303228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:37.303228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:37.304040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:37.304040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:37.304040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:37.304040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:37.304040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:37.304040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:37.304040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:37.304040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:37.304040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:37.304040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:37.304040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:37.304040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:00:37.304040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:37.304040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:37.304040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:37.304040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:37.304826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:37.304826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:37.304826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:37.304826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:37.304826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:37.304826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:37.304826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:37.304826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:37.304826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:37.304826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:37.304826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:00:37.304826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:00:37.304826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 27/51] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:00:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:00:37.311451 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b0f9f-872a-45c5-a124-7353a2e3906b None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:37.335340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e2b71-e3e3-4ce1-a8ef-f1aecf3b3615 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:37.370576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5aefe9-25e3-47c0-8a8f-354aaaac222b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:37.371416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5aefe9-25e3-47c0-8a8f-354aaaac222b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:37.371782 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5aefe9-25e3-47c0-8a8f-354aaaac222b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:37.372059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5aefe9-25e3-47c0-8a8f-354aaaac222b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:37.373266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5aefe9-25e3-47c0-8a8f-354aaaac222b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:37.374764 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5aefe9-25e3-47c0-8a8f-354aaaac222b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:37.376928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 25/52] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:00:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:00:37.382417 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5aefe9-25e3-47c0-8a8f-354aaaac222b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:37.393341 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:37.411122 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b0f9f-872a-45c5-a124-7353a2e3906b None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:37.444509 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32458a-07f8-4c05-ae84-1b99426a4e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:37.445227 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32458a-07f8-4c05-ae84-1b99426a4e70 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:37.445522 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32458a-07f8-4c05-ae84-1b99426a4e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:37.445854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32458a-07f8-4c05-ae84-1b99426a4e70 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:37.449071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32458a-07f8-4c05-ae84-1b99426a4e70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:37.449395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32458a-07f8-4c05-ae84-1b99426a4e70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:37.450824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32458a-07f8-4c05-ae84-1b99426a4e70 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:37.463586 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 28/53] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:00:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:00:37.469268 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32458a-07f8-4c05-ae84-1b99426a4e70 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:37.482344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5aefe9-25e3-47c0-8a8f-354aaaac222b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:37.508918 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:37.517126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f06c8-5050-45d8-8c42-74228787c61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:37.517799 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f06c8-5050-45d8-8c42-74228787c61f None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:37.522806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f06c8-5050-45d8-8c42-74228787c61f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:37.522806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f06c8-5050-45d8-8c42-74228787c61f None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:37.522806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f06c8-5050-45d8-8c42-74228787c61f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:37.522806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f06c8-5050-45d8-8c42-74228787c61f None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:37.569378 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32458a-07f8-4c05-ae84-1b99426a4e70 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:37.603238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbff928-b936-4cd7-95ce-9d7ddc5f48ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:37.604116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbff928-b936-4cd7-95ce-9d7ddc5f48ca None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:37.604405 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbff928-b936-4cd7-95ce-9d7ddc5f48ca None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:37.604720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbff928-b936-4cd7-95ce-9d7ddc5f48ca None admin] PATH_INFO: `/v3/users/360bd68e46a04911b5f7e4be275448d0` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:37.605931 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbff928-b936-4cd7-95ce-9d7ddc5f48ca None admin] RBAC: Authorizing `identity:get_user(user_id=360bd68e46a04911b5f7e4be275448d0)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:37.607424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbff928-b936-4cd7-95ce-9d7ddc5f48ca None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:37.609108 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 29/54] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:00:37 2022] GET /identity/v3/users/360bd68e46a04911b5f7e4be275448d0 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:37.614464 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbff928-b936-4cd7-95ce-9d7ddc5f48ca None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:37.629851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:37.635799 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 26/55] 10.222.0.66 () {60 vars in 1140 bytes} [Thu May 26 21:00:37 2022] POST /identity/v3/projects => generated 298 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:00:37.723915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbff928-b936-4cd7-95ce-9d7ddc5f48ca None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:37.760528 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51221c8d-6825-421f-85d8-731a63347606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:37.761370 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51221c8d-6825-421f-85d8-731a63347606 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:37.761655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51221c8d-6825-421f-85d8-731a63347606 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:37.761935 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51221c8d-6825-421f-85d8-731a63347606 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:37.763197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51221c8d-6825-421f-85d8-731a63347606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:37.764729 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51221c8d-6825-421f-85d8-731a63347606 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:37.766454 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 30/56] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:00:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:00:37.772599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f06c8-5050-45d8-8c42-74228787c61f None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:37.874763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f06c8-5050-45d8-8c42-74228787c61f None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:37.907578 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c1a4d-4d3c-40e2-9bf7-902327940549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:37.908242 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c1a4d-4d3c-40e2-9bf7-902327940549 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:37.908527 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c1a4d-4d3c-40e2-9bf7-902327940549 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:37.908836 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c1a4d-4d3c-40e2-9bf7-902327940549 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:37.909670 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c1a4d-4d3c-40e2-9bf7-902327940549 None admin] RBAC: Adding query filter params (role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.domain.id=default, user.id=360bd68e46a04911b5f7e4be275448d0) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:37.909979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c1a4d-4d3c-40e2-9bf7-902327940549 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:37.911427 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c1a4d-4d3c-40e2-9bf7-902327940549 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:37.919472 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 27/57] 10.222.0.66 () {56 vars in 1322 bytes} [Thu May 26 21:00:37 2022] GET /identity/v3/role_assignments?user.id=360bd68e46a04911b5f7e4be275448d0&scope.domain.id=default&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:39.859856 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b0280-b891-4154-a9de-afc7245f3cac None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:39.860346 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b0280-b891-4154-a9de-afc7245f3cac None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:39.860346 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b0280-b891-4154-a9de-afc7245f3cac None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:39.861723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 31/58] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:39.866877 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c4d8a-334d-4c64-80d9-12abb01fb03f None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:39.867269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c4d8a-334d-4c64-80d9-12abb01fb03f None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:39.867444 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c4d8a-334d-4c64-80d9-12abb01fb03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:39.884447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-418c4d8a-334d-4c64-80d9-12abb01fb03f None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:39.885675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-418c4d8a-334d-4c64-80d9-12abb01fb03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:39.924973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:39.950695 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 28/59] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:39.975000 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b0280-b891-4154-a9de-afc7245f3cac None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:40.053522 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:40.073365 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b0280-b891-4154-a9de-afc7245f3cac None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:40.105236 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb683df6-7e47-4d42-9072-f9b324d824dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:40.106015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb683df6-7e47-4d42-9072-f9b324d824dd None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:40.106293 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb683df6-7e47-4d42-9072-f9b324d824dd None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:40.106565 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb683df6-7e47-4d42-9072-f9b324d824dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:40.107713 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb683df6-7e47-4d42-9072-f9b324d824dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:40.109201 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb683df6-7e47-4d42-9072-f9b324d824dd None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:40.111400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 32/60] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:00:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:40.116995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c4d8a-334d-4c64-80d9-12abb01fb03f None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:40.213920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c4d8a-334d-4c64-80d9-12abb01fb03f None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:40.248229 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379b005-9483-46ad-a584-0af07d63a8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:40.248935 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379b005-9483-46ad-a584-0af07d63a8d6 None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:40.249228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379b005-9483-46ad-a584-0af07d63a8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:40.249526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379b005-9483-46ad-a584-0af07d63a8d6 None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:40.250228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379b005-9483-46ad-a584-0af07d63a8d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:40.252359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379b005-9483-46ad-a584-0af07d63a8d6 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:40.407542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 29/61] 10.222.0.66 () {60 vars in 1132 bytes} [Thu May 26 21:00:40 2022] POST /identity/v3/users => generated 275 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:00:43.524844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b686749-0067-4862-9436-5db3edd12636 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:43.525353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b686749-0067-4862-9436-5db3edd12636 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:43.525427 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b686749-0067-4862-9436-5db3edd12636 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:43.526773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 33/62] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:43.532634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6acda-59ca-4495-8997-b1b34ec1f0c3 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:43.533062 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6acda-59ca-4495-8997-b1b34ec1f0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:43.533250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6acda-59ca-4495-8997-b1b34ec1f0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:43.557682 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-bdf6acda-59ca-4495-8997-b1b34ec1f0c3 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:43.558920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-bdf6acda-59ca-4495-8997-b1b34ec1f0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:43.599887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:43.661940 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 30/63] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:43.697772 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b686749-0067-4862-9436-5db3edd12636 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:43.838354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b686749-0067-4862-9436-5db3edd12636 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:43.882452 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb346b-58e5-41b3-ab0d-42a6fbbd9580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:43.883266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb346b-58e5-41b3-ab0d-42a6fbbd9580 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:43.883552 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb346b-58e5-41b3-ab0d-42a6fbbd9580 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:43.883832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb346b-58e5-41b3-ab0d-42a6fbbd9580 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:43.895167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb346b-58e5-41b3-ab0d-42a6fbbd9580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:43.907756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-88fb346b-58e5-41b3-ab0d-42a6fbbd9580 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 21:00:43.907756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:43.907756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:43.907756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:43.907756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:43.907756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:43.907756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:43.907756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:43.907756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:43.907756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:43.907756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:43.907756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:43.907756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:43.907756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:43.907756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:43.907756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:43.908685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:43.908685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:43.908685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:43.908685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:43.908685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:43.908685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:43.908685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:43.908685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:43.908685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:43.908685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:43.908685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:43.908685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:00:43.908685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:43.908685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:43.908685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:43.908685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:43.909455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:43.909455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:43.909455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:43.909455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:43.909455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:43.909455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:43.909455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:43.909455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:43.909455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:43.909455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:43.909455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 21:00:43.909455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:00:43.909455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 34/64] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:00:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:00:43.914840 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6acda-59ca-4495-8997-b1b34ec1f0c3 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:44.008057 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d36ce0-9c19-461b-ae84-9d7831078c63 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:44.008751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d36ce0-9c19-461b-ae84-9d7831078c63 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:44.009305 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d36ce0-9c19-461b-ae84-9d7831078c63 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:44.011017 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 35/65] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:44.017997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350394de-b01b-4a44-b8ae-dd2d3d7e1f4f None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:44.018620 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350394de-b01b-4a44-b8ae-dd2d3d7e1f4f None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:44.019107 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350394de-b01b-4a44-b8ae-dd2d3d7e1f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:44.054051 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-350394de-b01b-4a44-b8ae-dd2d3d7e1f4f None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:44.057551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-350394de-b01b-4a44-b8ae-dd2d3d7e1f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:44.062190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:44.083497 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6acda-59ca-4495-8997-b1b34ec1f0c3 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:44.136734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3789fa-0719-4b52-856f-01f0757307db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:44.137763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3789fa-0719-4b52-856f-01f0757307db None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:44.138269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3789fa-0719-4b52-856f-01f0757307db None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:44.139673 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3789fa-0719-4b52-856f-01f0757307db None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:44.140682 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3789fa-0719-4b52-856f-01f0757307db None admin] RBAC: Adding query filter params (name=member) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:44.141861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3789fa-0719-4b52-856f-01f0757307db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:44.144259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3789fa-0719-4b52-856f-01f0757307db None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:44.161709 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 31/66] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:00:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:44.167906 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3789fa-0719-4b52-856f-01f0757307db None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:44.182092 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 36/67] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:00:44.209226 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:44.231964 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350394de-b01b-4a44-b8ae-dd2d3d7e1f4f None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:44.307873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3789fa-0719-4b52-856f-01f0757307db None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:44.344783 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350394de-b01b-4a44-b8ae-dd2d3d7e1f4f None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:44.347335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14694a34-07e6-43cd-a921-58bb90bdce23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:44.348218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14694a34-07e6-43cd-a921-58bb90bdce23 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:44.348492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14694a34-07e6-43cd-a921-58bb90bdce23 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:44.348803 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14694a34-07e6-43cd-a921-58bb90bdce23 None admin] PATH_INFO: `/v3/users/e941a7c6994b4caf960392573fa084ec` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:44.364308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14694a34-07e6-43cd-a921-58bb90bdce23 None admin] RBAC: Authorizing `identity:get_user(user_id=e941a7c6994b4caf960392573fa084ec)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:44.365822 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14694a34-07e6-43cd-a921-58bb90bdce23 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:44.367700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 32/68] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:00:44 2022] GET /identity/v3/users/e941a7c6994b4caf960392573fa084ec => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:44.370560 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0708c3-6fe3-4873-af4d-fcd294ca7687 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:44.370977 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0708c3-6fe3-4873-af4d-fcd294ca7687 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:44.371339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0708c3-6fe3-4873-af4d-fcd294ca7687 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:44.373373 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 33/69] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:44.374350 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff62284-08ee-4ef5-8688-4f118a9904de None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:44.374642 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff62284-08ee-4ef5-8688-4f118a9904de None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:44.374926 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff62284-08ee-4ef5-8688-4f118a9904de None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:44.376952 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 34/70] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:44.377504 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff62284-08ee-4ef5-8688-4f118a9904de None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:44.390108 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9df0d0-88cf-498c-82cd-4da63c71a658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:44.390851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9df0d0-88cf-498c-82cd-4da63c71a658 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:44.391197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9df0d0-88cf-498c-82cd-4da63c71a658 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:44.391987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9df0d0-88cf-498c-82cd-4da63c71a658 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:44.399271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:44.403040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9df0d0-88cf-498c-82cd-4da63c71a658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:44.411319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-8b9df0d0-88cf-498c-82cd-4da63c71a658 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:00:44.411319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:44.411319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:44.411319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:44.411319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:44.411319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:44.411319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:44.411319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:44.411319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:44.411319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:44.411319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:44.411319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:44.411319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:44.411319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:44.411319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:44.411319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:44.412172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:44.412172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:44.412172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:44.412172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:44.412172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:44.412172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:44.412172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:44.412172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:44.412172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:44.412172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:44.412172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:44.412172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:00:44.412172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:44.412172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:44.412172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:44.412172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:44.412939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:44.412939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:44.412939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:44.412939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:44.412939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:44.412939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:44.412939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:44.412939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:44.412939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:44.412939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:44.412939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:00:44.412939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:00:44.412939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 37/71] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:00:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:00:44.414119 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fae6c0-9ff4-48d1-8564-57aed27d7261 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:44.414119 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fae6c0-9ff4-48d1-8564-57aed27d7261 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:44.414351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fae6c0-9ff4-48d1-8564-57aed27d7261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:44.431553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-26fae6c0-9ff4-48d1-8564-57aed27d7261 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:44.432840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-26fae6c0-9ff4-48d1-8564-57aed27d7261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:44.468408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:44.488247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff62284-08ee-4ef5-8688-4f118a9904de None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:44.498911 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 38/72] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:44.502461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c038e7-0947-4925-ac37-1ceb613973cd None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:44.502763 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c038e7-0947-4925-ac37-1ceb613973cd None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:44.503344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c038e7-0947-4925-ac37-1ceb613973cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:44.519616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-e0c038e7-0947-4925-ac37-1ceb613973cd None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:44.520850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-e0c038e7-0947-4925-ac37-1ceb613973cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:44.524225 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beda0b5-a90b-4716-93f9-e581733ee5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:44.524917 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beda0b5-a90b-4716-93f9-e581733ee5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:44.525207 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beda0b5-a90b-4716-93f9-e581733ee5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:44.525487 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beda0b5-a90b-4716-93f9-e581733ee5c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:44.587841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 39/73] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:44.588450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c038e7-0947-4925-ac37-1ceb613973cd None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:44.600443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beda0b5-a90b-4716-93f9-e581733ee5c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:44.601973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beda0b5-a90b-4716-93f9-e581733ee5c1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:44.652912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:44.682712 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:44.694417 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c038e7-0947-4925-ac37-1ceb613973cd None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:44.703511 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 35/74] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:00:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:00:44.708677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b23d6-5294-4c3a-9f2b-05a63cd4f5ca None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:44.708677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b23d6-5294-4c3a-9f2b-05a63cd4f5ca None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:44.708677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b23d6-5294-4c3a-9f2b-05a63cd4f5ca None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:44.708677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 36/75] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:44.709299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b23d6-5294-4c3a-9f2b-05a63cd4f5ca None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:44.735158 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005154c-e19e-4676-9ce7-9e24ba4c3d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:44.735832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005154c-e19e-4676-9ce7-9e24ba4c3d86 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:44.736118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005154c-e19e-4676-9ce7-9e24ba4c3d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:44.736394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005154c-e19e-4676-9ce7-9e24ba4c3d86 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:44.737187 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005154c-e19e-4676-9ce7-9e24ba4c3d86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:44.737497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005154c-e19e-4676-9ce7-9e24ba4c3d86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:44.738908 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005154c-e19e-4676-9ce7-9e24ba4c3d86 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:44.747146 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 40/76] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:00:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:44.747959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005154c-e19e-4676-9ce7-9e24ba4c3d86 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:44.811386 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b23d6-5294-4c3a-9f2b-05a63cd4f5ca None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:44.845100 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243dd21-7b1e-423e-b14b-a6c96b70e5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:44.845894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243dd21-7b1e-423e-b14b-a6c96b70e5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:44.846181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243dd21-7b1e-423e-b14b-a6c96b70e5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:44.846463 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243dd21-7b1e-423e-b14b-a6c96b70e5e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:44.847152 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005154c-e19e-4676-9ce7-9e24ba4c3d86 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:44.856318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243dd21-7b1e-423e-b14b-a6c96b70e5e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:44.863987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-f243dd21-7b1e-423e-b14b-a6c96b70e5e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 21:00:44.863987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:44.863987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:44.863987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:44.863987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:44.863987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:44.863987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:44.863987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:44.863987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:44.863987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:44.863987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:44.863987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:44.863987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:44.863987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:44.863987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:44.863987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:44.864964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:44.864964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:44.864964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:44.864964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:44.864964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:44.864964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:44.864964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:44.864964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:44.864964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:44.864964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:44.864964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:44.864964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:00:44.864964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:44.864964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:44.864964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:44.864964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:44.865873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:44.865873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:44.865873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:44.865873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:44.865873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:44.865873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:44.865873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:44.865873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:44.865873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:44.865873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:44.865873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 21:00:44.865873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:00:44.865873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 37/77] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:00:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:00:44.866967 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243dd21-7b1e-423e-b14b-a6c96b70e5e3 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:44.871958 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:44.885770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75bb9d-7d80-4ac6-9d36-877b3a8724b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:44.886565 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75bb9d-7d80-4ac6-9d36-877b3a8724b1 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:44.886853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75bb9d-7d80-4ac6-9d36-877b3a8724b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:44.887134 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75bb9d-7d80-4ac6-9d36-877b3a8724b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:44.897973 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75bb9d-7d80-4ac6-9d36-877b3a8724b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:44.905723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-cd75bb9d-7d80-4ac6-9d36-877b3a8724b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:00:44.905723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:44.905723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:44.905723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:44.905723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:44.905723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:44.905723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:44.905723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:44.905723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:44.905723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:44.905723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:44.905723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:44.905723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:44.905723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:44.905723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:44.905723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:44.906754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:44.906754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:44.906754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:44.906754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:44.906754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:44.906754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:44.906754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:44.906754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:44.906754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:44.906754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:44.906754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:44.906754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:00:44.906754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:44.906754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:44.906754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:44.906754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:44.907578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:44.907578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:44.907578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:44.907578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:44.907578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:44.907578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:44.907578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:44.907578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:44.907578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:44.907578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:44.907578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:00:44.907578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:00:44.907578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 41/78] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:00:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:00:44.908311 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9f3ef-998c-4fd9-9a75-b6fc4ddc2e1f None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:44.908400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9f3ef-998c-4fd9-9a75-b6fc4ddc2e1f None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:44.908906 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9f3ef-998c-4fd9-9a75-b6fc4ddc2e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:44.910805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:44.925619 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-c1f9f3ef-998c-4fd9-9a75-b6fc4ddc2e1f None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:44.926810 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-c1f9f3ef-998c-4fd9-9a75-b6fc4ddc2e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:44.971530 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243dd21-7b1e-423e-b14b-a6c96b70e5e3 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:44.991469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 42/79] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:44.992317 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9f3ef-998c-4fd9-9a75-b6fc4ddc2e1f None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:45.008909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e36074-9039-43d2-96e0-cb67b71d905d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:45.009847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e36074-9039-43d2-96e0-cb67b71d905d None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:45.010065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e36074-9039-43d2-96e0-cb67b71d905d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:45.010343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e36074-9039-43d2-96e0-cb67b71d905d None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:45.011544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e36074-9039-43d2-96e0-cb67b71d905d None admin] RBAC: Authorizing `identity:get_project(project_id=8e241471fdd8481c81049b886aa4ed5c)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:45.013026 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e36074-9039-43d2-96e0-cb67b71d905d None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:45.015114 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 38/80] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:00:44 2022] GET /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:45.016021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e36074-9039-43d2-96e0-cb67b71d905d None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:45.091579 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9f3ef-998c-4fd9-9a75-b6fc4ddc2e1f None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:45.102501 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:45.114632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e36074-9039-43d2-96e0-cb67b71d905d None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:45.123436 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:45.125757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bc16d-461c-494a-9690-4a1ce5a98357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:45.126637 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bc16d-461c-494a-9690-4a1ce5a98357 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:45.126921 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bc16d-461c-494a-9690-4a1ce5a98357 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:45.127197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bc16d-461c-494a-9690-4a1ce5a98357 None admin] PATH_INFO: `/v3/users/e941a7c6994b4caf960392573fa084ec` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:45.128377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2bc16d-461c-494a-9690-4a1ce5a98357 None admin] RBAC: Authorizing `identity:get_user(user_id=e941a7c6994b4caf960392573fa084ec)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:45.129878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2bc16d-461c-494a-9690-4a1ce5a98357 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:45.131662 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 43/81] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:00:44 2022] GET /identity/v3/users/e941a7c6994b4caf960392573fa084ec => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:45.132345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bc16d-461c-494a-9690-4a1ce5a98357 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:45.147806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8927a-0e24-4775-961b-455019efc8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:45.149189 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8927a-0e24-4775-961b-455019efc8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:45.149189 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8927a-0e24-4775-961b-455019efc8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:45.149189 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8927a-0e24-4775-961b-455019efc8f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:45.149876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8927a-0e24-4775-961b-455019efc8f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:45.150188 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8927a-0e24-4775-961b-455019efc8f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:45.151575 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8927a-0e24-4775-961b-455019efc8f5 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:45.160811 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 39/82] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:00:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:45.161772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8927a-0e24-4775-961b-455019efc8f5 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:45.236607 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bc16d-461c-494a-9690-4a1ce5a98357 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:45.259776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8927a-0e24-4775-961b-455019efc8f5 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:45.270789 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2d457-3491-4230-a5b8-fabb6ebf93f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:45.271450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2d457-3491-4230-a5b8-fabb6ebf93f7 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:45.271733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2d457-3491-4230-a5b8-fabb6ebf93f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:45.272009 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2d457-3491-4230-a5b8-fabb6ebf93f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:45.272778 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2d457-3491-4230-a5b8-fabb6ebf93f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:45.273086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2d457-3491-4230-a5b8-fabb6ebf93f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:45.274466 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2d457-3491-4230-a5b8-fabb6ebf93f7 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:45.282862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 44/83] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:00:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:45.283664 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2d457-3491-4230-a5b8-fabb6ebf93f7 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:45.296054 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3151cb-ae51-4180-8a8f-41d5ab4ef7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:45.297051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3151cb-ae51-4180-8a8f-41d5ab4ef7db None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:45.297380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3151cb-ae51-4180-8a8f-41d5ab4ef7db None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:45.297668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3151cb-ae51-4180-8a8f-41d5ab4ef7db None admin] PATH_INFO: `/v3/domains/default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:45.298875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3151cb-ae51-4180-8a8f-41d5ab4ef7db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:45.300352 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3151cb-ae51-4180-8a8f-41d5ab4ef7db None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:45.302000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 40/84] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:00:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:45.302766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3151cb-ae51-4180-8a8f-41d5ab4ef7db None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:45.326531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:45.343060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:45.383300 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2d457-3491-4230-a5b8-fabb6ebf93f7 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:45.402018 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3151cb-ae51-4180-8a8f-41d5ab4ef7db None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:45.416458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292d94c-4c8e-4f79-aa86-d6a50c01de47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:45.417077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292d94c-4c8e-4f79-aa86-d6a50c01de47 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:45.417362 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292d94c-4c8e-4f79-aa86-d6a50c01de47 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:45.417641 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292d94c-4c8e-4f79-aa86-d6a50c01de47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:45.418472 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292d94c-4c8e-4f79-aa86-d6a50c01de47 None admin] RBAC: Adding query filter params (role.id=7cbf3c401d60412fbcae272fb8d191cc, scope.project.id=8e241471fdd8481c81049b886aa4ed5c, user.id=e941a7c6994b4caf960392573fa084ec) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:45.418780 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292d94c-4c8e-4f79-aa86-d6a50c01de47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:45.420229 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292d94c-4c8e-4f79-aa86-d6a50c01de47 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:45.425580 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 45/85] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:00:45 2022] GET /identity/v3/role_assignments?user.id=e941a7c6994b4caf960392573fa084ec&scope.project.id=8e241471fdd8481c81049b886aa4ed5c&role.id=7cbf3c401d60412fbcae272fb8d191cc => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:45.426353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292d94c-4c8e-4f79-aa86-d6a50c01de47 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:45.438265 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07baec-4631-4257-81e3-99d5a06212ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:45.438957 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07baec-4631-4257-81e3-99d5a06212ac None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:45.439247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07baec-4631-4257-81e3-99d5a06212ac None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:45.440072 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07baec-4631-4257-81e3-99d5a06212ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:45.524996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07baec-4631-4257-81e3-99d5a06212ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:45.526546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07baec-4631-4257-81e3-99d5a06212ac None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:45.543994 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292d94c-4c8e-4f79-aa86-d6a50c01de47 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:45.546529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:45.583172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df1ae9-35b0-4cff-9968-126ea0674378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:45.583494 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:45.584072 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df1ae9-35b0-4cff-9968-126ea0674378 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:45.584362 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df1ae9-35b0-4cff-9968-126ea0674378 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:45.584824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df1ae9-35b0-4cff-9968-126ea0674378 None admin] PATH_INFO: `/v3/users/e941a7c6994b4caf960392573fa084ec` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:45.586150 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df1ae9-35b0-4cff-9968-126ea0674378 None admin] RBAC: Authorizing `identity:get_user(user_id=e941a7c6994b4caf960392573fa084ec)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:45.587688 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df1ae9-35b0-4cff-9968-126ea0674378 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:45.589449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 46/86] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:00:45 2022] GET /identity/v3/users/e941a7c6994b4caf960392573fa084ec => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:45.593504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df1ae9-35b0-4cff-9968-126ea0674378 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:45.657687 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 41/87] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:00:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:00:45.658534 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07baec-4631-4257-81e3-99d5a06212ac None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:45.713580 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df1ae9-35b0-4cff-9968-126ea0674378 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:45.747939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b071c-a63d-468c-8304-d1c8dde41f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:45.748855 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b071c-a63d-468c-8304-d1c8dde41f49 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:45.749146 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b071c-a63d-468c-8304-d1c8dde41f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:45.749421 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b071c-a63d-468c-8304-d1c8dde41f49 None admin] PATH_INFO: `/v3/users/360bd68e46a04911b5f7e4be275448d0` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:45.751163 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b071c-a63d-468c-8304-d1c8dde41f49 None admin] RBAC: Authorizing `identity:get_user(user_id=360bd68e46a04911b5f7e4be275448d0)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:45.752679 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b071c-a63d-468c-8304-d1c8dde41f49 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:45.754317 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 47/88] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:00:45 2022] GET /identity/v3/users/360bd68e46a04911b5f7e4be275448d0 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:45.755097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b071c-a63d-468c-8304-d1c8dde41f49 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:45.771548 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07baec-4631-4257-81e3-99d5a06212ac None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:45.801368 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:45.807252 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75df97-6c17-4fc1-b824-4684c3889e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:45.807936 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75df97-6c17-4fc1-b824-4684c3889e05 None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:45.808228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75df97-6c17-4fc1-b824-4684c3889e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:45.808567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75df97-6c17-4fc1-b824-4684c3889e05 None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:45.809323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75df97-6c17-4fc1-b824-4684c3889e05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:45.813967 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75df97-6c17-4fc1-b824-4684c3889e05 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:45.820806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:45.860791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b071c-a63d-468c-8304-d1c8dde41f49 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:45.894641 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b0af4-9a20-4768-a019-ac1898ac7fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:45.895297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b0af4-9a20-4768-a019-ac1898ac7fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:45.895589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b0af4-9a20-4768-a019-ac1898ac7fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:45.895871 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b0af4-9a20-4768-a019-ac1898ac7fc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:45.910015 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 42/89] 10.222.0.66 () {60 vars in 1132 bytes} [Thu May 26 21:00:45 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:00:45.911002 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75df97-6c17-4fc1-b824-4684c3889e05 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:45.992479 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b0af4-9a20-4768-a019-ac1898ac7fc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:45.994152 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b0af4-9a20-4768-a019-ac1898ac7fc4 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:46.037385 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75df97-6c17-4fc1-b824-4684c3889e05 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:46.048075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:46.087520 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c17cc-6b3a-41b1-8f65-4eaf2190f3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:46.089186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c17cc-6b3a-41b1-8f65-4eaf2190f3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:46.089543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c17cc-6b3a-41b1-8f65-4eaf2190f3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:46.089894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c17cc-6b3a-41b1-8f65-4eaf2190f3a8 None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:46.091677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c17cc-6b3a-41b1-8f65-4eaf2190f3a8 None admin] RBAC: Authorizing `identity:get_project(project_id=8e241471fdd8481c81049b886aa4ed5c)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:46.093287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c17cc-6b3a-41b1-8f65-4eaf2190f3a8 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:46.095660 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 43/90] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:00:45 2022] GET /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:46.097185 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c17cc-6b3a-41b1-8f65-4eaf2190f3a8 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:46.130088 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 48/91] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:00:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:00:46.131229 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b0af4-9a20-4768-a019-ac1898ac7fc4 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:46.181830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:46.230416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c17cc-6b3a-41b1-8f65-4eaf2190f3a8 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:46.269176 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b0af4-9a20-4768-a019-ac1898ac7fc4 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:46.277604 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8cf25-f7f2-4178-8b5d-3af56280fed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:46.279237 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8cf25-f7f2-4178-8b5d-3af56280fed1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:46.279746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8cf25-f7f2-4178-8b5d-3af56280fed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:46.280209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8cf25-f7f2-4178-8b5d-3af56280fed1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:46.313721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef8c3e-a6d3-4f42-9705-11b3a5cd3928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:46.314392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef8c3e-a6d3-4f42-9705-11b3a5cd3928 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:46.314675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef8c3e-a6d3-4f42-9705-11b3a5cd3928 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:46.314950 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef8c3e-a6d3-4f42-9705-11b3a5cd3928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:46.315790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef8c3e-a6d3-4f42-9705-11b3a5cd3928 None admin] RBAC: Adding query filter params (role.id=d45da92733d441d7bfeeb10c762c6138, scope.project.id=8e241471fdd8481c81049b886aa4ed5c, user.id=e941a7c6994b4caf960392573fa084ec) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:46.316101 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef8c3e-a6d3-4f42-9705-11b3a5cd3928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:46.317687 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef8c3e-a6d3-4f42-9705-11b3a5cd3928 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:46.323818 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 49/92] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:00:46 2022] GET /identity/v3/role_assignments?user.id=e941a7c6994b4caf960392573fa084ec&scope.project.id=8e241471fdd8481c81049b886aa4ed5c&role.id=d45da92733d441d7bfeeb10c762c6138 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:46.324690 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef8c3e-a6d3-4f42-9705-11b3a5cd3928 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:46.330100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:46.387953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8cf25-f7f2-4178-8b5d-3af56280fed1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:46.389572 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8cf25-f7f2-4178-8b5d-3af56280fed1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:46.463882 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:46.471271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef8c3e-a6d3-4f42-9705-11b3a5cd3928 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:46.515955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c8b7d-eb31-46ac-8241-498d078812a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:46.517833 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c8b7d-eb31-46ac-8241-498d078812a7 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:46.518404 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c8b7d-eb31-46ac-8241-498d078812a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:46.518890 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c8b7d-eb31-46ac-8241-498d078812a7 None admin] PATH_INFO: `/v3/projects/0d3b0d8a1192409199c14f809f83c500` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:46.520516 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c8b7d-eb31-46ac-8241-498d078812a7 None admin] RBAC: Authorizing `identity:get_project(project_id=0d3b0d8a1192409199c14f809f83c500)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:46.522551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c8b7d-eb31-46ac-8241-498d078812a7 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:46.528610 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 44/93] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:00:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:00:46.529315 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 50/94] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:00:46 2022] GET /identity/v3/projects/0d3b0d8a1192409199c14f809f83c500 => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:46.531032 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8cf25-f7f2-4178-8b5d-3af56280fed1 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:46.535749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c8b7d-eb31-46ac-8241-498d078812a7 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:46.681402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8cf25-f7f2-4178-8b5d-3af56280fed1 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:46.726405 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:46.744373 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbafab-d5c0-4fa0-a781-fdd2d5346701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:46.745391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbafab-d5c0-4fa0-a781-fdd2d5346701 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:46.745682 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbafab-d5c0-4fa0-a781-fdd2d5346701 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:46.745965 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbafab-d5c0-4fa0-a781-fdd2d5346701 None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:46.750284 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbafab-d5c0-4fa0-a781-fdd2d5346701 None admin] RBAC: Authorizing `identity:get_project(project_id=8e241471fdd8481c81049b886aa4ed5c)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:46.751805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbafab-d5c0-4fa0-a781-fdd2d5346701 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:46.753595 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 45/95] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:00:46 2022] GET /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:46.759779 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbafab-d5c0-4fa0-a781-fdd2d5346701 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:46.787061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c8b7d-eb31-46ac-8241-498d078812a7 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:46.799058 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:46.848701 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e3ac8-f22b-4453-9d2b-55276a2f1aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:46.849377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e3ac8-f22b-4453-9d2b-55276a2f1aba None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:46.849667 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e3ac8-f22b-4453-9d2b-55276a2f1aba None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:46.849951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e3ac8-f22b-4453-9d2b-55276a2f1aba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:46.851110 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e3ac8-f22b-4453-9d2b-55276a2f1aba None admin] RBAC: Adding query filter params (role.id=7cbf3c401d60412fbcae272fb8d191cc, scope.project.id=0d3b0d8a1192409199c14f809f83c500, user.id=e941a7c6994b4caf960392573fa084ec) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:46.851429 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e3ac8-f22b-4453-9d2b-55276a2f1aba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:46.853171 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e3ac8-f22b-4453-9d2b-55276a2f1aba None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:46.859982 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 51/96] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:00:46 2022] GET /identity/v3/role_assignments?user.id=e941a7c6994b4caf960392573fa084ec&scope.project.id=0d3b0d8a1192409199c14f809f83c500&role.id=7cbf3c401d60412fbcae272fb8d191cc => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:46.928234 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbafab-d5c0-4fa0-a781-fdd2d5346701 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:46.981630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648d11e-215a-424d-bb89-37db121ac84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:46.982318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648d11e-215a-424d-bb89-37db121ac84f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:46.982607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648d11e-215a-424d-bb89-37db121ac84f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:46.982890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648d11e-215a-424d-bb89-37db121ac84f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:46.983766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648d11e-215a-424d-bb89-37db121ac84f None admin] RBAC: Adding query filter params (role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.project.id=8e241471fdd8481c81049b886aa4ed5c, user.id=360bd68e46a04911b5f7e4be275448d0) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:46.984085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648d11e-215a-424d-bb89-37db121ac84f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:46.985673 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648d11e-215a-424d-bb89-37db121ac84f None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:46.997143 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 46/97] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:00:46 2022] GET /identity/v3/role_assignments?user.id=360bd68e46a04911b5f7e4be275448d0&scope.project.id=8e241471fdd8481c81049b886aa4ed5c&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:00:47.965469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410ce0d-d55d-4f30-8a96-ffa3ac70fc8f None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:47.965951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410ce0d-d55d-4f30-8a96-ffa3ac70fc8f None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:47.965951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410ce0d-d55d-4f30-8a96-ffa3ac70fc8f None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:47.967332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 52/98] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:47.982782 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b1b8f-1778-45c7-b3c9-ec9d4cc783cd None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:47.983296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b1b8f-1778-45c7-b3c9-ec9d4cc783cd None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:47.983367 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b1b8f-1778-45c7-b3c9-ec9d4cc783cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:48.009611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-482b1b8f-1778-45c7-b3c9-ec9d4cc783cd None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:48.010836 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-482b1b8f-1778-45c7-b3c9-ec9d4cc783cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:48.097103 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 47/99] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:48.138984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410ce0d-d55d-4f30-8a96-ffa3ac70fc8f None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:48.285291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410ce0d-d55d-4f30-8a96-ffa3ac70fc8f None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:48.330330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56a87a-2e68-4675-8331-61bbb8c2c011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:48.331231 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56a87a-2e68-4675-8331-61bbb8c2c011 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:48.331518 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56a87a-2e68-4675-8331-61bbb8c2c011 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:48.331848 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56a87a-2e68-4675-8331-61bbb8c2c011 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:48.336972 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:48.349560 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56a87a-2e68-4675-8331-61bbb8c2c011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:48.357846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-7c56a87a-2e68-4675-8331-61bbb8c2c011 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 21:00:48.357846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:48.357846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:48.357846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:48.357846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:48.357846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:48.357846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:48.357846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:48.357846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:48.357846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:48.357846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:48.357846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:48.357846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:48.357846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:48.357846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:48.357846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:48.358751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:48.358751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:48.358751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:48.358751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:48.358751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:48.358751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:48.358751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:48.358751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:48.358751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:48.358751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:48.358751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:48.358751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:00:48.358751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:48.358751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:48.358751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:48.358751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:48.361083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:48.361083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:48.361083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:48.361083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:48.361083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:48.361083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:48.361083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:48.361083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:48.361083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:48.361083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:48.361083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 21:00:48.361083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:00:48.361083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 53/100] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:00:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:00:48.365270 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b1b8f-1778-45c7-b3c9-ec9d4cc783cd None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:48.411518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:48.511381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b1b8f-1778-45c7-b3c9-ec9d4cc783cd None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:48.564601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef31a1f-62b1-40b5-967e-57e541897403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:48.564601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef31a1f-62b1-40b5-967e-57e541897403 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:48.564601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef31a1f-62b1-40b5-967e-57e541897403 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:48.564601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef31a1f-62b1-40b5-967e-57e541897403 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:48.565251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef31a1f-62b1-40b5-967e-57e541897403 None admin] RBAC: Adding query filter params (name=member) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:48.565251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef31a1f-62b1-40b5-967e-57e541897403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:48.565251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef31a1f-62b1-40b5-967e-57e541897403 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:48.576913 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 48/101] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:00:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:48.583329 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56a87a-2e68-4675-8331-61bbb8c2c011 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:48.751802 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56a87a-2e68-4675-8331-61bbb8c2c011 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:48.805834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71725315-0f1f-44b6-a534-65165fb57f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:48.806772 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71725315-0f1f-44b6-a534-65165fb57f4f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:48.807062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71725315-0f1f-44b6-a534-65165fb57f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:48.807341 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71725315-0f1f-44b6-a534-65165fb57f4f None admin] PATH_INFO: `/v3/users/e941a7c6994b4caf960392573fa084ec` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:48.814241 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71725315-0f1f-44b6-a534-65165fb57f4f None admin] RBAC: Authorizing `identity:get_user(user_id=e941a7c6994b4caf960392573fa084ec)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:48.815687 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71725315-0f1f-44b6-a534-65165fb57f4f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:48.817898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 54/102] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:00:48 2022] GET /identity/v3/users/e941a7c6994b4caf960392573fa084ec => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:48.823025 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef31a1f-62b1-40b5-967e-57e541897403 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:48.930103 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:48.950003 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef31a1f-62b1-40b5-967e-57e541897403 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:48.995679 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401749f-4c1f-47fd-93fe-13161c75cbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:48.996557 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401749f-4c1f-47fd-93fe-13161c75cbb7 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:48.996876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401749f-4c1f-47fd-93fe-13161c75cbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:48.997156 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401749f-4c1f-47fd-93fe-13161c75cbb7 None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:48.998383 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401749f-4c1f-47fd-93fe-13161c75cbb7 None admin] RBAC: Authorizing `identity:get_project(project_id=8e241471fdd8481c81049b886aa4ed5c)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:48.999863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401749f-4c1f-47fd-93fe-13161c75cbb7 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:49.002181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 49/103] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:00:48 2022] GET /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:49.008066 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71725315-0f1f-44b6-a534-65165fb57f4f None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:49.090823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:49.142658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71725315-0f1f-44b6-a534-65165fb57f4f None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:49.191727 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ff12e-6728-4b4d-b2fa-b89132409d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:49.192695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ff12e-6728-4b4d-b2fa-b89132409d3e None admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:49.192990 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ff12e-6728-4b4d-b2fa-b89132409d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:49.193271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ff12e-6728-4b4d-b2fa-b89132409d3e None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c/users/e941a7c6994b4caf960392573fa084ec/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:49.198227 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ff12e-6728-4b4d-b2fa-b89132409d3e None admin] RBAC: Authorizing `identity:create_grant(project_id=8e241471fdd8481c81049b886aa4ed5c, user_id=e941a7c6994b4caf960392573fa084ec, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:49.199728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ff12e-6728-4b4d-b2fa-b89132409d3e None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:49.299377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 55/104] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:00:49 2022] PUT /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c/users/e941a7c6994b4caf960392573fa084ec/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:00:49.480535 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37168c1f-0b6c-47e6-8c36-e5568c0c1e11 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:49.480762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37168c1f-0b6c-47e6-8c36-e5568c0c1e11 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:49.481043 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37168c1f-0b6c-47e6-8c36-e5568c0c1e11 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:49.482425 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 50/105] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:49.488813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262627d-232f-4759-9384-fb20effbc648 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:49.489431 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262627d-232f-4759-9384-fb20effbc648 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:49.489915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262627d-232f-4759-9384-fb20effbc648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:49.508499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-4262627d-232f-4759-9384-fb20effbc648 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:49.510202 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-4262627d-232f-4759-9384-fb20effbc648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:49.585910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 56/106] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:49.622704 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37168c1f-0b6c-47e6-8c36-e5568c0c1e11 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:49.756519 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37168c1f-0b6c-47e6-8c36-e5568c0c1e11 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:49.802085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae37a21-0891-4afd-9035-48f1165c2aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:49.802904 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae37a21-0891-4afd-9035-48f1165c2aee None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:49.803189 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae37a21-0891-4afd-9035-48f1165c2aee None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:49.803465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae37a21-0891-4afd-9035-48f1165c2aee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:49.824106 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae37a21-0891-4afd-9035-48f1165c2aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:49.832528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-eae37a21-0891-4afd-9035-48f1165c2aee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 21:00:49.832528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:49.832528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:49.832528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:49.832528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:49.832528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:49.832528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:49.832528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:49.832528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:49.832528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:49.832528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:49.832528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:49.832528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:49.832528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:49.832528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:49.832528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:49.833663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:49.833663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:49.833663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:49.833663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:49.833663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:49.833663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:49.833663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:49.833663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:49.833663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:49.833663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:49.833663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:49.833663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:00:49.833663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:49.833663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:49.833663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:49.833663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:49.834391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:49.834391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:49.834391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:49.834391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:49.834391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:49.834391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:49.834391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:49.834391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:49.834391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:49.834391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:49.834391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 21:00:49.834391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:00:49.837975 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 51/107] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:00:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:00:49.844118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262627d-232f-4759-9384-fb20effbc648 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:49.913511 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:49.963968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262627d-232f-4759-9384-fb20effbc648 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:49.971504 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99074fcf-e2a1-47a7-b7ca-8e2a3b8668be None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:49.971868 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99074fcf-e2a1-47a7-b7ca-8e2a3b8668be None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:49.972074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99074fcf-e2a1-47a7-b7ca-8e2a3b8668be None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:49.973695 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 52/108] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:49.979278 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e730eac-c16b-4fd6-9514-064ea4bd2a52 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:49.979870 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e730eac-c16b-4fd6-9514-064ea4bd2a52 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:49.980353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e730eac-c16b-4fd6-9514-064ea4bd2a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:50.008694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d46ab0-14b6-4485-b640-f43cda2b0431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:50.008694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d46ab0-14b6-4485-b640-f43cda2b0431 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:50.008694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d46ab0-14b6-4485-b640-f43cda2b0431 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:50.008694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d46ab0-14b6-4485-b640-f43cda2b0431 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:50.009381 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d46ab0-14b6-4485-b640-f43cda2b0431 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:50.009381 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d46ab0-14b6-4485-b640-f43cda2b0431 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:50.010526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d46ab0-14b6-4485-b640-f43cda2b0431 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:50.017273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-5e730eac-c16b-4fd6-9514-064ea4bd2a52 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:50.019135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-5e730eac-c16b-4fd6-9514-064ea4bd2a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:50.020411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 57/109] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:00:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:50.025832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d46ab0-14b6-4485-b640-f43cda2b0431 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:50.031164 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:50.101034 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 53/110] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:50.128506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d46ab0-14b6-4485-b640-f43cda2b0431 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:50.134823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e730eac-c16b-4fd6-9514-064ea4bd2a52 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:50.146696 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:50.164706 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae68bd-30ab-49b6-a72e-c70464daa855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:50.165993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae68bd-30ab-49b6-a72e-c70464daa855 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:50.165993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae68bd-30ab-49b6-a72e-c70464daa855 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:50.166162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae68bd-30ab-49b6-a72e-c70464daa855 None admin] PATH_INFO: `/v3/users/1d547a89a23243dfaa66ecf588590a3e` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:50.181488 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae68bd-30ab-49b6-a72e-c70464daa855 None admin] RBAC: Authorizing `identity:get_user(user_id=1d547a89a23243dfaa66ecf588590a3e)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:50.183023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae68bd-30ab-49b6-a72e-c70464daa855 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:50.185469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 58/111] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:00:50 2022] GET /identity/v3/users/1d547a89a23243dfaa66ecf588590a3e => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:00:50.191353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae68bd-30ab-49b6-a72e-c70464daa855 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:50.280765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e730eac-c16b-4fd6-9514-064ea4bd2a52 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:50.298404 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae68bd-30ab-49b6-a72e-c70464daa855 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:50.336611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0109e5-a8b7-480b-bd7c-7976265fd049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:50.336611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0109e5-a8b7-480b-bd7c-7976265fd049 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:50.336611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0109e5-a8b7-480b-bd7c-7976265fd049 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:50.336611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0109e5-a8b7-480b-bd7c-7976265fd049 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:50.346882 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4b986-f328-4dd7-8dd7-ae4d45905fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:50.348103 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4b986-f328-4dd7-8dd7-ae4d45905fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:50.348611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4b986-f328-4dd7-8dd7-ae4d45905fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:50.349094 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4b986-f328-4dd7-8dd7-ae4d45905fb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:50.373521 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4b986-f328-4dd7-8dd7-ae4d45905fb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:50.384722 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:50.387914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-11d4b986-f328-4dd7-8dd7-ae4d45905fb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:00:50.387914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:50.387914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:50.387914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:50.387914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:50.387914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:50.387914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:50.387914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:50.387914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:50.387914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:50.387914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:50.387914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:50.387914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:50.387914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:50.387914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:50.387914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:50.388805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:50.388805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:50.388805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:50.388805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:50.388805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:50.388805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:50.388805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:50.388805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:50.388805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:50.388805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:50.388805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:50.388805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:00:50.388805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:50.388805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:50.388805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:50.388805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:50.389592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:50.389592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:50.389592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:50.389592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:50.389592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:50.389592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:50.389592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:50.389592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:50.389592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:50.389592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:50.389592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:00:50.389592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:00:50.390175 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 54/112] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:00:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:00:50.391631 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3bd7d-d8ba-4348-8111-f4fcb1ca796d None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:50.391928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3bd7d-d8ba-4348-8111-f4fcb1ca796d None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:50.392212 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3bd7d-d8ba-4348-8111-f4fcb1ca796d None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:50.393897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 55/113] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:50.395400 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462cf8e-fc83-4292-af94-d5499384fba2 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:50.395694 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462cf8e-fc83-4292-af94-d5499384fba2 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:50.395980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462cf8e-fc83-4292-af94-d5499384fba2 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:50.403290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 56/114] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:50.403290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462cf8e-fc83-4292-af94-d5499384fba2 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:50.409724 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0109e5-a8b7-480b-bd7c-7976265fd049 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:50.410323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:50.411230 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0109e5-a8b7-480b-bd7c-7976265fd049 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:50.512700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462cf8e-fc83-4292-af94-d5499384fba2 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:50.515690 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 59/115] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:00:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 21:00:50.524306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880224ad-158c-4a3e-bcfc-433a09150623 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:50.524306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880224ad-158c-4a3e-bcfc-433a09150623 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:50.524306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880224ad-158c-4a3e-bcfc-433a09150623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:50.539509 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-880224ad-158c-4a3e-bcfc-433a09150623 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:50.540670 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-880224ad-158c-4a3e-bcfc-433a09150623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:50.553907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e47a7-af6a-43f9-a380-5f4271b5f5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:50.554598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e47a7-af6a-43f9-a380-5f4271b5f5dc None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:50.554883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e47a7-af6a-43f9-a380-5f4271b5f5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:50.555157 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e47a7-af6a-43f9-a380-5f4271b5f5dc None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:50.555918 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e47a7-af6a-43f9-a380-5f4271b5f5dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:50.556225 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e47a7-af6a-43f9-a380-5f4271b5f5dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:50.557658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e47a7-af6a-43f9-a380-5f4271b5f5dc None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:50.572742 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 57/116] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:00:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:50.572742 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660a780-708c-47d2-8cdf-fa1098704565 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:50.572742 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660a780-708c-47d2-8cdf-fa1098704565 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:50.572742 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660a780-708c-47d2-8cdf-fa1098704565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:50.592985 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-0660a780-708c-47d2-8cdf-fa1098704565 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:50.594542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0660a780-708c-47d2-8cdf-fa1098704565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:50.627859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 60/117] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:50.628751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880224ad-158c-4a3e-bcfc-433a09150623 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:50.638705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:50.667318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:50.675188 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 58/118] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:50.676408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fb22d-6e22-48df-a6d2-743668839690 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:50.676736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fb22d-6e22-48df-a6d2-743668839690 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:50.677020 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fb22d-6e22-48df-a6d2-743668839690 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:50.678446 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 59/119] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:50.679030 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fb22d-6e22-48df-a6d2-743668839690 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:50.754677 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880224ad-158c-4a3e-bcfc-433a09150623 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:50.789231 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fb22d-6e22-48df-a6d2-743668839690 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:50.789454 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71d4e1-0c0c-4984-853f-5d9b33856291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:50.790359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71d4e1-0c0c-4984-853f-5d9b33856291 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:50.790712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71d4e1-0c0c-4984-853f-5d9b33856291 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:50.790988 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71d4e1-0c0c-4984-853f-5d9b33856291 None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:50.792183 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71d4e1-0c0c-4984-853f-5d9b33856291 None admin] RBAC: Authorizing `identity:get_project(project_id=8e241471fdd8481c81049b886aa4ed5c)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:50.793708 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71d4e1-0c0c-4984-853f-5d9b33856291 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:50.800744 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 61/120] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:00:50 2022] GET /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:50.800744 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71d4e1-0c0c-4984-853f-5d9b33856291 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:50.830450 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47de928-246f-4fad-b12e-2cb509859058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:50.831464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47de928-246f-4fad-b12e-2cb509859058 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:50.831747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47de928-246f-4fad-b12e-2cb509859058 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:50.832026 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47de928-246f-4fad-b12e-2cb509859058 None admin] PATH_INFO: `/v3/users/e941a7c6994b4caf960392573fa084ec` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:50.833370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47de928-246f-4fad-b12e-2cb509859058 None admin] RBAC: Authorizing `identity:get_user(user_id=e941a7c6994b4caf960392573fa084ec)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:50.835015 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47de928-246f-4fad-b12e-2cb509859058 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:50.840979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 60/121] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:00:50 2022] GET /identity/v3/users/e941a7c6994b4caf960392573fa084ec => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:50.842772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb19851-854b-4918-9e61-a8fbca9a7309 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:50.843098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb19851-854b-4918-9e61-a8fbca9a7309 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:50.843378 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb19851-854b-4918-9e61-a8fbca9a7309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:50.862318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-0eb19851-854b-4918-9e61-a8fbca9a7309 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:50.863528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0eb19851-854b-4918-9e61-a8fbca9a7309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:50.887414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:50.921466 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71d4e1-0c0c-4984-853f-5d9b33856291 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:50.930224 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:50.940003 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 61/122] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:50.940886 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb19851-854b-4918-9e61-a8fbca9a7309 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:50.963229 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca14265-e509-4c3d-8628-b82498d2c00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:50.964185 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca14265-e509-4c3d-8628-b82498d2c00a None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:50.964620 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca14265-e509-4c3d-8628-b82498d2c00a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:50.965074 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca14265-e509-4c3d-8628-b82498d2c00a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:50.979403 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca14265-e509-4c3d-8628-b82498d2c00a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:50.990446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-aca14265-e509-4c3d-8628-b82498d2c00a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:00:50.990446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:50.990446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:50.990446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:50.990446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:50.990446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:50.990446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:50.990446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:50.990446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:50.990446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:50.990446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:50.990446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:50.990446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:50.990446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:50.990446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:50.990446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:50.991265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:50.991265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:50.991265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:50.991265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:50.991265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:50.991265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:50.991265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:50.991265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:50.991265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:50.991265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:50.991265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:50.991265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:00:50.991265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:50.991265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:50.991265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:50.991265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:50.992020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:50.992020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:50.992020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:50.992020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:50.992020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:50.992020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:50.992020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:50.992020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:50.992020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:50.992020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:50.992020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:00:50.992020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:00:50.993265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 62/123] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:00:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:00:50.993350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca14265-e509-4c3d-8628-b82498d2c00a None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:51.054923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb19851-854b-4918-9e61-a8fbca9a7309 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:51.089463 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684a732-a533-46da-ba24-5544c7e8fea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:51.090273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684a732-a533-46da-ba24-5544c7e8fea0 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:51.090559 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684a732-a533-46da-ba24-5544c7e8fea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:51.090839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684a732-a533-46da-ba24-5544c7e8fea0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:51.092048 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684a732-a533-46da-ba24-5544c7e8fea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:51.093709 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684a732-a533-46da-ba24-5544c7e8fea0 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:51.096127 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 62/124] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:00:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:51.096986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684a732-a533-46da-ba24-5544c7e8fea0 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:51.112131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca14265-e509-4c3d-8628-b82498d2c00a None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:51.148078 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:51.153836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b08816-75c4-4e26-b69d-edb2619a206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:51.154507 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b08816-75c4-4e26-b69d-edb2619a206c None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:51.154851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b08816-75c4-4e26-b69d-edb2619a206c None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:51.155140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b08816-75c4-4e26-b69d-edb2619a206c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:51.156159 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b08816-75c4-4e26-b69d-edb2619a206c None admin] RBAC: Adding query filter params (role.id=d4282b64bc3b42419a613a6210a47a2b, scope.project.id=8e241471fdd8481c81049b886aa4ed5c, user.id=1d547a89a23243dfaa66ecf588590a3e) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:51.157180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b08816-75c4-4e26-b69d-edb2619a206c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:51.159124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b08816-75c4-4e26-b69d-edb2619a206c None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:51.165866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 63/125] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:00:50 2022] GET /identity/v3/role_assignments?user.id=1d547a89a23243dfaa66ecf588590a3e&scope.project.id=8e241471fdd8481c81049b886aa4ed5c&role.id=d4282b64bc3b42419a613a6210a47a2b => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:51.166710 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b08816-75c4-4e26-b69d-edb2619a206c None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:51.171443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:51.219803 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684a732-a533-46da-ba24-5544c7e8fea0 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:51.257562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fe6b5-ba82-4965-b503-152630ce3847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:51.258728 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fe6b5-ba82-4965-b503-152630ce3847 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:51.259162 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fe6b5-ba82-4965-b503-152630ce3847 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:51.259674 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fe6b5-ba82-4965-b503-152630ce3847 None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:51.261106 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fe6b5-ba82-4965-b503-152630ce3847 None admin] RBAC: Authorizing `identity:get_project(project_id=8e241471fdd8481c81049b886aa4ed5c)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:51.262816 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fe6b5-ba82-4965-b503-152630ce3847 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:51.264794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 63/126] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:00:51 2022] GET /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:51.266511 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fe6b5-ba82-4965-b503-152630ce3847 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:51.326789 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b08816-75c4-4e26-b69d-edb2619a206c None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:51.380614 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1340a17-e4cf-4f8b-881b-d6c7e5e1b894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:51.383829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1340a17-e4cf-4f8b-881b-d6c7e5e1b894 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:51.383829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1340a17-e4cf-4f8b-881b-d6c7e5e1b894 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:51.384247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1340a17-e4cf-4f8b-881b-d6c7e5e1b894 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:51.392717 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fe6b5-ba82-4965-b503-152630ce3847 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:51.400076 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1340a17-e4cf-4f8b-881b-d6c7e5e1b894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:51.408422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-e1340a17-e4cf-4f8b-881b-d6c7e5e1b894 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 21:00:51.408422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:51.408422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:51.408422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:51.408422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:51.408422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:51.408422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:51.408422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:51.408422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:51.408422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:51.408422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:51.408422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:51.408422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:51.408422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:51.408422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:51.408422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:51.409432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:51.409432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:51.409432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:51.409432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:51.409432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:51.409432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:51.409432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:51.409432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:51.409432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:51.409432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:51.409432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:51.409432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:00:51.409432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:51.409432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:51.409432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:51.409432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:51.410210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:51.410210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:51.410210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:51.410210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:51.410210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:51.410210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:51.410210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:51.410210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:51.410210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:51.410210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:51.410210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 21:00:51.410210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:00:51.414578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 64/127] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:00:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:00:51.415446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1340a17-e4cf-4f8b-881b-d6c7e5e1b894 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:51.429506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:51.435507 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f719d6a-0970-452c-a7c2-2a5e64a9d96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:51.437102 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f719d6a-0970-452c-a7c2-2a5e64a9d96c None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:51.445240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f719d6a-0970-452c-a7c2-2a5e64a9d96c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:51.445240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f719d6a-0970-452c-a7c2-2a5e64a9d96c None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:51.445240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f719d6a-0970-452c-a7c2-2a5e64a9d96c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:51.445240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f719d6a-0970-452c-a7c2-2a5e64a9d96c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:51.445240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f719d6a-0970-452c-a7c2-2a5e64a9d96c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:51.452642 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 64/128] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:00:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:51.454169 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f719d6a-0970-452c-a7c2-2a5e64a9d96c None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:51.486101 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:51.545932 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1340a17-e4cf-4f8b-881b-d6c7e5e1b894 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:51.594668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f719d6a-0970-452c-a7c2-2a5e64a9d96c None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:51.601518 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f3efd-2d2f-4dc6-900a-2407dac47e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:51.602377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f3efd-2d2f-4dc6-900a-2407dac47e7b None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:51.602810 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f3efd-2d2f-4dc6-900a-2407dac47e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:51.603252 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f3efd-2d2f-4dc6-900a-2407dac47e7b None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:51.604703 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f3efd-2d2f-4dc6-900a-2407dac47e7b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:51.606840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f3efd-2d2f-4dc6-900a-2407dac47e7b None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:51.636127 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f205be3-78a4-49d6-8713-9248465632af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:51.642776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f205be3-78a4-49d6-8713-9248465632af None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:51.642776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f205be3-78a4-49d6-8713-9248465632af None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:51.642776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f205be3-78a4-49d6-8713-9248465632af None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c/users/e941a7c6994b4caf960392573fa084ec/roles/d45da92733d441d7bfeeb10c762c6138` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:51.642776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f205be3-78a4-49d6-8713-9248465632af None admin] RBAC: Authorizing `identity:create_grant(project_id=8e241471fdd8481c81049b886aa4ed5c, user_id=e941a7c6994b4caf960392573fa084ec, role_id=d45da92733d441d7bfeeb10c762c6138)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:51.643254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f205be3-78a4-49d6-8713-9248465632af None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:51.708457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 65/129] 10.222.0.66 () {60 vars in 1141 bytes} [Thu May 26 21:00:51 2022] POST /identity/v3/projects => generated 302 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:00:51.709704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f3efd-2d2f-4dc6-900a-2407dac47e7b None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:51.745410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 65/130] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:00:51 2022] PUT /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c/users/e941a7c6994b4caf960392573fa084ec/roles/d45da92733d441d7bfeeb10c762c6138 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:00:51.749439 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f205be3-78a4-49d6-8713-9248465632af None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:51.858337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:51.918630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f3efd-2d2f-4dc6-900a-2407dac47e7b None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:51.933210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:51.961438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f205be3-78a4-49d6-8713-9248465632af None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:52.001619 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e2d04-5c41-4e7a-89ef-b1ee37411ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:52.002329 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e2d04-5c41-4e7a-89ef-b1ee37411ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:52.002616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e2d04-5c41-4e7a-89ef-b1ee37411ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:52.002894 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e2d04-5c41-4e7a-89ef-b1ee37411ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:52.003691 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e2d04-5c41-4e7a-89ef-b1ee37411ae1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:52.004005 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e2d04-5c41-4e7a-89ef-b1ee37411ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:52.005482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e2d04-5c41-4e7a-89ef-b1ee37411ae1 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:52.024435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 66/131] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:00:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:52.033886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e2d04-5c41-4e7a-89ef-b1ee37411ae1 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:52.047890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194ae2f-80b0-4c89-9802-0681e7cf52d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:52.048860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194ae2f-80b0-4c89-9802-0681e7cf52d9 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:52.049152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194ae2f-80b0-4c89-9802-0681e7cf52d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:52.049431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194ae2f-80b0-4c89-9802-0681e7cf52d9 None admin] PATH_INFO: `/v3/users/360bd68e46a04911b5f7e4be275448d0` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:52.053526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194ae2f-80b0-4c89-9802-0681e7cf52d9 None admin] RBAC: Authorizing `identity:get_user(user_id=360bd68e46a04911b5f7e4be275448d0)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:52.055105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194ae2f-80b0-4c89-9802-0681e7cf52d9 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:52.056899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 66/132] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:00:51 2022] GET /identity/v3/users/360bd68e46a04911b5f7e4be275448d0 => generated 247 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:52.063405 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194ae2f-80b0-4c89-9802-0681e7cf52d9 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:52.219871 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e2d04-5c41-4e7a-89ef-b1ee37411ae1 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:52.260605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194ae2f-80b0-4c89-9802-0681e7cf52d9 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:52.266856 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fdb91-1bca-473b-b92f-66a3a7c2f296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:52.267843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fdb91-1bca-473b-b92f-66a3a7c2f296 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:52.268131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fdb91-1bca-473b-b92f-66a3a7c2f296 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:52.268410 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fdb91-1bca-473b-b92f-66a3a7c2f296 None admin] PATH_INFO: `/v3/users/e941a7c6994b4caf960392573fa084ec` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:52.270503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fdb91-1bca-473b-b92f-66a3a7c2f296 None admin] RBAC: Authorizing `identity:get_user(user_id=e941a7c6994b4caf960392573fa084ec)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:52.272087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fdb91-1bca-473b-b92f-66a3a7c2f296 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:52.273798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 67/133] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:00:52 2022] GET /identity/v3/users/e941a7c6994b4caf960392573fa084ec => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:00:52.279566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbcf50-1dba-4876-8c01-8a4517cd45de None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:52.279566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbcf50-1dba-4876-8c01-8a4517cd45de None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:52.279566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbcf50-1dba-4876-8c01-8a4517cd45de None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:52.279799 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:52.279870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 68/134] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:52.279870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbcf50-1dba-4876-8c01-8a4517cd45de None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:52.293347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c49101-a13b-40d5-ac6a-e4299cbf700b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:52.294149 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c49101-a13b-40d5-ac6a-e4299cbf700b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:52.294444 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c49101-a13b-40d5-ac6a-e4299cbf700b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:52.294723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c49101-a13b-40d5-ac6a-e4299cbf700b None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:52.296300 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c49101-a13b-40d5-ac6a-e4299cbf700b None admin] RBAC: Authorizing `identity:get_project(project_id=8e241471fdd8481c81049b886aa4ed5c)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:52.299177 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c49101-a13b-40d5-ac6a-e4299cbf700b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:52.301592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 67/135] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:00:52 2022] GET /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:00:52.303268 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1c7d8-3633-483c-acf9-932baf7e102f None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:52.303721 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1c7d8-3633-483c-acf9-932baf7e102f None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:52.304009 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1c7d8-3633-483c-acf9-932baf7e102f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:52.328182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-e3c1c7d8-3633-483c-acf9-932baf7e102f None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:52.329496 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e3c1c7d8-3633-483c-acf9-932baf7e102f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:52.332304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:52.396016 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbcf50-1dba-4876-8c01-8a4517cd45de None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:52.403408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 68/136] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:52.404046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1c7d8-3633-483c-acf9-932baf7e102f None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:52.435878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71799811-8374-4917-a2da-df69efaee55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:52.437440 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71799811-8374-4917-a2da-df69efaee55f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:52.437978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71799811-8374-4917-a2da-df69efaee55f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:52.438473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71799811-8374-4917-a2da-df69efaee55f None admin] PATH_INFO: `/v3/projects/0d3b0d8a1192409199c14f809f83c500` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:52.439893 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71799811-8374-4917-a2da-df69efaee55f None admin] RBAC: Authorizing `identity:get_project(project_id=0d3b0d8a1192409199c14f809f83c500)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:52.441624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71799811-8374-4917-a2da-df69efaee55f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:52.444130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 69/137] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:00:52 2022] GET /identity/v3/projects/0d3b0d8a1192409199c14f809f83c500 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:52.449358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71799811-8374-4917-a2da-df69efaee55f None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:52.527771 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1c7d8-3633-483c-acf9-932baf7e102f None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:52.546706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:52.562357 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71799811-8374-4917-a2da-df69efaee55f None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:52.565033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba482c91-68b2-41a7-9675-81f6526201ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:52.566063 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba482c91-68b2-41a7-9675-81f6526201ef None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:52.566450 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba482c91-68b2-41a7-9675-81f6526201ef None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:52.566883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba482c91-68b2-41a7-9675-81f6526201ef None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c/users/360bd68e46a04911b5f7e4be275448d0/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:52.568972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba482c91-68b2-41a7-9675-81f6526201ef None admin] RBAC: Authorizing `identity:create_grant(project_id=8e241471fdd8481c81049b886aa4ed5c, user_id=360bd68e46a04911b5f7e4be275448d0, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:52.570541 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba482c91-68b2-41a7-9675-81f6526201ef None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:52.572097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:52.605229 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b077a79-b8cc-40b1-bcd9-b0885dbd0d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:52.606439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b077a79-b8cc-40b1-bcd9-b0885dbd0d51 None admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:52.606921 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b077a79-b8cc-40b1-bcd9-b0885dbd0d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:52.607354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b077a79-b8cc-40b1-bcd9-b0885dbd0d51 None admin] PATH_INFO: `/v3/projects/0d3b0d8a1192409199c14f809f83c500/users/e941a7c6994b4caf960392573fa084ec/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:52.610240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b077a79-b8cc-40b1-bcd9-b0885dbd0d51 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d3b0d8a1192409199c14f809f83c500, user_id=e941a7c6994b4caf960392573fa084ec, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:52.612088 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b077a79-b8cc-40b1-bcd9-b0885dbd0d51 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:52.640848 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 69/138] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:00:52 2022] PUT /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c/users/360bd68e46a04911b5f7e4be275448d0/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:00:52.641859 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba482c91-68b2-41a7-9675-81f6526201ef None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:52.725924 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 70/139] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:00:52 2022] PUT /identity/v3/projects/0d3b0d8a1192409199c14f809f83c500/users/e941a7c6994b4caf960392573fa084ec/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:00:52.757204 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba482c91-68b2-41a7-9675-81f6526201ef None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:52.806973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8e272-5d02-4303-a537-1d7dffcae14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:52.808158 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8e272-5d02-4303-a537-1d7dffcae14a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:52.808702 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8e272-5d02-4303-a537-1d7dffcae14a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:52.809205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8e272-5d02-4303-a537-1d7dffcae14a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:52.829774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8e272-5d02-4303-a537-1d7dffcae14a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:52.838209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-a7f8e272-5d02-4303-a537-1d7dffcae14a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 21:00:52.838209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:52.838209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:52.838209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:52.838209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:52.838209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:52.838209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:52.838209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:52.838209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:52.838209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:52.838209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:52.838209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:52.838209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:52.838209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:52.838209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:52.838209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:52.839141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:52.839141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:52.839141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:52.839141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:52.839141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:52.839141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:52.839141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:52.839141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:52.839141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:52.839141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:52.839141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:52.839141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:00:52.839141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:52.839141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:52.839141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:52.839141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:52.839892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:52.839892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:52.839892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:52.839892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:52.839892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:52.839892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:52.839892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:52.839892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:52.839892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:52.839892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:52.839892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 21:00:52.839892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:00:52.842502 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 70/140] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:00:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:00:52.849487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b077a79-b8cc-40b1-bcd9-b0885dbd0d51 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:52.963446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b077a79-b8cc-40b1-bcd9-b0885dbd0d51 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:53.002681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e316d0-e6e8-4798-8843-6eb3969fac53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:53.004189 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e316d0-e6e8-4798-8843-6eb3969fac53 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:53.005469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e316d0-e6e8-4798-8843-6eb3969fac53 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:53.005950 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e316d0-e6e8-4798-8843-6eb3969fac53 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:53.007744 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e316d0-e6e8-4798-8843-6eb3969fac53 None admin] RBAC: Adding query filter params (name=member) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:53.008270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e316d0-e6e8-4798-8843-6eb3969fac53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:53.010760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e316d0-e6e8-4798-8843-6eb3969fac53 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:53.021429 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 71/141] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:00:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:53.026828 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8e272-5d02-4303-a537-1d7dffcae14a None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:53.079513 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:53.142984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8e272-5d02-4303-a537-1d7dffcae14a None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:53.181550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57eadaf-c6a7-42af-bb0c-157902a2ae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:53.182445 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57eadaf-c6a7-42af-bb0c-157902a2ae2a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:53.182830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57eadaf-c6a7-42af-bb0c-157902a2ae2a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:53.183025 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57eadaf-c6a7-42af-bb0c-157902a2ae2a None admin] PATH_INFO: `/v3/users/e941a7c6994b4caf960392573fa084ec` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:53.184222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57eadaf-c6a7-42af-bb0c-157902a2ae2a None admin] RBAC: Authorizing `identity:get_user(user_id=e941a7c6994b4caf960392573fa084ec)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:53.189884 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57eadaf-c6a7-42af-bb0c-157902a2ae2a None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:53.191750 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 71/142] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:00:53 2022] GET /identity/v3/users/e941a7c6994b4caf960392573fa084ec => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:53.197664 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e316d0-e6e8-4798-8843-6eb3969fac53 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:53.230980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:53.327122 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e316d0-e6e8-4798-8843-6eb3969fac53 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:53.368002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592eae3-c4c0-4c87-b965-0755b9e9d36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:53.368598 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592eae3-c4c0-4c87-b965-0755b9e9d36f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:53.368890 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592eae3-c4c0-4c87-b965-0755b9e9d36f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:53.369172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592eae3-c4c0-4c87-b965-0755b9e9d36f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:53.444960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592eae3-c4c0-4c87-b965-0755b9e9d36f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:53.446462 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592eae3-c4c0-4c87-b965-0755b9e9d36f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:53.478351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:53.576891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 72/143] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:00:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:00:53.582972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57eadaf-c6a7-42af-bb0c-157902a2ae2a None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:53.689682 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57eadaf-c6a7-42af-bb0c-157902a2ae2a None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:53.696962 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:53.736238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ea6a3-ba37-41ac-b80f-b757c3c43a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:53.737161 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea6a3-ba37-41ac-b80f-b757c3c43a7a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:53.737892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea6a3-ba37-41ac-b80f-b757c3c43a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:53.738183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea6a3-ba37-41ac-b80f-b757c3c43a7a None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:53.739461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ea6a3-ba37-41ac-b80f-b757c3c43a7a None admin] RBAC: Authorizing `identity:get_project(project_id=8e241471fdd8481c81049b886aa4ed5c)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:53.741023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ea6a3-ba37-41ac-b80f-b757c3c43a7a None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:53.748924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 72/144] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:00:53 2022] GET /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:53.749562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592eae3-c4c0-4c87-b965-0755b9e9d36f None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:53.895665 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592eae3-c4c0-4c87-b965-0755b9e9d36f None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:53.937655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d2ea6-ada2-4fac-8a6f-49663fca6fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:53.938327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d2ea6-ada2-4fac-8a6f-49663fca6fac None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:53.938618 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d2ea6-ada2-4fac-8a6f-49663fca6fac None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:53.938901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d2ea6-ada2-4fac-8a6f-49663fca6fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:53.939807 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d2ea6-ada2-4fac-8a6f-49663fca6fac None admin] RBAC: Adding query filter params (role.id=7cbf3c401d60412fbcae272fb8d191cc, scope.project.id=8e241471fdd8481c81049b886aa4ed5c, user.id=e941a7c6994b4caf960392573fa084ec) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:53.940070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d2ea6-ada2-4fac-8a6f-49663fca6fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:53.941586 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d2ea6-ada2-4fac-8a6f-49663fca6fac None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:53.943555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:53.953877 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 73/145] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:00:53 2022] GET /identity/v3/role_assignments?user.id=e941a7c6994b4caf960392573fa084ec&scope.project.id=8e241471fdd8481c81049b886aa4ed5c&role.id=7cbf3c401d60412fbcae272fb8d191cc => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:54.487276 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631c152-38f7-4f11-87bf-41f91431d05b None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:54.487786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631c152-38f7-4f11-87bf-41f91431d05b None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:54.487858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631c152-38f7-4f11-87bf-41f91431d05b None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:54.489395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 73/146] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:54.494770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397404-01a3-4fb1-a421-15fa295eb90b None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:54.495294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397404-01a3-4fb1-a421-15fa295eb90b None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:54.495377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397404-01a3-4fb1-a421-15fa295eb90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:54.514923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-85397404-01a3-4fb1-a421-15fa295eb90b None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:54.516692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-85397404-01a3-4fb1-a421-15fa295eb90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:54.620079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 74/147] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:54.654940 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631c152-38f7-4f11-87bf-41f91431d05b None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:54.789977 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631c152-38f7-4f11-87bf-41f91431d05b None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:54.846452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c46463-0638-4501-a2cd-e35a782fe425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:54.847297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c46463-0638-4501-a2cd-e35a782fe425 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:54.847600 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c46463-0638-4501-a2cd-e35a782fe425 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:54.847883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c46463-0638-4501-a2cd-e35a782fe425 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:54.859325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c46463-0638-4501-a2cd-e35a782fe425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:54.871499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-a0c46463-0638-4501-a2cd-e35a782fe425 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 21:00:54.871499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:54.871499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:54.871499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:54.871499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:54.871499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:54.871499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:54.871499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:54.871499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:54.871499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:54.871499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:54.871499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:54.871499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:54.871499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:54.871499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:54.871499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:54.872416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:54.872416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:54.872416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:54.872416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:54.872416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:54.872416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:54.872416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:54.872416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:54.872416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:54.872416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:54.872416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:54.872416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:00:54.872416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:54.872416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:54.872416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:54.872416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:54.873192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:54.873192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:54.873192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:54.873192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:54.873192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:54.873192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:54.873192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:54.873192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:54.873192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:54.873192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:54.873192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 21:00:54.873192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:00:54.873192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 74/148] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:00:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:00:54.881784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85397404-01a3-4fb1-a421-15fa295eb90b None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:54.985661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1b8da-773d-4a4c-bec2-30ad5370ae3e None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:54.985971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1b8da-773d-4a4c-bec2-30ad5370ae3e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:54.986225 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1b8da-773d-4a4c-bec2-30ad5370ae3e None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:54.987764 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 75/149] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:00:54.994219 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4caf8-7018-4642-b657-cefff74c9a50 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:54.994513 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4caf8-7018-4642-b657-cefff74c9a50 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:54.994797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4caf8-7018-4642-b657-cefff74c9a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:55.013928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-bde4caf8-7018-4642-b657-cefff74c9a50 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:55.015633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-bde4caf8-7018-4642-b657-cefff74c9a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:55.049714 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:55.068666 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85397404-01a3-4fb1-a421-15fa295eb90b None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:55.093944 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:55.100714 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 76/150] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:00:55.102471 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d973ee-81bb-4b48-8c33-12ab85cff29a None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:55.102915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d973ee-81bb-4b48-8c33-12ab85cff29a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:55.103343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d973ee-81bb-4b48-8c33-12ab85cff29a None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:55.109960 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 77/151] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:55.114054 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fdc97-f481-4213-bfd5-ee183e0a9905 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:55.114345 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fdc97-f481-4213-bfd5-ee183e0a9905 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:55.114626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fdc97-f481-4213-bfd5-ee183e0a9905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:55.123892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d91f4a-c4b8-4bc9-947a-f9ecf79c2aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:55.124573 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d91f4a-c4b8-4bc9-947a-f9ecf79c2aba None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:55.124879 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d91f4a-c4b8-4bc9-947a-f9ecf79c2aba None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:55.125883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d91f4a-c4b8-4bc9-947a-f9ecf79c2aba None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:55.126550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d91f4a-c4b8-4bc9-947a-f9ecf79c2aba None admin] RBAC: Adding query filter params (name=reader) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:55.128569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d91f4a-c4b8-4bc9-947a-f9ecf79c2aba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:55.133887 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d91f4a-c4b8-4bc9-947a-f9ecf79c2aba None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:55.139271 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-0c5fdc97-f481-4213-bfd5-ee183e0a9905 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:55.140446 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0c5fdc97-f481-4213-bfd5-ee183e0a9905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:55.145644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 75/152] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:00:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:55.146866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d91f4a-c4b8-4bc9-947a-f9ecf79c2aba None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:55.218478 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 78/153] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:55.219387 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fdc97-f481-4213-bfd5-ee183e0a9905 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:55.282653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d91f4a-c4b8-4bc9-947a-f9ecf79c2aba None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:55.319644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45ad8d-13b3-4ae0-bb45-ea6a17a5f398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:55.320305 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45ad8d-13b3-4ae0-bb45-ea6a17a5f398 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:55.320708 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45ad8d-13b3-4ae0-bb45-ea6a17a5f398 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:55.320993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45ad8d-13b3-4ae0-bb45-ea6a17a5f398 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:55.322209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45ad8d-13b3-4ae0-bb45-ea6a17a5f398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:55.323667 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45ad8d-13b3-4ae0-bb45-ea6a17a5f398 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:55.325550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 76/154] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:00:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:55.326198 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45ad8d-13b3-4ae0-bb45-ea6a17a5f398 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:55.364595 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:55.374023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fdc97-f481-4213-bfd5-ee183e0a9905 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:55.385681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:55.423159 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49588725-5a02-4ee0-8c3c-b2278a6e0708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:55.424399 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49588725-5a02-4ee0-8c3c-b2278a6e0708 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:55.425381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49588725-5a02-4ee0-8c3c-b2278a6e0708 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:55.426105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49588725-5a02-4ee0-8c3c-b2278a6e0708 None admin] PATH_INFO: `/v3/users/1d547a89a23243dfaa66ecf588590a3e` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:55.428336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49588725-5a02-4ee0-8c3c-b2278a6e0708 None admin] RBAC: Authorizing `identity:get_user(user_id=1d547a89a23243dfaa66ecf588590a3e)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:55.430908 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49588725-5a02-4ee0-8c3c-b2278a6e0708 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:55.433578 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 79/155] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:00:55 2022] GET /identity/v3/users/1d547a89a23243dfaa66ecf588590a3e => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:55.434154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49588725-5a02-4ee0-8c3c-b2278a6e0708 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:55.441278 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45ad8d-13b3-4ae0-bb45-ea6a17a5f398 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:55.476794 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a3d60-ac28-4cbc-9c62-bf4908652b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:55.477602 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a3d60-ac28-4cbc-9c62-bf4908652b2f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:55.477882 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a3d60-ac28-4cbc-9c62-bf4908652b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:55.478146 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a3d60-ac28-4cbc-9c62-bf4908652b2f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:55.490017 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a3d60-ac28-4cbc-9c62-bf4908652b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:55.498144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-021a3d60-ac28-4cbc-9c62-bf4908652b2f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:00:55.498144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:55.498144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:55.498144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:55.498144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:55.498144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:55.498144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:55.498144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:55.498144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:55.498144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:55.498144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:55.498144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:55.498144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:55.498144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:55.498144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:55.498144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:55.499418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:55.499418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:55.499418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:55.499418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:55.499418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:55.499418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:55.499418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:55.499418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:55.499418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:55.499418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:55.499418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:55.499418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:00:55.499418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:55.499418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:55.499418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:55.499418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:55.500309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:55.500309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:55.500309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:55.500309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:55.500309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:55.500309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:55.500309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:55.500309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:55.500309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:55.500309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:55.500309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:00:55.500309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:00:55.500309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 77/156] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:00:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:00:55.500309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a3d60-ac28-4cbc-9c62-bf4908652b2f None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:55.572397 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49588725-5a02-4ee0-8c3c-b2278a6e0708 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:55.610515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac22e60-c73a-4de3-93a3-e1257e0e1ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:55.611446 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac22e60-c73a-4de3-93a3-e1257e0e1ec8 None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:55.611945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac22e60-c73a-4de3-93a3-e1257e0e1ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:55.612460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac22e60-c73a-4de3-93a3-e1257e0e1ec8 None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:55.613426 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac22e60-c73a-4de3-93a3-e1257e0e1ec8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:55.615092 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac22e60-c73a-4de3-93a3-e1257e0e1ec8 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:55.630429 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a3d60-ac28-4cbc-9c62-bf4908652b2f None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:55.644702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:55.666535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e992c3c-0cfe-4b41-854a-4dcaf9581fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:55.667992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e992c3c-0cfe-4b41-854a-4dcaf9581fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:55.668469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e992c3c-0cfe-4b41-854a-4dcaf9581fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:55.669014 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e992c3c-0cfe-4b41-854a-4dcaf9581fb1 None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:55.671253 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e992c3c-0cfe-4b41-854a-4dcaf9581fb1 None admin] RBAC: Authorizing `identity:get_project(project_id=8e241471fdd8481c81049b886aa4ed5c)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:55.674602 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e992c3c-0cfe-4b41-854a-4dcaf9581fb1 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:55.678107 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 78/157] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:00:55 2022] GET /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:55.679337 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e992c3c-0cfe-4b41-854a-4dcaf9581fb1 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:55.690067 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 80/158] 10.222.0.66 () {60 vars in 1132 bytes} [Thu May 26 21:00:55 2022] POST /identity/v3/users => generated 283 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:00:55.691592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac22e60-c73a-4de3-93a3-e1257e0e1ec8 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:55.720674 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:55.838020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e992c3c-0cfe-4b41-854a-4dcaf9581fb1 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:55.841712 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac22e60-c73a-4de3-93a3-e1257e0e1ec8 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:55.880297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c714c-341d-4cde-b11e-8a2684fcc32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:55.881118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c714c-341d-4cde-b11e-8a2684fcc32e None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:55.881300 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c714c-341d-4cde-b11e-8a2684fcc32e None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:55.881575 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c714c-341d-4cde-b11e-8a2684fcc32e None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:55.882332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c714c-341d-4cde-b11e-8a2684fcc32e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:55.882967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c714c-341d-4cde-b11e-8a2684fcc32e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:55.884045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c714c-341d-4cde-b11e-8a2684fcc32e None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:55.893663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5542c-6837-4298-b1f1-654e9b1a6dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:55.894066 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 79/159] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:00:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:55.895223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5542c-6837-4298-b1f1-654e9b1a6dac None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:55.895726 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5542c-6837-4298-b1f1-654e9b1a6dac None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:55.896201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5542c-6837-4298-b1f1-654e9b1a6dac None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c/users/1d547a89a23243dfaa66ecf588590a3e/roles/d4282b64bc3b42419a613a6210a47a2b` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:55.898595 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5542c-6837-4298-b1f1-654e9b1a6dac None admin] RBAC: Authorizing `identity:create_grant(project_id=8e241471fdd8481c81049b886aa4ed5c, user_id=1d547a89a23243dfaa66ecf588590a3e, role_id=d4282b64bc3b42419a613a6210a47a2b)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:55.899787 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e4ae0-c5e0-4a8f-b570-919fa73e324b None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:55.900077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e4ae0-c5e0-4a8f-b570-919fa73e324b None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:55.900358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e4ae0-c5e0-4a8f-b570-919fa73e324b None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:55.900820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5542c-6837-4298-b1f1-654e9b1a6dac None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:55.901802 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 80/160] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:55.902520 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e4ae0-c5e0-4a8f-b570-919fa73e324b None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:55.961699 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:55.980856 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 81/161] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:00:55 2022] PUT /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c/users/1d547a89a23243dfaa66ecf588590a3e/roles/d4282b64bc3b42419a613a6210a47a2b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:00:55.982226 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad886cc-0eaa-4fe9-ae52-ad9fc9161ecc None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:55.982522 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad886cc-0eaa-4fe9-ae52-ad9fc9161ecc None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:55.982802 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad886cc-0eaa-4fe9-ae52-ad9fc9161ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:56.003726 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-0ad886cc-0eaa-4fe9-ae52-ad9fc9161ecc None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:56.005031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0ad886cc-0eaa-4fe9-ae52-ad9fc9161ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:56.046997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e4ae0-c5e0-4a8f-b570-919fa73e324b None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:56.096142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31f1d2-62bd-4cec-9a31-0aa54b4d2a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:56.097369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31f1d2-62bd-4cec-9a31-0aa54b4d2a9e None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:56.097721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31f1d2-62bd-4cec-9a31-0aa54b4d2a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:56.098062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31f1d2-62bd-4cec-9a31-0aa54b4d2a9e None admin] PATH_INFO: `/v3/users/e941a7c6994b4caf960392573fa084ec` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:56.099483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31f1d2-62bd-4cec-9a31-0aa54b4d2a9e None admin] RBAC: Authorizing `identity:get_user(user_id=e941a7c6994b4caf960392573fa084ec)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:56.101258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31f1d2-62bd-4cec-9a31-0aa54b4d2a9e None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:56.102572 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 82/162] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:56.103238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 81/163] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:00:55 2022] GET /identity/v3/users/e941a7c6994b4caf960392573fa084ec => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:56.108790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad886cc-0eaa-4fe9-ae52-ad9fc9161ecc None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:56.121257 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:56.132592 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31f1d2-62bd-4cec-9a31-0aa54b4d2a9e None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:56.258464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad886cc-0eaa-4fe9-ae52-ad9fc9161ecc None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:56.289702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31f1d2-62bd-4cec-9a31-0aa54b4d2a9e None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:56.299928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f6e5f-10e2-47bc-89eb-929745b24569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:56.300996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f6e5f-10e2-47bc-89eb-929745b24569 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:56.301471 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f6e5f-10e2-47bc-89eb-929745b24569 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:56.301916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f6e5f-10e2-47bc-89eb-929745b24569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:56.307662 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:56.333193 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd585ab-dd77-4d13-a170-b6ecc9962366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:56.334697 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd585ab-dd77-4d13-a170-b6ecc9962366 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:56.335055 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd585ab-dd77-4d13-a170-b6ecc9962366 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:56.335405 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd585ab-dd77-4d13-a170-b6ecc9962366 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:56.351915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd585ab-dd77-4d13-a170-b6ecc9962366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:56.362104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-2bd585ab-dd77-4d13-a170-b6ecc9962366 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 21:00:56.362104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:56.362104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:56.362104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:56.362104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:56.362104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:56.362104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:56.362104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:56.362104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:56.362104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:56.362104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:56.362104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:56.362104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:56.362104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:56.362104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:56.362104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:56.363008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:56.363008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:56.363008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:56.363008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:56.363008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:56.363008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:56.363008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:56.363008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:56.363008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:56.363008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:56.363008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:56.363008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:00:56.363008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:56.363008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:56.363008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:56.363008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:56.363768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:56.363768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:56.363768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:56.363768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:56.363768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:56.363768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:56.363768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:56.363768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:56.363768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:56.363768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:56.363768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 21:00:56.363768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:00:56.363768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 82/164] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:00:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:00:56.367923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a431a-5538-437a-b3e7-3eab377ad47f None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:56.367923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a431a-5538-437a-b3e7-3eab377ad47f None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:56.367923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a431a-5538-437a-b3e7-3eab377ad47f None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:56.368201 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 83/165] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:56.372870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a431a-5538-437a-b3e7-3eab377ad47f None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:56.406915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f6e5f-10e2-47bc-89eb-929745b24569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:56.409750 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f6e5f-10e2-47bc-89eb-929745b24569 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:56.423463 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:56.525891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a431a-5538-437a-b3e7-3eab377ad47f None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:56.560923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 83/166] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:00:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 21:00:56.563810 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb303455-313d-4ea6-a12f-c1e259283b89 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:56.563810 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb303455-313d-4ea6-a12f-c1e259283b89 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:56.564133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb303455-313d-4ea6-a12f-c1e259283b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:56.586079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d41bd-369a-49a7-b0c8-7d04240a0558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:56.587182 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d41bd-369a-49a7-b0c8-7d04240a0558 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:56.587673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d41bd-369a-49a7-b0c8-7d04240a0558 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:56.588442 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d41bd-369a-49a7-b0c8-7d04240a0558 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:56.589418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d41bd-369a-49a7-b0c8-7d04240a0558 None admin] RBAC: Adding query filter params (name=member) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:56.589908 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d41bd-369a-49a7-b0c8-7d04240a0558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:56.591654 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d41bd-369a-49a7-b0c8-7d04240a0558 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:56.592239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-bb303455-313d-4ea6-a12f-c1e259283b89 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:56.593547 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-bb303455-313d-4ea6-a12f-c1e259283b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:56.604286 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 84/167] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:00:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:56.605914 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d41bd-369a-49a7-b0c8-7d04240a0558 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:56.647525 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:56.697458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 84/168] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:56.698323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb303455-313d-4ea6-a12f-c1e259283b89 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:56.776941 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:56.788148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d41bd-369a-49a7-b0c8-7d04240a0558 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:56.859888 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452111b0-5681-4c48-8b5a-7fdaf60c7880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:56.860756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452111b0-5681-4c48-8b5a-7fdaf60c7880 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:56.861039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452111b0-5681-4c48-8b5a-7fdaf60c7880 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:56.861321 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452111b0-5681-4c48-8b5a-7fdaf60c7880 None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:56.869465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452111b0-5681-4c48-8b5a-7fdaf60c7880 None admin] RBAC: Authorizing `identity:get_project(project_id=8e241471fdd8481c81049b886aa4ed5c)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:56.870990 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452111b0-5681-4c48-8b5a-7fdaf60c7880 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:56.873005 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 85/169] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:00:56 2022] GET /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:56.874516 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452111b0-5681-4c48-8b5a-7fdaf60c7880 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:56.886848 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb303455-313d-4ea6-a12f-c1e259283b89 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:56.930288 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ae531-821d-4fed-9078-b9f073c26b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:56.931615 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ae531-821d-4fed-9078-b9f073c26b15 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:56.932111 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ae531-821d-4fed-9078-b9f073c26b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:56.932642 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ae531-821d-4fed-9078-b9f073c26b15 None admin] PATH_INFO: `/v3/users/e941a7c6994b4caf960392573fa084ec` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:56.934730 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ae531-821d-4fed-9078-b9f073c26b15 None admin] RBAC: Authorizing `identity:get_user(user_id=e941a7c6994b4caf960392573fa084ec)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:56.936888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ae531-821d-4fed-9078-b9f073c26b15 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:56.938835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 85/170] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:00:56 2022] GET /identity/v3/users/e941a7c6994b4caf960392573fa084ec => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:56.939817 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ae531-821d-4fed-9078-b9f073c26b15 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:57.117995 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:57.121347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ae531-821d-4fed-9078-b9f073c26b15 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:57.124907 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452111b0-5681-4c48-8b5a-7fdaf60c7880 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:57.136924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:57.185832 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab627a8-b9b3-4765-bc1d-65b2976cd562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:57.186768 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab627a8-b9b3-4765-bc1d-65b2976cd562 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:57.187058 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab627a8-b9b3-4765-bc1d-65b2976cd562 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:57.187334 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab627a8-b9b3-4765-bc1d-65b2976cd562 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:57.188252 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab627a8-b9b3-4765-bc1d-65b2976cd562 None admin] RBAC: Adding query filter params (role.id=d45da92733d441d7bfeeb10c762c6138, scope.project.id=8e241471fdd8481c81049b886aa4ed5c, user.id=e941a7c6994b4caf960392573fa084ec) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:57.188564 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab627a8-b9b3-4765-bc1d-65b2976cd562 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:57.190034 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab627a8-b9b3-4765-bc1d-65b2976cd562 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:57.192977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5b083-7a83-4319-ba72-17a033fb9a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:57.193773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5b083-7a83-4319-ba72-17a033fb9a75 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:57.194054 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5b083-7a83-4319-ba72-17a033fb9a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:57.194324 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5b083-7a83-4319-ba72-17a033fb9a75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:57.206160 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 86/171] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:00:56 2022] GET /identity/v3/role_assignments?user.id=e941a7c6994b4caf960392573fa084ec&scope.project.id=8e241471fdd8481c81049b886aa4ed5c&role.id=d45da92733d441d7bfeeb10c762c6138 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:57.207056 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab627a8-b9b3-4765-bc1d-65b2976cd562 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:57.213613 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5b083-7a83-4319-ba72-17a033fb9a75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:57.227750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-4ce5b083-7a83-4319-ba72-17a033fb9a75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:00:57.227750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:57.227750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:57.227750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:57.227750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:57.227750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:57.227750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:57.227750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:57.227750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:57.227750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:57.227750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:57.227750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:57.227750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:57.227750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:57.227750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:57.227750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:57.231487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:57.231487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:57.231487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:57.231487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:57.231487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:57.231487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:57.231487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:57.231487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:57.231487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:57.231487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:57.231487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:57.231487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:00:57.231487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:57.231487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:57.231487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:57.231487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:57.232351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:57.232351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:57.232351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:57.232351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:57.232351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:57.232351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:57.232351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:57.232351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:57.232351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:57.232351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:57.232351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:00:57.232351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:00:57.232351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 86/172] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:00:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:00:57.238258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5b083-7a83-4319-ba72-17a033fb9a75 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:57.421180 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab627a8-b9b3-4765-bc1d-65b2976cd562 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:57.455568 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5b083-7a83-4319-ba72-17a033fb9a75 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:57.488882 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b0413-ccba-4a77-b4bd-14bcd8afb18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:57.489559 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b0413-ccba-4a77-b4bd-14bcd8afb18b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:57.489843 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b0413-ccba-4a77-b4bd-14bcd8afb18b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:57.490122 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b0413-ccba-4a77-b4bd-14bcd8afb18b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:57.525634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9661e9-10be-4d3c-b955-6f50e3dfc9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:57.526323 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9661e9-10be-4d3c-b955-6f50e3dfc9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:57.526872 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9661e9-10be-4d3c-b955-6f50e3dfc9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:57.526960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9661e9-10be-4d3c-b955-6f50e3dfc9c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:57.527672 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9661e9-10be-4d3c-b955-6f50e3dfc9c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:57.527987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9661e9-10be-4d3c-b955-6f50e3dfc9c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:57.529418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9661e9-10be-4d3c-b955-6f50e3dfc9c4 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:57.548706 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 87/173] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:00:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:57.551980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9661e9-10be-4d3c-b955-6f50e3dfc9c4 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:57.559663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:57.603462 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:57.616335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b0413-ccba-4a77-b4bd-14bcd8afb18b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:57.618859 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b0413-ccba-4a77-b4bd-14bcd8afb18b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:57.766291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9661e9-10be-4d3c-b955-6f50e3dfc9c4 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:57.796024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 87/174] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:00:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:00:57.802707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b0413-ccba-4a77-b4bd-14bcd8afb18b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:57.821594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b5624-7929-417f-8c8d-895bc9212f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:57.822829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b5624-7929-417f-8c8d-895bc9212f90 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:57.823344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b5624-7929-417f-8c8d-895bc9212f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:57.823822 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b5624-7929-417f-8c8d-895bc9212f90 None admin] PATH_INFO: `/v3/users/360bd68e46a04911b5f7e4be275448d0` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:57.825414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b5624-7929-417f-8c8d-895bc9212f90 None admin] RBAC: Authorizing `identity:get_user(user_id=360bd68e46a04911b5f7e4be275448d0)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:57.827293 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b5624-7929-417f-8c8d-895bc9212f90 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:57.829850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 88/175] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:00:57 2022] GET /identity/v3/users/360bd68e46a04911b5f7e4be275448d0 => generated 247 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:57.835866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b5624-7929-417f-8c8d-895bc9212f90 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:57.952914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:58.003293 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b0413-ccba-4a77-b4bd-14bcd8afb18b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:58.008973 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:58.026544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b5624-7929-417f-8c8d-895bc9212f90 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:58.063993 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e275208-3ae2-4fc1-b38c-5e1fad20670d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:58.064902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e275208-3ae2-4fc1-b38c-5e1fad20670d None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:58.065184 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e275208-3ae2-4fc1-b38c-5e1fad20670d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:58.065458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e275208-3ae2-4fc1-b38c-5e1fad20670d None admin] PATH_INFO: `/v3/projects/0d3b0d8a1192409199c14f809f83c500` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:58.069309 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e275208-3ae2-4fc1-b38c-5e1fad20670d None admin] RBAC: Authorizing `identity:get_project(project_id=0d3b0d8a1192409199c14f809f83c500)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:58.070797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e275208-3ae2-4fc1-b38c-5e1fad20670d None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:58.072869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 88/176] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:00:57 2022] GET /identity/v3/projects/0d3b0d8a1192409199c14f809f83c500 => generated 312 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:00:58.081086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5211b-d8f9-4793-83b4-8dd7db89eb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:58.081491 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e275208-3ae2-4fc1-b38c-5e1fad20670d None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:58.081758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5211b-d8f9-4793-83b4-8dd7db89eb8c None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:58.082039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5211b-d8f9-4793-83b4-8dd7db89eb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:58.082312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5211b-d8f9-4793-83b4-8dd7db89eb8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:58.192362 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5211b-d8f9-4793-83b4-8dd7db89eb8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:58.194348 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5211b-d8f9-4793-83b4-8dd7db89eb8c None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:58.242687 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e275208-3ae2-4fc1-b38c-5e1fad20670d None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:58.298828 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ce983-f50b-4292-9fc7-f347b8a957f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:58.299407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ce983-f50b-4292-9fc7-f347b8a957f5 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:58.299689 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ce983-f50b-4292-9fc7-f347b8a957f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:58.299960 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ce983-f50b-4292-9fc7-f347b8a957f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:58.300820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ce983-f50b-4292-9fc7-f347b8a957f5 None admin] RBAC: Adding query filter params (role.id=7cbf3c401d60412fbcae272fb8d191cc, scope.project.id=0d3b0d8a1192409199c14f809f83c500, user.id=e941a7c6994b4caf960392573fa084ec) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:58.301127 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ce983-f50b-4292-9fc7-f347b8a957f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:58.302577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ce983-f50b-4292-9fc7-f347b8a957f5 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:58.310875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 89/177] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:00:58 2022] GET /identity/v3/role_assignments?user.id=e941a7c6994b4caf960392573fa084ec&scope.project.id=0d3b0d8a1192409199c14f809f83c500&role.id=7cbf3c401d60412fbcae272fb8d191cc => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:00:58.370562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:58.386780 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 89/178] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:00:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:00:58.394324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ce983-f50b-4292-9fc7-f347b8a957f5 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:58.399450 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:58.541286 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ce983-f50b-4292-9fc7-f347b8a957f5 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:58.596684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca924c4-c506-4daf-9b8a-28758b61c81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:58.597597 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca924c4-c506-4daf-9b8a-28758b61c81e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:58.597875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca924c4-c506-4daf-9b8a-28758b61c81e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:58.598148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca924c4-c506-4daf-9b8a-28758b61c81e None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:58.599390 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca924c4-c506-4daf-9b8a-28758b61c81e None admin] RBAC: Authorizing `identity:get_project(project_id=8e241471fdd8481c81049b886aa4ed5c)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:58.600879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca924c4-c506-4daf-9b8a-28758b61c81e None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:58.602790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 90/179] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:00:58 2022] GET /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:58.608998 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5211b-d8f9-4793-83b4-8dd7db89eb8c None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:58.768303 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5211b-d8f9-4793-83b4-8dd7db89eb8c None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:58.814156 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b845075-2981-4d96-a6e8-b7146ceba061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:58.814753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b845075-2981-4d96-a6e8-b7146ceba061 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:58.815032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b845075-2981-4d96-a6e8-b7146ceba061 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:58.815303 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b845075-2981-4d96-a6e8-b7146ceba061 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:58.816158 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b845075-2981-4d96-a6e8-b7146ceba061 None admin] RBAC: Adding query filter params (role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.project.id=8e241471fdd8481c81049b886aa4ed5c, user.id=360bd68e46a04911b5f7e4be275448d0) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:58.816464 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b845075-2981-4d96-a6e8-b7146ceba061 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:58.817993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b845075-2981-4d96-a6e8-b7146ceba061 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:58.824832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 90/180] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:00:58 2022] GET /identity/v3/role_assignments?user.id=360bd68e46a04911b5f7e4be275448d0&scope.project.id=8e241471fdd8481c81049b886aa4ed5c&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:58.833486 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4dc4cc-2ff2-4e27-87de-8b702dc33a48 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:58.833988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4dc4cc-2ff2-4e27-87de-8b702dc33a48 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:58.834399 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4dc4cc-2ff2-4e27-87de-8b702dc33a48 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:58.836574 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 91/181] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:58.842762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212ae3e-f869-4e03-8e2c-8ec4ef0d6294 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:58.843098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212ae3e-f869-4e03-8e2c-8ec4ef0d6294 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:58.843330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212ae3e-f869-4e03-8e2c-8ec4ef0d6294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:58.861478 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-7212ae3e-f869-4e03-8e2c-8ec4ef0d6294 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:58.862681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-7212ae3e-f869-4e03-8e2c-8ec4ef0d6294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:58.922312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:58.942823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 91/182] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:00:58.986500 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4dc4cc-2ff2-4e27-87de-8b702dc33a48 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:59.108834 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:59.170863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4dc4cc-2ff2-4e27-87de-8b702dc33a48 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:59.221372 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bc047-8d1d-42ff-806e-4d15a3868d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:59.222200 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bc047-8d1d-42ff-806e-4d15a3868d8f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:59.222482 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bc047-8d1d-42ff-806e-4d15a3868d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:59.222848 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bc047-8d1d-42ff-806e-4d15a3868d8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:59.236568 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bc047-8d1d-42ff-806e-4d15a3868d8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:59.244477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-920bc047-8d1d-42ff-806e-4d15a3868d8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:00:59.244477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:59.244477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:59.244477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:59.244477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:59.244477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:59.244477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:59.244477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:59.244477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:59.244477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:59.244477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:59.244477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:59.244477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:59.244477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:59.244477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:59.244477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:59.245408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:59.245408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:59.245408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:59.245408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:59.245408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:59.245408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:59.245408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:59.245408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:59.245408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:59.245408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:59.245408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:59.245408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:00:59.245408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:59.245408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:59.245408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:59.245408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:59.246190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:59.246190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:59.246190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:59.246190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:59.246190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:59.246190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:59.246190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:59.246190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:59.246190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:59.246190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:59.246190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:00:59.246190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:00:59.246190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 92/183] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:00:59.253227 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212ae3e-f869-4e03-8e2c-8ec4ef0d6294 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:59.356384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212ae3e-f869-4e03-8e2c-8ec4ef0d6294 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:59.391545 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8f31c-c750-4097-87f5-7bcea65f74e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:59.392154 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8f31c-c750-4097-87f5-7bcea65f74e0 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:59.392432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8f31c-c750-4097-87f5-7bcea65f74e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:59.392737 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8f31c-c750-4097-87f5-7bcea65f74e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:59.393513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8f31c-c750-4097-87f5-7bcea65f74e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:00:59.393821 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8f31c-c750-4097-87f5-7bcea65f74e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:59.395256 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8f31c-c750-4097-87f5-7bcea65f74e0 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:59.405129 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 92/184] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:00:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:59.411131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bc047-8d1d-42ff-806e-4d15a3868d8f None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:59.521381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bc047-8d1d-42ff-806e-4d15a3868d8f None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:59.555874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:59.560143 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874f865-1744-4fb1-a61f-2ffa60d7a6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:59.562369 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874f865-1744-4fb1-a61f-2ffa60d7a6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:59.562897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874f865-1744-4fb1-a61f-2ffa60d7a6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:59.563380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874f865-1744-4fb1-a61f-2ffa60d7a6e5 None admin] PATH_INFO: `/v3/users/016ef01e4d5e4a43834e199292f3ba3d` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:59.580360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874f865-1744-4fb1-a61f-2ffa60d7a6e5 None admin] RBAC: Authorizing `identity:get_user(user_id=016ef01e4d5e4a43834e199292f3ba3d)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:59.582275 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874f865-1744-4fb1-a61f-2ffa60d7a6e5 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:59.584806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 93/185] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:00:59 2022] GET /identity/v3/users/016ef01e4d5e4a43834e199292f3ba3d => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:00:59.590418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8f31c-c750-4097-87f5-7bcea65f74e0 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:59.611569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a756b20-f2f3-400c-baa2-5e0b211895d4 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:59.611911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a756b20-f2f3-400c-baa2-5e0b211895d4 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:59.612128 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a756b20-f2f3-400c-baa2-5e0b211895d4 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:59.614063 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 94/186] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:59.619971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89af69d-ade9-47f6-bf6f-09140885a83e None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:59.620270 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89af69d-ade9-47f6-bf6f-09140885a83e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:59.620521 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89af69d-ade9-47f6-bf6f-09140885a83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:59.643223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-b89af69d-ade9-47f6-bf6f-09140885a83e None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:59.644335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-b89af69d-ade9-47f6-bf6f-09140885a83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:59.647762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:59.707660 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8f31c-c750-4097-87f5-7bcea65f74e0 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:59.725619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 95/187] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:00:59.747157 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223119e3-1a69-4917-81fe-87426d611e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:59.748038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223119e3-1a69-4917-81fe-87426d611e93 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:59.748614 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223119e3-1a69-4917-81fe-87426d611e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:59.748896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223119e3-1a69-4917-81fe-87426d611e93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:59.750227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89af69d-ade9-47f6-bf6f-09140885a83e None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:59.822809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223119e3-1a69-4917-81fe-87426d611e93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:59.824254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223119e3-1a69-4917-81fe-87426d611e93 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:59.869763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89af69d-ade9-47f6-bf6f-09140885a83e None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:59.871534 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:59.887732 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:59.904574 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057074e-ccc6-4cda-9483-9b19118fc4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:59.905369 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057074e-ccc6-4cda-9483-9b19118fc4dc None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:59.905654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057074e-ccc6-4cda-9483-9b19118fc4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:59.905924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057074e-ccc6-4cda-9483-9b19118fc4dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:59.916026 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057074e-ccc6-4cda-9483-9b19118fc4dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:00:59.923666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-a057074e-ccc6-4cda-9483-9b19118fc4dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 21:00:59.923666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:00:59.923666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:00:59.923666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:00:59.923666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:00:59.923666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:00:59.923666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:00:59.923666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:00:59.923666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:00:59.923666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:00:59.923666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:00:59.923666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:00:59.923666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:00:59.923666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:00:59.923666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:00:59.923666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:00:59.924719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:00:59.924719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:00:59.924719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:00:59.924719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:00:59.924719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:00:59.924719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:00:59.924719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:00:59.924719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:00:59.924719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:00:59.924719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:00:59.924719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:00:59.924719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:00:59.924719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:00:59.924719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:00:59.924719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:00:59.924719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:00:59.925737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:00:59.925737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:00:59.925737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:00:59.925737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:00:59.925737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:00:59.925737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:00:59.925737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:00:59.925737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:00:59.925737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:00:59.925737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:00:59.925737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 21:00:59.925737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:00:59.926435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 93/188] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:00:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:00:59.926514 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 96/189] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:00:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:00:59.926587 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155422d2-6625-4be6-9dfd-be60a576919d None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:59.926587 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155422d2-6625-4be6-9dfd-be60a576919d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:59.926703 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155422d2-6625-4be6-9dfd-be60a576919d None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:59.928632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 94/190] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:59.928759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cb20d-e979-49aa-8e2a-185558679ce9 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:59.928759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cb20d-e979-49aa-8e2a-185558679ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:59.928759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cb20d-e979-49aa-8e2a-185558679ce9 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:59.930225 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155422d2-6625-4be6-9dfd-be60a576919d None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:59.934926 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 97/191] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:00:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:59.935651 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cb20d-e979-49aa-8e2a-185558679ce9 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:00.032959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155422d2-6625-4be6-9dfd-be60a576919d None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:00.038406 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cb20d-e979-49aa-8e2a-185558679ce9 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:00.070773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc099a-226b-4b3c-b3e3-b7d8d45f7a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:00.071633 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc099a-226b-4b3c-b3e3-b7d8d45f7a5a None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:00.071915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc099a-226b-4b3c-b3e3-b7d8d45f7a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:00.072189 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc099a-226b-4b3c-b3e3-b7d8d45f7a5a None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:00.073415 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc099a-226b-4b3c-b3e3-b7d8d45f7a5a None admin] RBAC: Authorizing `identity:get_project(project_id=0c071ff9e8b04956814c07c7d5500549)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:00.074752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf14d5-a702-40c0-b737-9d22e6c68f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:00.074865 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc099a-226b-4b3c-b3e3-b7d8d45f7a5a None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:00.075424 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf14d5-a702-40c0-b737-9d22e6c68f3c None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:00.075708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf14d5-a702-40c0-b737-9d22e6c68f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:00.075985 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf14d5-a702-40c0-b737-9d22e6c68f3c None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:00.076542 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 95/192] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:00:59 2022] GET /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:00.076767 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf14d5-a702-40c0-b737-9d22e6c68f3c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:00.077079 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf14d5-a702-40c0-b737-9d22e6c68f3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:00.077696 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b085c-423c-4089-908b-115c2f08f8b6 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:00.078044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b085c-423c-4089-908b-115c2f08f8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:00.078823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b085c-423c-4089-908b-115c2f08f8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:00.079036 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf14d5-a702-40c0-b737-9d22e6c68f3c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:00.088218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 98/193] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:00:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:00.089497 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed65f5e-4e68-4f5e-ac04-158ad25cbc1c None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:00.089786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed65f5e-4e68-4f5e-ac04-158ad25cbc1c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:00.090063 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed65f5e-4e68-4f5e-ac04-158ad25cbc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:00.097817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-343b085c-423c-4089-908b-115c2f08f8b6 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:00.099016 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-343b085c-423c-4089-908b-115c2f08f8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:00.106503 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-7ed65f5e-4e68-4f5e-ac04-158ad25cbc1c None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:00.107683 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-7ed65f5e-4e68-4f5e-ac04-158ad25cbc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:00.108315 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:00.143030 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:00.177065 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 96/194] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:00.177065 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b085c-423c-4089-908b-115c2f08f8b6 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:00.177716 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 99/195] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:00.178939 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed65f5e-4e68-4f5e-ac04-158ad25cbc1c None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:00.276791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b085c-423c-4089-908b-115c2f08f8b6 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:00.282441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed65f5e-4e68-4f5e-ac04-158ad25cbc1c None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:00.313096 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd83d6d-3f1e-4b8b-b384-3419889b6811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:00.313787 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd83d6d-3f1e-4b8b-b384-3419889b6811 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:00.314063 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd83d6d-3f1e-4b8b-b384-3419889b6811 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:00.314334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd83d6d-3f1e-4b8b-b384-3419889b6811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:00.315168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd83d6d-3f1e-4b8b-b384-3419889b6811 None admin] RBAC: Adding query filter params (role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.project.id=0c071ff9e8b04956814c07c7d5500549, user.id=016ef01e4d5e4a43834e199292f3ba3d) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:00.315470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd83d6d-3f1e-4b8b-b384-3419889b6811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:00.319120 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd83d6d-3f1e-4b8b-b384-3419889b6811 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:00.322630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 97/196] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:01:00 2022] GET /identity/v3/role_assignments?user.id=016ef01e4d5e4a43834e199292f3ba3d&scope.project.id=0c071ff9e8b04956814c07c7d5500549&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:00.322630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd83d6d-3f1e-4b8b-b384-3419889b6811 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:00.336896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e7cd1-73f2-4fa6-91ee-0d69322de686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:00.336896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e7cd1-73f2-4fa6-91ee-0d69322de686 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:00.336896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e7cd1-73f2-4fa6-91ee-0d69322de686 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:00.336896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e7cd1-73f2-4fa6-91ee-0d69322de686 None admin] PATH_INFO: `/v3/users/1d547a89a23243dfaa66ecf588590a3e` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:00.337210 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e7cd1-73f2-4fa6-91ee-0d69322de686 None admin] RBAC: Authorizing `identity:get_user(user_id=1d547a89a23243dfaa66ecf588590a3e)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:00.337210 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e7cd1-73f2-4fa6-91ee-0d69322de686 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:00.337210 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 100/197] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:01:00 2022] GET /identity/v3/users/1d547a89a23243dfaa66ecf588590a3e => generated 289 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:00.337210 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e7cd1-73f2-4fa6-91ee-0d69322de686 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:00.346097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:00.388437 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:00.453482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd83d6d-3f1e-4b8b-b384-3419889b6811 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:00.458944 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e7cd1-73f2-4fa6-91ee-0d69322de686 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:00.490296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811c3bb-21d3-41d2-a434-760a80e26275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:00.491113 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811c3bb-21d3-41d2-a434-760a80e26275 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:00.491400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811c3bb-21d3-41d2-a434-760a80e26275 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:00.491666 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811c3bb-21d3-41d2-a434-760a80e26275 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:00.492940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811c3bb-21d3-41d2-a434-760a80e26275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:00.494432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811c3bb-21d3-41d2-a434-760a80e26275 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:00.496099 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 98/198] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:00.496914 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811c3bb-21d3-41d2-a434-760a80e26275 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:00.509130 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ec818-0f67-4129-9254-e9ff01eff764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:00.509946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ec818-0f67-4129-9254-e9ff01eff764 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:00.510225 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ec818-0f67-4129-9254-e9ff01eff764 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:00.510494 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ec818-0f67-4129-9254-e9ff01eff764 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:00.521901 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ec818-0f67-4129-9254-e9ff01eff764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:00.530191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-621ec818-0f67-4129-9254-e9ff01eff764 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:00.530191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:00.530191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:00.530191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:00.530191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:00.530191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:00.530191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:00.530191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:00.530191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:00.530191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:00.530191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:00.530191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:00.530191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:00.530191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:00.530191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:00.530191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:00.531296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:00.531296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:00.531296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:00.531296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:00.531296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:00.531296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:00.531296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:00.531296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:00.531296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:00.531296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:00.531296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:00.531296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:00.531296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:00.531296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:00.531296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:00.531296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:00.532134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:00.532134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:00.532134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:00.532134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:00.532134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:00.532134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:00.532134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:00.532134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:00.532134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:00.532134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:00.532134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:00.532134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:00.532134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 101/199] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:01:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:00.532825 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ec818-0f67-4129-9254-e9ff01eff764 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:00.606018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:00.648175 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811c3bb-21d3-41d2-a434-760a80e26275 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:00.696341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:00.698915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c04815-81a3-4a49-9584-7581d1ad2253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:00.699574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c04815-81a3-4a49-9584-7581d1ad2253 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:00.699858 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c04815-81a3-4a49-9584-7581d1ad2253 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:00.700137 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c04815-81a3-4a49-9584-7581d1ad2253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:00.701056 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ec818-0f67-4129-9254-e9ff01eff764 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:00.737308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5460bdd-3830-44d6-913a-06a126690f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:00.737983 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5460bdd-3830-44d6-913a-06a126690f8f None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:00.738263 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5460bdd-3830-44d6-913a-06a126690f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:00.738533 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5460bdd-3830-44d6-913a-06a126690f8f None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:00.739241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5460bdd-3830-44d6-913a-06a126690f8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:00.741737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5460bdd-3830-44d6-913a-06a126690f8f None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:00.770708 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c04815-81a3-4a49-9584-7581d1ad2253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:00.772188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c04815-81a3-4a49-9584-7581d1ad2253 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:00.847830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 102/200] 10.222.0.66 () {60 vars in 1132 bytes} [Thu May 26 21:01:00 2022] POST /identity/v3/users => generated 297 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:01:00.848606 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5460bdd-3830-44d6-913a-06a126690f8f None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:00.865027 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:00.883656 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 99/201] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:00.889591 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c04815-81a3-4a49-9584-7581d1ad2253 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:00.995308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5460bdd-3830-44d6-913a-06a126690f8f None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:00.999886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c04815-81a3-4a49-9584-7581d1ad2253 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:01.033844 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5cd1f-f4e8-4426-aa9b-699945c86ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:01.034959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5cd1f-f4e8-4426-aa9b-699945c86ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:01.035430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5cd1f-f4e8-4426-aa9b-699945c86ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:01.035897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5cd1f-f4e8-4426-aa9b-699945c86ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:01.036938 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5cd1f-f4e8-4426-aa9b-699945c86ab9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:01.037445 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5cd1f-f4e8-4426-aa9b-699945c86ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:01.039448 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5cd1f-f4e8-4426-aa9b-699945c86ab9 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:01.041078 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee7393-0f3e-4f0a-bf5b-3206f036c04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:01.042189 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee7393-0f3e-4f0a-bf5b-3206f036c04d None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:01.042621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee7393-0f3e-4f0a-bf5b-3206f036c04d None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:01.043030 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee7393-0f3e-4f0a-bf5b-3206f036c04d None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:01.044464 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee7393-0f3e-4f0a-bf5b-3206f036c04d None admin] RBAC: Authorizing `identity:get_project(project_id=8e241471fdd8481c81049b886aa4ed5c)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:01.046099 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee7393-0f3e-4f0a-bf5b-3206f036c04d None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:01.048309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 100/202] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:00 2022] GET /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:01.050755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 103/203] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:01.058052 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee7393-0f3e-4f0a-bf5b-3206f036c04d None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:01.058246 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5cd1f-f4e8-4426-aa9b-699945c86ab9 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:01.082368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:01.109410 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:01.177121 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee7393-0f3e-4f0a-bf5b-3206f036c04d None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:01.204048 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5cd1f-f4e8-4426-aa9b-699945c86ab9 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:01.231217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892a5ef-9d8b-4cd6-9d28-06823312d1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:01.231909 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892a5ef-9d8b-4cd6-9d28-06823312d1cd None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:01.232197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892a5ef-9d8b-4cd6-9d28-06823312d1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:01.232478 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892a5ef-9d8b-4cd6-9d28-06823312d1cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:01.234539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892a5ef-9d8b-4cd6-9d28-06823312d1cd None admin] RBAC: Adding query filter params (role.id=d4282b64bc3b42419a613a6210a47a2b, scope.project.id=8e241471fdd8481c81049b886aa4ed5c, user.id=1d547a89a23243dfaa66ecf588590a3e) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:01.234539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892a5ef-9d8b-4cd6-9d28-06823312d1cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:01.235601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892a5ef-9d8b-4cd6-9d28-06823312d1cd None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:01.243186 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 101/204] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:01:01 2022] GET /identity/v3/role_assignments?user.id=1d547a89a23243dfaa66ecf588590a3e&scope.project.id=8e241471fdd8481c81049b886aa4ed5c&role.id=d4282b64bc3b42419a613a6210a47a2b => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:01.249933 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70619575-6892-49cd-91b8-2079431996b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:01.250874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70619575-6892-49cd-91b8-2079431996b1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:01.251151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70619575-6892-49cd-91b8-2079431996b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:01.251422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70619575-6892-49cd-91b8-2079431996b1 None admin] PATH_INFO: `/v3/users/016ef01e4d5e4a43834e199292f3ba3d` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:01.253475 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70619575-6892-49cd-91b8-2079431996b1 None admin] RBAC: Authorizing `identity:get_user(user_id=016ef01e4d5e4a43834e199292f3ba3d)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:01.255521 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70619575-6892-49cd-91b8-2079431996b1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:01.258281 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 104/205] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:01:01 2022] GET /identity/v3/users/016ef01e4d5e4a43834e199292f3ba3d => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:01.264708 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892a5ef-9d8b-4cd6-9d28-06823312d1cd None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:01.391170 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892a5ef-9d8b-4cd6-9d28-06823312d1cd None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:01.402124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:01.433187 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208bee0-9c1d-485c-838d-c0b1e2cf8edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:01.434217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208bee0-9c1d-485c-838d-c0b1e2cf8edf None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:01.434697 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208bee0-9c1d-485c-838d-c0b1e2cf8edf None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:01.435155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208bee0-9c1d-485c-838d-c0b1e2cf8edf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:01.515403 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208bee0-9c1d-485c-838d-c0b1e2cf8edf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:01.517350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208bee0-9c1d-485c-838d-c0b1e2cf8edf None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:01.625878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 102/206] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:01.631568 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70619575-6892-49cd-91b8-2079431996b1 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:01.739518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:01.756811 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70619575-6892-49cd-91b8-2079431996b1 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:01.803193 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986cece-4ccf-4bb4-b11d-db70310b2f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:01.803996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986cece-4ccf-4bb4-b11d-db70310b2f66 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:01.804279 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986cece-4ccf-4bb4-b11d-db70310b2f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:01.804556 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986cece-4ccf-4bb4-b11d-db70310b2f66 None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:01.805831 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986cece-4ccf-4bb4-b11d-db70310b2f66 None admin] RBAC: Authorizing `identity:get_project(project_id=0c071ff9e8b04956814c07c7d5500549)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:01.807290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986cece-4ccf-4bb4-b11d-db70310b2f66 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:01.809319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 105/207] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:01 2022] GET /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:01.815682 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208bee0-9c1d-485c-838d-c0b1e2cf8edf None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:01.826552 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:01.921136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208bee0-9c1d-485c-838d-c0b1e2cf8edf None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:01.962999 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ced0c4-0e2e-4684-a4ce-a1cd7983dee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:01.964042 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ced0c4-0e2e-4684-a4ce-a1cd7983dee1 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:01.964526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ced0c4-0e2e-4684-a4ce-a1cd7983dee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:01.965025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ced0c4-0e2e-4684-a4ce-a1cd7983dee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:01.966061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ced0c4-0e2e-4684-a4ce-a1cd7983dee1 None admin] RBAC: Adding query filter params (role.id=d45da92733d441d7bfeeb10c762c6138, scope.project.id=0c071ff9e8b04956814c07c7d5500549, user.id=016ef01e4d5e4a43834e199292f3ba3d) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:01.966590 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ced0c4-0e2e-4684-a4ce-a1cd7983dee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:01.968250 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ced0c4-0e2e-4684-a4ce-a1cd7983dee1 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:01.975357 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 103/208] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:01:01 2022] GET /identity/v3/role_assignments?user.id=016ef01e4d5e4a43834e199292f3ba3d&scope.project.id=0c071ff9e8b04956814c07c7d5500549&role.id=d45da92733d441d7bfeeb10c762c6138 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:02.705446 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab376c00-64b0-416a-a335-851f8fa5c7ff None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:02.705958 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab376c00-64b0-416a-a335-851f8fa5c7ff None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:02.706065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab376c00-64b0-416a-a335-851f8fa5c7ff None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:02.707634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 106/209] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:02.714702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a89d1-e62d-4d93-869a-5c5c4027580e None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:02.714987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a89d1-e62d-4d93-869a-5c5c4027580e None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:02.715276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a89d1-e62d-4d93-869a-5c5c4027580e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:02.733066 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-995a89d1-e62d-4d93-869a-5c5c4027580e None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:02.734883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-995a89d1-e62d-4d93-869a-5c5c4027580e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:02.832826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 104/210] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:02.869721 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab376c00-64b0-416a-a335-851f8fa5c7ff None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:03.013136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab376c00-64b0-416a-a335-851f8fa5c7ff None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:03.061034 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c6745-6932-4a7e-80d4-9fc00a22ef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:03.062094 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c6745-6932-4a7e-80d4-9fc00a22ef3d None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:03.062407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c6745-6932-4a7e-80d4-9fc00a22ef3d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:03.062678 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c6745-6932-4a7e-80d4-9fc00a22ef3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:03.074115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c6745-6932-4a7e-80d4-9fc00a22ef3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:03.082074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-de0c6745-6932-4a7e-80d4-9fc00a22ef3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:01:03.082074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:03.082074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:03.082074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:03.082074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:03.082074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:03.082074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:03.082074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:03.082074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:03.082074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:03.082074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:03.082074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:03.082074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:03.082074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:03.082074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:03.082074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:03.082984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:03.082984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:03.082984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:03.082984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:03.082984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:03.082984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:03.082984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:03.082984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:03.082984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:03.082984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:03.082984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:03.082984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:03.082984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:03.082984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:03.082984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:03.082984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:03.083780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:03.083780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:03.083780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:03.083780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:03.083780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:03.083780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:03.083780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:03.083780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:03.083780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:03.083780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:03.083780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:01:03.083780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:03.083780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 107/211] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:01:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:03.090954 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a89d1-e62d-4d93-869a-5c5c4027580e None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:03.096006 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:03.201403 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a89d1-e62d-4d93-869a-5c5c4027580e None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:03.241154 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ed711-7e30-4867-87a3-603c4ee8aac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:03.242204 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ed711-7e30-4867-87a3-603c4ee8aac7 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:03.242694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ed711-7e30-4867-87a3-603c4ee8aac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:03.243173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ed711-7e30-4867-87a3-603c4ee8aac7 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:03.244166 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ed711-7e30-4867-87a3-603c4ee8aac7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:03.244701 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ed711-7e30-4867-87a3-603c4ee8aac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:03.246319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ed711-7e30-4867-87a3-603c4ee8aac7 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:03.256016 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 105/212] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:03.262061 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c6745-6932-4a7e-80d4-9fc00a22ef3d None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:03.279469 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:03.373726 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c6745-6932-4a7e-80d4-9fc00a22ef3d None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:03.412302 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d943db-994f-4911-ad37-a295734d60da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:03.413210 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d943db-994f-4911-ad37-a295734d60da None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:03.413489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d943db-994f-4911-ad37-a295734d60da None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:03.413761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d943db-994f-4911-ad37-a295734d60da None admin] PATH_INFO: `/v3/users/016ef01e4d5e4a43834e199292f3ba3d` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:03.414965 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d943db-994f-4911-ad37-a295734d60da None admin] RBAC: Authorizing `identity:get_user(user_id=016ef01e4d5e4a43834e199292f3ba3d)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:03.416408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d943db-994f-4911-ad37-a295734d60da None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:03.418414 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 108/213] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:01:03 2022] GET /identity/v3/users/016ef01e4d5e4a43834e199292f3ba3d => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:03.423977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ed711-7e30-4867-87a3-603c4ee8aac7 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:03.492965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:03.532720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ed711-7e30-4867-87a3-603c4ee8aac7 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:03.545389 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb30af3-7cb7-49bc-9cef-444b97a7c21b None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:03.545983 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb30af3-7cb7-49bc-9cef-444b97a7c21b None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:03.546493 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb30af3-7cb7-49bc-9cef-444b97a7c21b None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:03.548478 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 109/214] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:03.559993 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db69813-7a17-4086-9a55-8f928a765193 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:03.559993 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db69813-7a17-4086-9a55-8f928a765193 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:03.559993 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db69813-7a17-4086-9a55-8f928a765193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:03.580495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-3db69813-7a17-4086-9a55-8f928a765193 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:03.581757 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3db69813-7a17-4086-9a55-8f928a765193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:03.584977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562e2be-a3a9-4d04-90e1-6983827a605c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:03.585930 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562e2be-a3a9-4d04-90e1-6983827a605c None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:03.586367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562e2be-a3a9-4d04-90e1-6983827a605c None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:03.586795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562e2be-a3a9-4d04-90e1-6983827a605c None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:03.588174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562e2be-a3a9-4d04-90e1-6983827a605c None admin] RBAC: Authorizing `identity:get_project(project_id=0c071ff9e8b04956814c07c7d5500549)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:03.589893 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562e2be-a3a9-4d04-90e1-6983827a605c None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:03.591910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 106/215] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:03 2022] GET /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:03.597832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562e2be-a3a9-4d04-90e1-6983827a605c None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:03.664708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 110/216] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:01:03.683487 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db69813-7a17-4086-9a55-8f928a765193 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:03.696518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:03.715467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562e2be-a3a9-4d04-90e1-6983827a605c None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:03.755759 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:03.761002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0584c90-ff6c-4380-b381-9e395b8bf282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:03.762153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0584c90-ff6c-4380-b381-9e395b8bf282 None admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:03.762430 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0584c90-ff6c-4380-b381-9e395b8bf282 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:03.762856 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0584c90-ff6c-4380-b381-9e395b8bf282 None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549/users/016ef01e4d5e4a43834e199292f3ba3d/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:03.765108 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0584c90-ff6c-4380-b381-9e395b8bf282 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c071ff9e8b04956814c07c7d5500549, user_id=016ef01e4d5e4a43834e199292f3ba3d, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:03.767270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0584c90-ff6c-4380-b381-9e395b8bf282 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:03.806458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db69813-7a17-4086-9a55-8f928a765193 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:03.835722 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 107/217] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:01:03 2022] PUT /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549/users/016ef01e4d5e4a43834e199292f3ba3d/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:01:03.837824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0aa09-a86c-4bb7-979f-4700e39e003b None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:03.838303 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0aa09-a86c-4bb7-979f-4700e39e003b None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:03.838758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0aa09-a86c-4bb7-979f-4700e39e003b None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:03.840747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 108/218] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:03.846444 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d183e0b-fc36-469f-b51d-fb6c82b89336 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:03.847087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d183e0b-fc36-469f-b51d-fb6c82b89336 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:03.847544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d183e0b-fc36-469f-b51d-fb6c82b89336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:03.855756 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0b762-4720-44f1-a468-b557aa45c93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:03.856679 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0b762-4720-44f1-a468-b557aa45c93b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:03.857183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0b762-4720-44f1-a468-b557aa45c93b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:03.857470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0b762-4720-44f1-a468-b557aa45c93b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:03.868566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-0d183e0b-fc36-469f-b51d-fb6c82b89336 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:03.870279 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-0d183e0b-fc36-469f-b51d-fb6c82b89336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:03.870398 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0b762-4720-44f1-a468-b557aa45c93b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:03.879044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-1be0b762-4720-44f1-a468-b557aa45c93b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:03.879044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:03.879044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:03.879044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:03.879044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:03.879044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:03.879044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:03.879044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:03.879044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:03.879044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:03.879044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:03.879044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:03.879044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:03.879044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:03.879044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:03.879044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:03.880017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:03.880017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:03.880017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:03.880017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:03.880017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:03.880017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:03.880017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:03.880017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:03.880017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:03.880017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:03.880017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:03.880017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:03.880017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:03.880017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:03.880017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:03.880017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:03.881343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:03.881343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:03.881343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:03.881343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:03.881343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:03.881343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:03.881343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:03.881343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:03.881343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:03.881343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:03.881343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:03.881343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:03.881343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 111/219] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:01:03.887126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0b762-4720-44f1-a468-b557aa45c93b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:03.966389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 109/220] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:01:03.981302 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:03.991183 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d183e0b-fc36-469f-b51d-fb6c82b89336 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:04.008008 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0b762-4720-44f1-a468-b557aa45c93b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:04.047427 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7800a-3b9a-412e-b363-d56e7afbdebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:04.048304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7800a-3b9a-412e-b363-d56e7afbdebd None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:04.048680 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7800a-3b9a-412e-b363-d56e7afbdebd None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:04.049032 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7800a-3b9a-412e-b363-d56e7afbdebd None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:04.049882 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7800a-3b9a-412e-b363-d56e7afbdebd None admin] RBAC: Adding query filter params (name=member) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:04.050266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7800a-3b9a-412e-b363-d56e7afbdebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:04.051843 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7800a-3b9a-412e-b363-d56e7afbdebd None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:04.064611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 112/221] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:01:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:04.070977 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7800a-3b9a-412e-b363-d56e7afbdebd None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:04.114571 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d183e0b-fc36-469f-b51d-fb6c82b89336 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:04.146292 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:04.161905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e05a42-7f77-49f3-ab8f-e560efe929d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:04.162884 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e05a42-7f77-49f3-ab8f-e560efe929d0 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:04.163172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e05a42-7f77-49f3-ab8f-e560efe929d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:04.163756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e05a42-7f77-49f3-ab8f-e560efe929d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:04.165023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e05a42-7f77-49f3-ab8f-e560efe929d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:04.166979 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e05a42-7f77-49f3-ab8f-e560efe929d0 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:04.169487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 110/222] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:04.175386 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e05a42-7f77-49f3-ab8f-e560efe929d0 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:04.182204 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7800a-3b9a-412e-b363-d56e7afbdebd None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:04.220546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956c8c0-e751-4259-a115-d4d3b33f0227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:04.221470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c8c0-e751-4259-a115-d4d3b33f0227 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:04.221803 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c8c0-e751-4259-a115-d4d3b33f0227 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:04.222158 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c8c0-e751-4259-a115-d4d3b33f0227 None admin] PATH_INFO: `/v3/users/ec9dccbb5d4d48e2963f76eb765cbf32` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:04.236994 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:04.241343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956c8c0-e751-4259-a115-d4d3b33f0227 None admin] RBAC: Authorizing `identity:get_user(user_id=ec9dccbb5d4d48e2963f76eb765cbf32)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:04.243063 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956c8c0-e751-4259-a115-d4d3b33f0227 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:04.245991 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 113/223] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:01:04 2022] GET /identity/v3/users/ec9dccbb5d4d48e2963f76eb765cbf32 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:04.252139 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956c8c0-e751-4259-a115-d4d3b33f0227 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:04.304886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e05a42-7f77-49f3-ab8f-e560efe929d0 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:04.352676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c600c-87d1-430d-a8a3-14adb6d92a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:04.353386 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c600c-87d1-430d-a8a3-14adb6d92a2a None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:04.353672 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c600c-87d1-430d-a8a3-14adb6d92a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:04.354231 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c600c-87d1-430d-a8a3-14adb6d92a2a None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:04.354970 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c600c-87d1-430d-a8a3-14adb6d92a2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:04.357951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c600c-87d1-430d-a8a3-14adb6d92a2a None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:04.369257 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956c8c0-e751-4259-a115-d4d3b33f0227 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:04.407450 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c77336-c57b-4813-991f-8ad452adc98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:04.408116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c77336-c57b-4813-991f-8ad452adc98c None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:04.408397 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c77336-c57b-4813-991f-8ad452adc98c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:04.408708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c77336-c57b-4813-991f-8ad452adc98c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:04.476534 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:04.487223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c77336-c57b-4813-991f-8ad452adc98c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:04.488736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c77336-c57b-4813-991f-8ad452adc98c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:04.494034 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 111/224] 10.222.0.66 () {60 vars in 1132 bytes} [Thu May 26 21:01:04 2022] POST /identity/v3/users => generated 297 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:01:04.495704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0245555-f6ae-443b-ac4d-1a2a6ef70db3 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:04.496190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0245555-f6ae-443b-ac4d-1a2a6ef70db3 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:04.496639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0245555-f6ae-443b-ac4d-1a2a6ef70db3 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:04.498836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 112/225] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:04.506376 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d0061-325a-4101-b6b5-cb6ca0759198 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:04.507622 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d0061-325a-4101-b6b5-cb6ca0759198 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:04.508444 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d0061-325a-4101-b6b5-cb6ca0759198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:04.533795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-4b2d0061-325a-4101-b6b5-cb6ca0759198 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:04.536208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-4b2d0061-325a-4101-b6b5-cb6ca0759198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:04.607043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:04.633980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 113/226] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:04.654441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 114/227] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:04.660862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d0061-325a-4101-b6b5-cb6ca0759198 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:04.665310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c77336-c57b-4813-991f-8ad452adc98c None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:04.790294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:04.792217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d0061-325a-4101-b6b5-cb6ca0759198 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:04.800752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c77336-c57b-4813-991f-8ad452adc98c None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:04.834521 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bc440-aa51-430d-a785-13b40f7339f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:04.835435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bc440-aa51-430d-a785-13b40f7339f7 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:04.835720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bc440-aa51-430d-a785-13b40f7339f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:04.836000 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bc440-aa51-430d-a785-13b40f7339f7 None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:04.839156 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bc440-aa51-430d-a785-13b40f7339f7 None admin] RBAC: Authorizing `identity:get_project(project_id=0c071ff9e8b04956814c07c7d5500549)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:04.839290 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bc440-aa51-430d-a785-13b40f7339f7 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:04.841043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 114/228] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:04 2022] GET /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:04.844300 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41499473-3b95-4491-b06d-4c77ee6be01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:04.845240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41499473-3b95-4491-b06d-4c77ee6be01f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:04.845619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41499473-3b95-4491-b06d-4c77ee6be01f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:04.845977 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41499473-3b95-4491-b06d-4c77ee6be01f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:04.847595 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bc440-aa51-430d-a785-13b40f7339f7 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:04.859172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41499473-3b95-4491-b06d-4c77ee6be01f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:04.868116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-41499473-3b95-4491-b06d-4c77ee6be01f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:04.868116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:04.868116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:04.868116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:04.868116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:04.868116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:04.868116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:04.868116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:04.868116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:04.868116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:04.868116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:04.868116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:04.868116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:04.868116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:04.868116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:04.868116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:04.869064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:04.869064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:04.869064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:04.869064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:04.869064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:04.869064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:04.869064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:04.869064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:04.869064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:04.869064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:04.869064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:04.869064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:04.869064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:04.869064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:04.869064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:04.869064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:04.869855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:04.869855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:04.869855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:04.869855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:04.869855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:04.869855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:04.869855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:04.869855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:04.869855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:04.869855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:04.869855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:04.869855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:04.869855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 115/229] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:01:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:04.877395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41499473-3b95-4491-b06d-4c77ee6be01f None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:04.908691 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:04.989428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bc440-aa51-430d-a785-13b40f7339f7 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:05.006836 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41499473-3b95-4491-b06d-4c77ee6be01f None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:05.055164 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e639f-a323-47bc-a4c0-7a8997a2cd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:05.056127 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc052f63-d11a-4b2c-a163-2556b35ed05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:05.057079 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc052f63-d11a-4b2c-a163-2556b35ed05f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:05.057951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e639f-a323-47bc-a4c0-7a8997a2cd9c None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:05.058430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc052f63-d11a-4b2c-a163-2556b35ed05f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:05.058899 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e639f-a323-47bc-a4c0-7a8997a2cd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:05.059368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc052f63-d11a-4b2c-a163-2556b35ed05f None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:05.059920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e639f-a323-47bc-a4c0-7a8997a2cd9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:05.060936 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc052f63-d11a-4b2c-a163-2556b35ed05f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:05.062770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e639f-a323-47bc-a4c0-7a8997a2cd9c None admin] RBAC: Adding query filter params (role.id=7cbf3c401d60412fbcae272fb8d191cc, scope.project.id=0c071ff9e8b04956814c07c7d5500549, user.id=ec9dccbb5d4d48e2963f76eb765cbf32) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:05.063283 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc052f63-d11a-4b2c-a163-2556b35ed05f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:05.064913 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc052f63-d11a-4b2c-a163-2556b35ed05f None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:05.065457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e639f-a323-47bc-a4c0-7a8997a2cd9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:05.067103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e639f-a323-47bc-a4c0-7a8997a2cd9c None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:05.080155 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 116/230] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:05.082378 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 115/231] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:01:04 2022] GET /identity/v3/role_assignments?user.id=ec9dccbb5d4d48e2963f76eb765cbf32&scope.project.id=0c071ff9e8b04956814c07c7d5500549&role.id=7cbf3c401d60412fbcae272fb8d191cc => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:05.094214 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e639f-a323-47bc-a4c0-7a8997a2cd9c None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:05.255630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e639f-a323-47bc-a4c0-7a8997a2cd9c None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:05.272980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:05.313594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d6b7d-cf74-409b-8e48-c5027275cf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:05.314425 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d6b7d-cf74-409b-8e48-c5027275cf60 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:05.314768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d6b7d-cf74-409b-8e48-c5027275cf60 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:05.315049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d6b7d-cf74-409b-8e48-c5027275cf60 None admin] PATH_INFO: `/v3/users/016ef01e4d5e4a43834e199292f3ba3d` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:05.316412 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d6b7d-cf74-409b-8e48-c5027275cf60 None admin] RBAC: Authorizing `identity:get_user(user_id=016ef01e4d5e4a43834e199292f3ba3d)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:05.317995 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d6b7d-cf74-409b-8e48-c5027275cf60 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:05.319966 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 116/232] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:01:05 2022] GET /identity/v3/users/016ef01e4d5e4a43834e199292f3ba3d => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:05.325621 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc052f63-d11a-4b2c-a163-2556b35ed05f None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:05.342198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:05.438361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc052f63-d11a-4b2c-a163-2556b35ed05f None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:05.482692 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff126fd9-0134-4966-8bfa-6e2dad86f195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:05.483577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff126fd9-0134-4966-8bfa-6e2dad86f195 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:05.483859 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff126fd9-0134-4966-8bfa-6e2dad86f195 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:05.484695 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff126fd9-0134-4966-8bfa-6e2dad86f195 None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:05.485939 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff126fd9-0134-4966-8bfa-6e2dad86f195 None admin] RBAC: Authorizing `identity:get_project(project_id=0c071ff9e8b04956814c07c7d5500549)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:05.487401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff126fd9-0134-4966-8bfa-6e2dad86f195 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:05.489138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 117/233] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:05 2022] GET /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:05.494806 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d6b7d-cf74-409b-8e48-c5027275cf60 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:05.622473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d6b7d-cf74-409b-8e48-c5027275cf60 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:05.667782 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35959500-6537-456f-8bc4-b5b08deade51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:05.669071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35959500-6537-456f-8bc4-b5b08deade51 None admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:05.669560 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35959500-6537-456f-8bc4-b5b08deade51 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:05.670057 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35959500-6537-456f-8bc4-b5b08deade51 None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549/users/016ef01e4d5e4a43834e199292f3ba3d/roles/d45da92733d441d7bfeeb10c762c6138` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:05.678680 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35959500-6537-456f-8bc4-b5b08deade51 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c071ff9e8b04956814c07c7d5500549, user_id=016ef01e4d5e4a43834e199292f3ba3d, role_id=d45da92733d441d7bfeeb10c762c6138)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:05.680563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35959500-6537-456f-8bc4-b5b08deade51 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:05.766247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 117/234] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:01:05 2022] PUT /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549/users/016ef01e4d5e4a43834e199292f3ba3d/roles/d45da92733d441d7bfeeb10c762c6138 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:01:06.480990 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ffcaa-368a-4fc1-bd5f-e4e247c6b573 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:06.481538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ffcaa-368a-4fc1-bd5f-e4e247c6b573 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:06.481538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ffcaa-368a-4fc1-bd5f-e4e247c6b573 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:06.483189 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 118/235] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:06.488216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0fd04-0675-4b51-9fe5-6b55ffe732ed None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:06.488649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0fd04-0675-4b51-9fe5-6b55ffe732ed None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:06.488822 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0fd04-0675-4b51-9fe5-6b55ffe732ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:06.510411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-6ff0fd04-0675-4b51-9fe5-6b55ffe732ed None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:06.511630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-6ff0fd04-0675-4b51-9fe5-6b55ffe732ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:06.551336 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:06.593597 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 118/236] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:06.635472 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ffcaa-368a-4fc1-bd5f-e4e247c6b573 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:06.742907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:06.776066 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ffcaa-368a-4fc1-bd5f-e4e247c6b573 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:06.830129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a99b5c-8a1d-4e8e-ac6a-d7712ae23092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:06.831292 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a99b5c-8a1d-4e8e-ac6a-d7712ae23092 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:06.831787 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a99b5c-8a1d-4e8e-ac6a-d7712ae23092 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:06.832277 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a99b5c-8a1d-4e8e-ac6a-d7712ae23092 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:06.851892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a99b5c-8a1d-4e8e-ac6a-d7712ae23092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:06.859989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-42a99b5c-8a1d-4e8e-ac6a-d7712ae23092 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:01:06.859989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:06.859989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:06.859989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:06.859989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:06.859989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:06.859989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:06.859989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:06.859989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:06.859989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:06.859989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:06.859989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:06.859989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:06.859989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:06.859989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:06.859989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:06.860907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:06.860907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:06.860907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:06.860907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:06.860907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:06.860907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:06.860907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:06.860907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:06.860907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:06.860907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:06.860907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:06.860907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:06.860907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:06.860907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:06.860907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:06.860907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:06.861819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:06.861819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:06.861819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:06.861819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:06.861819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:06.861819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:06.861819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:06.861819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:06.861819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:06.861819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:06.861819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:01:06.861819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:06.864182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 119/237] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:01:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:06.873815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0fd04-0675-4b51-9fe5-6b55ffe732ed None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:06.992729 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0fd04-0675-4b51-9fe5-6b55ffe732ed None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:07.035628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650813b5-2cc7-4566-8328-41f9c4f8d5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:07.036241 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650813b5-2cc7-4566-8328-41f9c4f8d5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:07.036530 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650813b5-2cc7-4566-8328-41f9c4f8d5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:07.036836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650813b5-2cc7-4566-8328-41f9c4f8d5a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:07.037609 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650813b5-2cc7-4566-8328-41f9c4f8d5a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:07.037918 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650813b5-2cc7-4566-8328-41f9c4f8d5a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:07.039330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650813b5-2cc7-4566-8328-41f9c4f8d5a5 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:07.049115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 119/238] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:07.054721 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a99b5c-8a1d-4e8e-ac6a-d7712ae23092 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:07.212751 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a99b5c-8a1d-4e8e-ac6a-d7712ae23092 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:07.263808 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471abe85-48a4-4697-8492-da0f947f6a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:07.264776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471abe85-48a4-4697-8492-da0f947f6a55 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:07.265096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471abe85-48a4-4697-8492-da0f947f6a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:07.265383 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471abe85-48a4-4697-8492-da0f947f6a55 None admin] PATH_INFO: `/v3/users/016ef01e4d5e4a43834e199292f3ba3d` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:07.267918 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471abe85-48a4-4697-8492-da0f947f6a55 None admin] RBAC: Authorizing `identity:get_user(user_id=016ef01e4d5e4a43834e199292f3ba3d)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:07.269431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471abe85-48a4-4697-8492-da0f947f6a55 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:07.271077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 120/239] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:01:07 2022] GET /identity/v3/users/016ef01e4d5e4a43834e199292f3ba3d => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:07.276911 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650813b5-2cc7-4566-8328-41f9c4f8d5a5 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:07.310843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:07.382527 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24f6a7-6411-42d3-af0c-ba8e50f7f5c4 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:07.383160 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24f6a7-6411-42d3-af0c-ba8e50f7f5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:07.383665 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24f6a7-6411-42d3-af0c-ba8e50f7f5c4 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:07.385540 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 121/240] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:07.390773 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4ca95-e546-4fa2-99d4-875d5cc10ec5 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:07.391351 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4ca95-e546-4fa2-99d4-875d5cc10ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:07.391819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4ca95-e546-4fa2-99d4-875d5cc10ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:07.403033 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650813b5-2cc7-4566-8328-41f9c4f8d5a5 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:07.413160 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-2be4ca95-e546-4fa2-99d4-875d5cc10ec5 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:07.414737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-2be4ca95-e546-4fa2-99d4-875d5cc10ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:07.418934 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:07.440802 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df67806-84c5-45aa-bd2e-3a7694cc7844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:07.441475 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df67806-84c5-45aa-bd2e-3a7694cc7844 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:07.441763 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df67806-84c5-45aa-bd2e-3a7694cc7844 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:07.442044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df67806-84c5-45aa-bd2e-3a7694cc7844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:07.492781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 122/241] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:01:07.494981 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0972c-853c-4213-acab-f9bdf11c0590 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:07.495411 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0972c-853c-4213-acab-f9bdf11c0590 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:07.495829 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0972c-853c-4213-acab-f9bdf11c0590 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:07.497406 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 123/242] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:07.504194 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5bcb23-5174-452f-82b2-e49d62cae0be None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:07.504480 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5bcb23-5174-452f-82b2-e49d62cae0be None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:07.504793 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5bcb23-5174-452f-82b2-e49d62cae0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:07.524701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-da5bcb23-5174-452f-82b2-e49d62cae0be None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:07.525768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df67806-84c5-45aa-bd2e-3a7694cc7844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:07.526240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-da5bcb23-5174-452f-82b2-e49d62cae0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:07.528223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df67806-84c5-45aa-bd2e-3a7694cc7844 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:07.570707 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:07.605778 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 124/243] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:01:07.606677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5bcb23-5174-452f-82b2-e49d62cae0be None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:07.682288 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 120/244] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:07.683420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df67806-84c5-45aa-bd2e-3a7694cc7844 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:07.690483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:07.736551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5bcb23-5174-452f-82b2-e49d62cae0be None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:07.780259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4ee10-5bbe-426c-b839-80e8ca8fe471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:07.782388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4ee10-5bbe-426c-b839-80e8ca8fe471 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:07.783082 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4ee10-5bbe-426c-b839-80e8ca8fe471 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:07.783512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4ee10-5bbe-426c-b839-80e8ca8fe471 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:07.794360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df67806-84c5-45aa-bd2e-3a7694cc7844 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:07.798134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4ee10-5bbe-426c-b839-80e8ca8fe471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:07.807576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-7fe4ee10-5bbe-426c-b839-80e8ca8fe471 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 21:01:07.807576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:07.807576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:07.807576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:07.807576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:07.807576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:07.807576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:07.807576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:07.807576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:07.807576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:07.807576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:07.807576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:07.807576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:07.807576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:07.807576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:07.807576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:07.808708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:07.808708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:07.808708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:07.808708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:07.808708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:07.808708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:07.808708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:07.808708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:07.808708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:07.808708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:07.808708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:07.808708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:07.808708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:07.808708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:07.808708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:07.808708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:07.809718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:07.809718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:07.809718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:07.809718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:07.809718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:07.809718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:07.809718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:07.809718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:07.809718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:07.809718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:07.809718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 21:01:07.809718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:07.817560 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 125/245] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:07.817893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4ee10-5bbe-426c-b839-80e8ca8fe471 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:07.834577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:07.845855 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900981d-8ad5-45cc-96b8-221136fafc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:07.850916 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900981d-8ad5-45cc-96b8-221136fafc09 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:07.850916 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900981d-8ad5-45cc-96b8-221136fafc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:07.850916 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900981d-8ad5-45cc-96b8-221136fafc09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:07.850916 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900981d-8ad5-45cc-96b8-221136fafc09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:07.852425 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900981d-8ad5-45cc-96b8-221136fafc09 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:07.855215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 121/246] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:07.856331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900981d-8ad5-45cc-96b8-221136fafc09 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:07.941895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4ee10-5bbe-426c-b839-80e8ca8fe471 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:07.972377 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:07.983912 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d02cc5-3de6-46c0-971b-be6057f0ec25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:07.984979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d02cc5-3de6-46c0-971b-be6057f0ec25 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:07.985233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d02cc5-3de6-46c0-971b-be6057f0ec25 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:07.985523 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d02cc5-3de6-46c0-971b-be6057f0ec25 None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:07.986776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d02cc5-3de6-46c0-971b-be6057f0ec25 None admin] RBAC: Authorizing `identity:get_project(project_id=0c071ff9e8b04956814c07c7d5500549)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:07.988946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d02cc5-3de6-46c0-971b-be6057f0ec25 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:07.994034 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 126/247] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:07 2022] GET /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:07.994034 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d02cc5-3de6-46c0-971b-be6057f0ec25 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:08.002357 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900981d-8ad5-45cc-96b8-221136fafc09 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:08.042475 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e213e8c-b5a5-4321-ab13-ac7d77ca92d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:08.043510 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e213e8c-b5a5-4321-ab13-ac7d77ca92d1 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:08.044021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e213e8c-b5a5-4321-ab13-ac7d77ca92d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:08.044511 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e213e8c-b5a5-4321-ab13-ac7d77ca92d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:08.045522 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e213e8c-b5a5-4321-ab13-ac7d77ca92d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:08.046053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e213e8c-b5a5-4321-ab13-ac7d77ca92d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:08.047801 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e213e8c-b5a5-4321-ab13-ac7d77ca92d1 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:08.057623 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 122/248] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:01:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:08.058972 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e213e8c-b5a5-4321-ab13-ac7d77ca92d1 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:08.112383 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d02cc5-3de6-46c0-971b-be6057f0ec25 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:08.125674 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:08.147826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65b5f2-6cfd-4c97-a449-e1e404dbd1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:08.148512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65b5f2-6cfd-4c97-a449-e1e404dbd1f0 None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:08.148829 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65b5f2-6cfd-4c97-a449-e1e404dbd1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:08.149110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65b5f2-6cfd-4c97-a449-e1e404dbd1f0 None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:08.149832 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65b5f2-6cfd-4c97-a449-e1e404dbd1f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:08.151288 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65b5f2-6cfd-4c97-a449-e1e404dbd1f0 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:08.174490 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e213e8c-b5a5-4321-ab13-ac7d77ca92d1 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:08.210264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d454787-877d-4a65-a0ca-c113cccf0d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:08.210923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d454787-877d-4a65-a0ca-c113cccf0d91 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:08.211208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d454787-877d-4a65-a0ca-c113cccf0d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:08.211486 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d454787-877d-4a65-a0ca-c113cccf0d91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:08.212368 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d454787-877d-4a65-a0ca-c113cccf0d91 None admin] RBAC: Adding query filter params (role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.project.id=0c071ff9e8b04956814c07c7d5500549, user.id=016ef01e4d5e4a43834e199292f3ba3d) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:08.212707 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d454787-877d-4a65-a0ca-c113cccf0d91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:08.214149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d454787-877d-4a65-a0ca-c113cccf0d91 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:08.220172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 123/249] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:01:08 2022] GET /identity/v3/role_assignments?user.id=016ef01e4d5e4a43834e199292f3ba3d&scope.project.id=0c071ff9e8b04956814c07c7d5500549&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:08.221019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d454787-877d-4a65-a0ca-c113cccf0d91 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:08.240647 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 127/250] 10.222.0.66 () {60 vars in 1132 bytes} [Thu May 26 21:01:07 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:01:08.248089 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbd97c-367d-4ed5-b51d-9a703f4f9cfc None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:08.248501 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbd97c-367d-4ed5-b51d-9a703f4f9cfc None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:08.248878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbd97c-367d-4ed5-b51d-9a703f4f9cfc None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:08.250981 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 128/251] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:08.258112 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b3b4a-504e-4eb2-9850-271d9063a6ee None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:08.258473 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b3b4a-504e-4eb2-9850-271d9063a6ee None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:08.258846 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b3b4a-504e-4eb2-9850-271d9063a6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:08.296074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-b31b3b4a-504e-4eb2-9850-271d9063a6ee None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:08.297433 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-b31b3b4a-504e-4eb2-9850-271d9063a6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:08.351270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d454787-877d-4a65-a0ca-c113cccf0d91 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:08.381195 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:08.395086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df544c-4a5f-435b-80c6-d9ca412ebb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:08.396476 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df544c-4a5f-435b-80c6-d9ca412ebb64 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:08.397027 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df544c-4a5f-435b-80c6-d9ca412ebb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:08.397485 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df544c-4a5f-435b-80c6-d9ca412ebb64 None admin] PATH_INFO: `/v3/users/da2fc9db7a184826b16f19cca75653e0` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:08.406116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:08.415916 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df544c-4a5f-435b-80c6-d9ca412ebb64 None admin] RBAC: Authorizing `identity:get_user(user_id=da2fc9db7a184826b16f19cca75653e0)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:08.417968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df544c-4a5f-435b-80c6-d9ca412ebb64 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:08.420088 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 124/252] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:01:08 2022] GET /identity/v3/users/da2fc9db7a184826b16f19cca75653e0 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:08.426396 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df544c-4a5f-435b-80c6-d9ca412ebb64 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:08.466769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 129/253] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:08.493684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b3b4a-504e-4eb2-9850-271d9063a6ee None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:08.575840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df544c-4a5f-435b-80c6-d9ca412ebb64 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:08.624182 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad0377-0966-47e6-b168-f99bf6deda6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:08.625509 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad0377-0966-47e6-b168-f99bf6deda6d None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:08.625797 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad0377-0966-47e6-b168-f99bf6deda6d None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:08.626077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad0377-0966-47e6-b168-f99bf6deda6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:08.644977 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b3b4a-504e-4eb2-9850-271d9063a6ee None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:08.681489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:08.686928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55a600-33ae-48c5-9514-4cfa9e964a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:08.688313 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55a600-33ae-48c5-9514-4cfa9e964a6d None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:08.688638 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55a600-33ae-48c5-9514-4cfa9e964a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:08.688920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55a600-33ae-48c5-9514-4cfa9e964a6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:08.700819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55a600-33ae-48c5-9514-4cfa9e964a6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:08.706584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad0377-0966-47e6-b168-f99bf6deda6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:08.708075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad0377-0966-47e6-b168-f99bf6deda6d None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:08.708691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-de55a600-33ae-48c5-9514-4cfa9e964a6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:08.708691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:08.708691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:08.708691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:08.708691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:08.708691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:08.708691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:08.708691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:08.708691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:08.708691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:08.708691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:08.708691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:08.708691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:08.708691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:08.708691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:08.708691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:08.709551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:08.709551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:08.709551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:08.709551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:08.709551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:08.709551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:08.709551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:08.709551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:08.709551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:08.709551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:08.709551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:08.709551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:08.709551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:08.709551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:08.709551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:08.709551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:08.710331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:08.710331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:08.710331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:08.710331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:08.710331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:08.710331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:08.710331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:08.710331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:08.710331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:08.710331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:08.710331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:08.710331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:08.710331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 130/254] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:08.716151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55a600-33ae-48c5-9514-4cfa9e964a6d None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:08.770558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:08.842565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55a600-33ae-48c5-9514-4cfa9e964a6d None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:08.842778 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 125/255] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 21:01:08.844677 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224d415-3d3f-45fb-b2e6-07f8129ebad3 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:08.844968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224d415-3d3f-45fb-b2e6-07f8129ebad3 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:08.845252 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224d415-3d3f-45fb-b2e6-07f8129ebad3 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:08.846543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 126/256] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:08.854587 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224d415-3d3f-45fb-b2e6-07f8129ebad3 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:08.890094 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76dc7f-7397-4311-aa2e-726aae051bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:08.890866 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76dc7f-7397-4311-aa2e-726aae051bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:08.891219 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76dc7f-7397-4311-aa2e-726aae051bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:08.891617 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76dc7f-7397-4311-aa2e-726aae051bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:08.892452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76dc7f-7397-4311-aa2e-726aae051bd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:08.892896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76dc7f-7397-4311-aa2e-726aae051bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:08.894340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76dc7f-7397-4311-aa2e-726aae051bd7 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:08.903487 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 131/257] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:01:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:08.904819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380b1ff-b3d7-461f-a789-550bfd8cdbb5 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:08.905214 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380b1ff-b3d7-461f-a789-550bfd8cdbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:08.906125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380b1ff-b3d7-461f-a789-550bfd8cdbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:08.926289 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-7380b1ff-b3d7-461f-a789-550bfd8cdbb5 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:08.927719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-7380b1ff-b3d7-461f-a789-550bfd8cdbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:08.963075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:08.990555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224d415-3d3f-45fb-b2e6-07f8129ebad3 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:09.024681 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 132/258] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:09.025607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380b1ff-b3d7-461f-a789-550bfd8cdbb5 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:09.048901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e39ebd-de97-4e73-8595-e52f8e510738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:09.049804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e39ebd-de97-4e73-8595-e52f8e510738 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:09.050087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e39ebd-de97-4e73-8595-e52f8e510738 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:09.050360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e39ebd-de97-4e73-8595-e52f8e510738 None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:09.051983 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e39ebd-de97-4e73-8595-e52f8e510738 None admin] RBAC: Authorizing `identity:get_project(project_id=0c071ff9e8b04956814c07c7d5500549)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:09.053678 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e39ebd-de97-4e73-8595-e52f8e510738 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:09.055928 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 127/259] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:08 2022] GET /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:09.061573 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e39ebd-de97-4e73-8595-e52f8e510738 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:09.086253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:09.159699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380b1ff-b3d7-461f-a789-550bfd8cdbb5 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:09.164792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e39ebd-de97-4e73-8595-e52f8e510738 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:09.197811 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17644b37-ebb0-4553-84f0-1cbb6d48c7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:09.199575 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17644b37-ebb0-4553-84f0-1cbb6d48c7bf None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:09.200095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17644b37-ebb0-4553-84f0-1cbb6d48c7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:09.200199 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c91293-461e-41b0-8462-858ec1f07e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:09.200715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17644b37-ebb0-4553-84f0-1cbb6d48c7bf None admin] PATH_INFO: `/v3/users/ec9dccbb5d4d48e2963f76eb765cbf32` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:09.201044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c91293-461e-41b0-8462-858ec1f07e81 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:09.201329 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c91293-461e-41b0-8462-858ec1f07e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:09.201607 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c91293-461e-41b0-8462-858ec1f07e81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:09.203453 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17644b37-ebb0-4553-84f0-1cbb6d48c7bf None admin] RBAC: Authorizing `identity:get_user(user_id=ec9dccbb5d4d48e2963f76eb765cbf32)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:09.205198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17644b37-ebb0-4553-84f0-1cbb6d48c7bf None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:09.207467 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 133/260] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:01:09 2022] GET /identity/v3/users/ec9dccbb5d4d48e2963f76eb765cbf32 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:09.208695 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17644b37-ebb0-4553-84f0-1cbb6d48c7bf None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:09.213680 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c91293-461e-41b0-8462-858ec1f07e81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:09.222458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-14c91293-461e-41b0-8462-858ec1f07e81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:09.222458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:09.222458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:09.222458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:09.222458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:09.222458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:09.222458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:09.222458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:09.222458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:09.222458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:09.222458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:09.222458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:09.222458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:09.222458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:09.222458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:09.222458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:09.223416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:09.223416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:09.223416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:09.223416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:09.223416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:09.223416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:09.223416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:09.223416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:09.223416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:09.223416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:09.223416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:09.223416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:09.223416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:09.223416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:09.223416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:09.223416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:09.224174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:09.224174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:09.224174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:09.224174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:09.224174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:09.224174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:09.224174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:09.224174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:09.224174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:09.224174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:09.224174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:09.224174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:09.224174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 128/261] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:01:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:09.230553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c91293-461e-41b0-8462-858ec1f07e81 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:09.248973 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:09.330228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17644b37-ebb0-4553-84f0-1cbb6d48c7bf None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:09.332190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:09.334698 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c91293-461e-41b0-8462-858ec1f07e81 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:09.370113 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d1b45-363e-40cb-996c-d317a5d783a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:09.370488 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aea216-a43e-4ca2-83a6-6099ca265cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:09.371358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aea216-a43e-4ca2-83a6-6099ca265cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:09.371548 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d1b45-363e-40cb-996c-d317a5d783a5 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:09.371646 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aea216-a43e-4ca2-83a6-6099ca265cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:09.371903 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aea216-a43e-4ca2-83a6-6099ca265cf0 None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:09.372329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d1b45-363e-40cb-996c-d317a5d783a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:09.372903 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d1b45-363e-40cb-996c-d317a5d783a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:09.373181 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aea216-a43e-4ca2-83a6-6099ca265cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=0c071ff9e8b04956814c07c7d5500549)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:09.374153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d1b45-363e-40cb-996c-d317a5d783a5 None admin] RBAC: Adding query filter params (role.id=d4282b64bc3b42419a613a6210a47a2b, scope.project.id=0c071ff9e8b04956814c07c7d5500549, user.id=da2fc9db7a184826b16f19cca75653e0) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:09.374676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aea216-a43e-4ca2-83a6-6099ca265cf0 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:09.374944 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d1b45-363e-40cb-996c-d317a5d783a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:09.376728 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d1b45-363e-40cb-996c-d317a5d783a5 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:09.376837 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 129/262] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:09 2022] GET /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:09.377638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aea216-a43e-4ca2-83a6-6099ca265cf0 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:09.383635 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 134/263] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:01:09 2022] GET /identity/v3/role_assignments?user.id=da2fc9db7a184826b16f19cca75653e0&scope.project.id=0c071ff9e8b04956814c07c7d5500549&role.id=d4282b64bc3b42419a613a6210a47a2b => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:09.384751 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d1b45-363e-40cb-996c-d317a5d783a5 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:09.502425 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d1b45-363e-40cb-996c-d317a5d783a5 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:09.536967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:09.543973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83b3c4-3c52-4e69-a0ac-2267e3e67f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:09.550327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83b3c4-3c52-4e69-a0ac-2267e3e67f1d None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:09.550327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83b3c4-3c52-4e69-a0ac-2267e3e67f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:09.550327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83b3c4-3c52-4e69-a0ac-2267e3e67f1d None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549/users/ec9dccbb5d4d48e2963f76eb765cbf32/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:09.550327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83b3c4-3c52-4e69-a0ac-2267e3e67f1d None admin] RBAC: Authorizing `identity:create_grant(project_id=0c071ff9e8b04956814c07c7d5500549, user_id=ec9dccbb5d4d48e2963f76eb765cbf32, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:09.550327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83b3c4-3c52-4e69-a0ac-2267e3e67f1d None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:09.573652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aea216-a43e-4ca2-83a6-6099ca265cf0 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:09.618364 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 135/264] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:01:09 2022] PUT /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549/users/ec9dccbb5d4d48e2963f76eb765cbf32/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:01:09.629949 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982ec81-856e-4b17-9d51-aa75ff8825a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:09.631440 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982ec81-856e-4b17-9d51-aa75ff8825a4 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:09.632042 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982ec81-856e-4b17-9d51-aa75ff8825a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:09.632574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982ec81-856e-4b17-9d51-aa75ff8825a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:09.633683 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982ec81-856e-4b17-9d51-aa75ff8825a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:09.634250 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982ec81-856e-4b17-9d51-aa75ff8825a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:09.636224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982ec81-856e-4b17-9d51-aa75ff8825a4 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:09.649006 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 130/265] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:09.657497 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83b3c4-3c52-4e69-a0ac-2267e3e67f1d None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:09.693093 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:09.786385 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83b3c4-3c52-4e69-a0ac-2267e3e67f1d None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:09.828463 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6b244-81fe-401e-8f79-af918666474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:09.829847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6b244-81fe-401e-8f79-af918666474d None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:09.830388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6b244-81fe-401e-8f79-af918666474d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:09.830873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6b244-81fe-401e-8f79-af918666474d None admin] PATH_INFO: `/v3/users/016ef01e4d5e4a43834e199292f3ba3d` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:09.832643 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6b244-81fe-401e-8f79-af918666474d None admin] RBAC: Authorizing `identity:get_user(user_id=016ef01e4d5e4a43834e199292f3ba3d)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:09.834496 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6b244-81fe-401e-8f79-af918666474d None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:09.836473 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 136/266] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:01:09 2022] GET /identity/v3/users/016ef01e4d5e4a43834e199292f3ba3d => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:09.842462 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982ec81-856e-4b17-9d51-aa75ff8825a4 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:09.995695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982ec81-856e-4b17-9d51-aa75ff8825a4 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:10.035501 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44878922-c853-4c98-a319-23beaa3c762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:10.036167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44878922-c853-4c98-a319-23beaa3c762d None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:10.036534 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44878922-c853-4c98-a319-23beaa3c762d None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:10.036777 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44878922-c853-4c98-a319-23beaa3c762d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:10.045989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:10.115463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44878922-c853-4c98-a319-23beaa3c762d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:10.117056 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44878922-c853-4c98-a319-23beaa3c762d None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:10.280963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 131/267] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:10.286634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6b244-81fe-401e-8f79-af918666474d None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:10.403980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:10.412293 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6b244-81fe-401e-8f79-af918666474d None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:10.451146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f1177-b67c-45f6-b3c7-6fd71236c89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:10.452271 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f1177-b67c-45f6-b3c7-6fd71236c89f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:10.452865 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f1177-b67c-45f6-b3c7-6fd71236c89f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:10.453286 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f1177-b67c-45f6-b3c7-6fd71236c89f None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:10.454684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f1177-b67c-45f6-b3c7-6fd71236c89f None admin] RBAC: Authorizing `identity:get_project(project_id=0c071ff9e8b04956814c07c7d5500549)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:10.456316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f1177-b67c-45f6-b3c7-6fd71236c89f None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:10.458241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 137/268] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:10 2022] GET /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:10.464306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44878922-c853-4c98-a319-23beaa3c762d None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:10.529853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:10.615711 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44878922-c853-4c98-a319-23beaa3c762d None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:10.659577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb85f69-2268-4bd3-ab63-11a34973c75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:10.660432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb85f69-2268-4bd3-ab63-11a34973c75e None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:10.660564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb85f69-2268-4bd3-ab63-11a34973c75e None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:10.660904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb85f69-2268-4bd3-ab63-11a34973c75e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:10.661714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb85f69-2268-4bd3-ab63-11a34973c75e None admin] RBAC: Adding query filter params (role.id=d45da92733d441d7bfeeb10c762c6138, scope.project.id=0c071ff9e8b04956814c07c7d5500549, user.id=016ef01e4d5e4a43834e199292f3ba3d) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:10.662078 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb85f69-2268-4bd3-ab63-11a34973c75e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:10.663551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb85f69-2268-4bd3-ab63-11a34973c75e None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:10.670360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 132/269] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:01:10 2022] GET /identity/v3/role_assignments?user.id=016ef01e4d5e4a43834e199292f3ba3d&scope.project.id=0c071ff9e8b04956814c07c7d5500549&role.id=d45da92733d441d7bfeeb10c762c6138 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:11.146808 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02998c-176e-40b1-ad11-8d3e4c9eb58a None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:11.147853 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02998c-176e-40b1-ad11-8d3e4c9eb58a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:11.148361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02998c-176e-40b1-ad11-8d3e4c9eb58a None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:11.150307 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 138/270] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:11.156863 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50720cb2-ae21-47f2-ac55-cb03130cb31d None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:11.157443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50720cb2-ae21-47f2-ac55-cb03130cb31d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:11.157921 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50720cb2-ae21-47f2-ac55-cb03130cb31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:11.176861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-50720cb2-ae21-47f2-ac55-cb03130cb31d None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:11.178428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-50720cb2-ae21-47f2-ac55-cb03130cb31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:11.258473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 133/271] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:11.265569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999c8ce-9ba6-432b-94c8-7e8946f60e13 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:11.266164 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999c8ce-9ba6-432b-94c8-7e8946f60e13 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:11.266723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999c8ce-9ba6-432b-94c8-7e8946f60e13 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:11.268330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 139/272] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:11.274244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4cf2c-ab9c-47d1-8b9f-3194933c3e37 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:11.274809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4cf2c-ab9c-47d1-8b9f-3194933c3e37 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:11.275284 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4cf2c-ab9c-47d1-8b9f-3194933c3e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:11.290415 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999c8ce-9ba6-432b-94c8-7e8946f60e13 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:11.294792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-fab4cf2c-ab9c-47d1-8b9f-3194933c3e37 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:11.297119 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-fab4cf2c-ab9c-47d1-8b9f-3194933c3e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:11.349008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:11.370191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 134/273] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:01:11.394341 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4cf2c-ab9c-47d1-8b9f-3194933c3e37 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:11.423663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999c8ce-9ba6-432b-94c8-7e8946f60e13 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:11.462307 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15680807-a468-424c-b478-9d06e90b0bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:11.463642 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15680807-a468-424c-b478-9d06e90b0bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:11.464192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15680807-a468-424c-b478-9d06e90b0bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:11.464699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15680807-a468-424c-b478-9d06e90b0bf5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:11.477182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15680807-a468-424c-b478-9d06e90b0bf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:11.485786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-15680807-a468-424c-b478-9d06e90b0bf5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:11.485786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:11.485786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:11.485786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:11.485786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:11.485786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:11.485786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:11.485786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:11.485786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:11.485786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:11.485786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:11.485786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:11.485786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:11.485786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:11.485786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:11.485786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:11.486659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:11.486659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:11.486659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:11.486659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:11.486659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:11.486659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:11.486659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:11.486659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:11.486659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:11.486659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:11.486659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:11.486659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:11.486659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:11.486659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:11.486659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:11.486659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:11.487423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:11.487423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:11.487423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:11.487423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:11.487423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:11.487423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:11.487423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:11.487423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:11.487423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:11.487423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:11.487423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:11.487423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:11.490031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 140/274] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:01:11.499312 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15680807-a468-424c-b478-9d06e90b0bf5 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:11.507463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4cf2c-ab9c-47d1-8b9f-3194933c3e37 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:11.537014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:11.542867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe4151-5d3f-4ca8-945c-861cda7d0409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:11.543675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe4151-5d3f-4ca8-945c-861cda7d0409 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:11.543950 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe4151-5d3f-4ca8-945c-861cda7d0409 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:11.544219 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe4151-5d3f-4ca8-945c-861cda7d0409 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:11.545460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe4151-5d3f-4ca8-945c-861cda7d0409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:11.546975 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe4151-5d3f-4ca8-945c-861cda7d0409 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:11.552862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 135/275] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:11.556209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe4151-5d3f-4ca8-945c-861cda7d0409 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:11.589439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:11.620690 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15680807-a468-424c-b478-9d06e90b0bf5 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:11.661593 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449104d6-3b0f-4839-bae7-d4d11c9ce342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:11.662754 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449104d6-3b0f-4839-bae7-d4d11c9ce342 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:11.663187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449104d6-3b0f-4839-bae7-d4d11c9ce342 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:11.663611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449104d6-3b0f-4839-bae7-d4d11c9ce342 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:11.664539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449104d6-3b0f-4839-bae7-d4d11c9ce342 None admin] RBAC: Adding query filter params (name=member) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:11.665021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449104d6-3b0f-4839-bae7-d4d11c9ce342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:11.665459 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe4151-5d3f-4ca8-945c-861cda7d0409 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:11.667288 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449104d6-3b0f-4839-bae7-d4d11c9ce342 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:11.680976 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 141/276] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:01:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:11.683122 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449104d6-3b0f-4839-bae7-d4d11c9ce342 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:11.700456 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39feeeeb-6ca5-4487-abf4-73ad9ea7c5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:11.701280 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39feeeeb-6ca5-4487-abf4-73ad9ea7c5d0 None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:11.701464 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39feeeeb-6ca5-4487-abf4-73ad9ea7c5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:11.701739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39feeeeb-6ca5-4487-abf4-73ad9ea7c5d0 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:11.703003 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39feeeeb-6ca5-4487-abf4-73ad9ea7c5d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:11.704501 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39feeeeb-6ca5-4487-abf4-73ad9ea7c5d0 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:11.776203 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:11.792059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449104d6-3b0f-4839-bae7-d4d11c9ce342 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:11.825436 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595ba3e-1cd2-4339-b309-74c0ca99ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:11.826311 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595ba3e-1cd2-4339-b309-74c0ca99ba84 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:11.826595 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595ba3e-1cd2-4339-b309-74c0ca99ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:11.826910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595ba3e-1cd2-4339-b309-74c0ca99ba84 None admin] PATH_INFO: `/v3/users/a4e187ccf7cf492aba4f3b85bb8a48d5` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:11.844016 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 136/277] 10.222.0.66 () {60 vars in 1132 bytes} [Thu May 26 21:01:11 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:01:11.848758 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595ba3e-1cd2-4339-b309-74c0ca99ba84 None admin] RBAC: Authorizing `identity:get_user(user_id=a4e187ccf7cf492aba4f3b85bb8a48d5)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:11.848758 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595ba3e-1cd2-4339-b309-74c0ca99ba84 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:11.849513 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 142/278] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:01:11 2022] GET /identity/v3/users/a4e187ccf7cf492aba4f3b85bb8a48d5 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:11.855462 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39feeeeb-6ca5-4487-abf4-73ad9ea7c5d0 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:11.973694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:11.991647 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39feeeeb-6ca5-4487-abf4-73ad9ea7c5d0 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:12.032222 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5bcd6-1708-4abf-8341-1bfba11a2b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:12.032926 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5bcd6-1708-4abf-8341-1bfba11a2b1d None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:12.033207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5bcd6-1708-4abf-8341-1bfba11a2b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:12.033483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5bcd6-1708-4abf-8341-1bfba11a2b1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:12.034321 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5bcd6-1708-4abf-8341-1bfba11a2b1d None admin] RBAC: Adding query filter params (role.id=7cbf3c401d60412fbcae272fb8d191cc, user.id=a4e187ccf7cf492aba4f3b85bb8a48d5, scope.system=all) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:12.034631 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5bcd6-1708-4abf-8341-1bfba11a2b1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:12.036086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5bcd6-1708-4abf-8341-1bfba11a2b1d None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:12.042314 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 137/279] 10.222.0.66 () {56 vars in 1308 bytes} [Thu May 26 21:01:11 2022] GET /identity/v3/role_assignments?user.id=a4e187ccf7cf492aba4f3b85bb8a48d5&scope.system=all&role.id=7cbf3c401d60412fbcae272fb8d191cc => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:12.192438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12973da4-1ae2-4733-82a8-e23a162eae4e None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:12.193056 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12973da4-1ae2-4733-82a8-e23a162eae4e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:12.193056 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12973da4-1ae2-4733-82a8-e23a162eae4e None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:12.194683 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 143/280] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:12.201181 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881eb3b3-45c0-460a-ac68-1954c55df35b None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:12.201479 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881eb3b3-45c0-460a-ac68-1954c55df35b None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:12.201776 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881eb3b3-45c0-460a-ac68-1954c55df35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:12.219960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-881eb3b3-45c0-460a-ac68-1954c55df35b None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:12.221226 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-881eb3b3-45c0-460a-ac68-1954c55df35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:12.302077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 138/281] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:12.325844 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12973da4-1ae2-4733-82a8-e23a162eae4e None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:12.335022 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278e33a-85ba-4175-8371-d1bd6b830909 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:12.335312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278e33a-85ba-4175-8371-d1bd6b830909 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:12.335592 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278e33a-85ba-4175-8371-d1bd6b830909 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:12.337268 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 139/282] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:01:12.342430 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164dd14-4fac-4c59-a36e-c94d75c21f2d None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:12.342718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164dd14-4fac-4c59-a36e-c94d75c21f2d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:12.343035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164dd14-4fac-4c59-a36e-c94d75c21f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:12.360975 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-8164dd14-4fac-4c59-a36e-c94d75c21f2d None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:12.362167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-8164dd14-4fac-4c59-a36e-c94d75c21f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:12.491550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 140/283] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:01:12.500450 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12973da4-1ae2-4733-82a8-e23a162eae4e None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:12.527279 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164dd14-4fac-4c59-a36e-c94d75c21f2d None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:12.549009 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:12.554087 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96bb6b-4ab4-4965-95bd-a1b300b04e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:12.554841 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96bb6b-4ab4-4965-95bd-a1b300b04e0f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:12.555121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96bb6b-4ab4-4965-95bd-a1b300b04e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:12.555390 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96bb6b-4ab4-4965-95bd-a1b300b04e0f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:12.582288 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96bb6b-4ab4-4965-95bd-a1b300b04e0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:12.597403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-4f96bb6b-4ab4-4965-95bd-a1b300b04e0f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 21:01:12.597403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:12.597403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:12.597403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:12.597403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:12.597403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:12.597403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:12.597403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:12.597403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:12.597403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:12.597403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:12.597403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:12.597403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:12.597403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:12.597403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:12.597403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:12.598340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:12.598340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:12.598340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:12.598340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:12.598340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:12.598340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:12.598340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:12.598340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:12.598340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:12.598340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:12.598340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:12.598340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:12.598340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:12.598340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:12.598340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:12.598340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:12.599110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:12.599110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:12.599110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:12.599110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:12.599110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:12.599110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:12.599110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:12.599110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:12.599110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:12.599110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:12.599110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 21:01:12.599110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:12.606143 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 144/284] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:12.609786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96bb6b-4ab4-4965-95bd-a1b300b04e0f None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:12.612887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:12.719343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164dd14-4fac-4c59-a36e-c94d75c21f2d None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:12.785679 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c92388-9f9e-4af9-9eb6-be70bb02e15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:12.786542 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c92388-9f9e-4af9-9eb6-be70bb02e15a None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:12.786834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c92388-9f9e-4af9-9eb6-be70bb02e15a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:12.787115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c92388-9f9e-4af9-9eb6-be70bb02e15a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:12.806480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c92388-9f9e-4af9-9eb6-be70bb02e15a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:12.814482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-59c92388-9f9e-4af9-9eb6-be70bb02e15a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:12.814482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:12.814482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:12.814482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:12.814482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:12.814482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:12.814482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:12.814482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:12.814482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:12.814482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:12.814482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:12.814482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:12.814482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:12.814482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:12.814482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:12.814482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:12.815380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:12.815380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:12.815380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:12.815380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:12.815380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:12.815380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:12.815380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:12.815380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:12.815380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:12.815380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:12.815380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:12.815380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:12.815380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:12.815380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:12.815380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:12.815380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:12.816132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:12.816132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:12.816132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:12.816132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:12.816132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:12.816132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:12.816132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:12.816132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:12.816132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:12.816132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:12.816132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:12.816132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:12.816132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 141/285] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:12.824373 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96bb6b-4ab4-4965-95bd-a1b300b04e0f None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:12.827714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c92388-9f9e-4af9-9eb6-be70bb02e15a None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:12.883483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7b63f-622c-424b-ae40-e888d97ad52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:12.884166 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b63f-622c-424b-ae40-e888d97ad52c None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:12.884449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b63f-622c-424b-ae40-e888d97ad52c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:12.884753 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b63f-622c-424b-ae40-e888d97ad52c None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:12.885514 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7b63f-622c-424b-ae40-e888d97ad52c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:12.885818 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7b63f-622c-424b-ae40-e888d97ad52c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:12.887219 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7b63f-622c-424b-ae40-e888d97ad52c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:12.909388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 145/286] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:01:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:12.910453 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7b63f-622c-424b-ae40-e888d97ad52c None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:12.966245 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:13.026876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:13.027073 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c92388-9f9e-4af9-9eb6-be70bb02e15a None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:13.079353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fd0df-0837-475f-b39d-43c124b554dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:13.079950 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fd0df-0837-475f-b39d-43c124b554dd None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:13.080233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fd0df-0837-475f-b39d-43c124b554dd None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:13.080508 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fd0df-0837-475f-b39d-43c124b554dd None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:13.081310 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fd0df-0837-475f-b39d-43c124b554dd None admin] RBAC: Adding query filter params (name=member) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:13.081627 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fd0df-0837-475f-b39d-43c124b554dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:13.083045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fd0df-0837-475f-b39d-43c124b554dd None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:13.090140 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7b63f-622c-424b-ae40-e888d97ad52c None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:13.092025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 142/287] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:01:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:13.104878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fd0df-0837-475f-b39d-43c124b554dd None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:13.149411 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1dad5-c930-42da-b625-4f1b5151a4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:13.150296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1dad5-c930-42da-b625-4f1b5151a4ad None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:13.150575 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1dad5-c930-42da-b625-4f1b5151a4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:13.150847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1dad5-c930-42da-b625-4f1b5151a4ad None admin] PATH_INFO: `/v3/users/da2fc9db7a184826b16f19cca75653e0` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:13.153651 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1dad5-c930-42da-b625-4f1b5151a4ad None admin] RBAC: Authorizing `identity:get_user(user_id=da2fc9db7a184826b16f19cca75653e0)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:13.155108 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1dad5-c930-42da-b625-4f1b5151a4ad None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:13.162347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 146/288] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:01:12 2022] GET /identity/v3/users/da2fc9db7a184826b16f19cca75653e0 => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:13.173583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1dad5-c930-42da-b625-4f1b5151a4ad None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:13.277681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fd0df-0837-475f-b39d-43c124b554dd None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:13.307468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1dad5-c930-42da-b625-4f1b5151a4ad None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:13.335898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:13.348125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6a9f8-0c77-4dce-a4f4-ceaee8e4684c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:13.354395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6a9f8-0c77-4dce-a4f4-ceaee8e4684c None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:13.354395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6a9f8-0c77-4dce-a4f4-ceaee8e4684c None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:13.354395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6a9f8-0c77-4dce-a4f4-ceaee8e4684c None admin] PATH_INFO: `/v3/users/ec9dccbb5d4d48e2963f76eb765cbf32` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:13.354395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6a9f8-0c77-4dce-a4f4-ceaee8e4684c None admin] RBAC: Authorizing `identity:get_user(user_id=ec9dccbb5d4d48e2963f76eb765cbf32)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:13.354395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6a9f8-0c77-4dce-a4f4-ceaee8e4684c None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:13.354395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 143/289] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:01:13 2022] GET /identity/v3/users/ec9dccbb5d4d48e2963f76eb765cbf32 => generated 297 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:13.359949 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6a9f8-0c77-4dce-a4f4-ceaee8e4684c None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:13.374074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:13.383233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f3cd1-628a-43d0-8c13-9b45281d5dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:13.384114 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f3cd1-628a-43d0-8c13-9b45281d5dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:13.384400 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f3cd1-628a-43d0-8c13-9b45281d5dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:13.384776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f3cd1-628a-43d0-8c13-9b45281d5dd1 None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:13.388302 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f3cd1-628a-43d0-8c13-9b45281d5dd1 None admin] RBAC: Authorizing `identity:get_project(project_id=0c071ff9e8b04956814c07c7d5500549)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:13.390387 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f3cd1-628a-43d0-8c13-9b45281d5dd1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:13.392156 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 147/290] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:13 2022] GET /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:13.404685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f3cd1-628a-43d0-8c13-9b45281d5dd1 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:13.511991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6a9f8-0c77-4dce-a4f4-ceaee8e4684c None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:13.546977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f012ac5-cb03-4bdf-97c8-c3b626d9e15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:13.547639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f012ac5-cb03-4bdf-97c8-c3b626d9e15b None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:13.547927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f012ac5-cb03-4bdf-97c8-c3b626d9e15b None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:13.548205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f012ac5-cb03-4bdf-97c8-c3b626d9e15b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:13.585752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f3cd1-628a-43d0-8c13-9b45281d5dd1 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:13.617419 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:13.618511 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f012ac5-cb03-4bdf-97c8-c3b626d9e15b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:13.620229 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f012ac5-cb03-4bdf-97c8-c3b626d9e15b None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:13.657179 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8da4e-8ede-46cf-81ad-4f804e2689a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:13.658082 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8da4e-8ede-46cf-81ad-4f804e2689a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:13.658368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8da4e-8ede-46cf-81ad-4f804e2689a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:13.658642 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8da4e-8ede-46cf-81ad-4f804e2689a7 None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549/users/da2fc9db7a184826b16f19cca75653e0/roles/d4282b64bc3b42419a613a6210a47a2b` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:13.660772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8da4e-8ede-46cf-81ad-4f804e2689a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c071ff9e8b04956814c07c7d5500549, user_id=da2fc9db7a184826b16f19cca75653e0, role_id=d4282b64bc3b42419a613a6210a47a2b)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:13.662217 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8da4e-8ede-46cf-81ad-4f804e2689a7 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:13.723176 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 144/291] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:13.729604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f012ac5-cb03-4bdf-97c8-c3b626d9e15b None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:13.789567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 148/292] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:01:13 2022] PUT /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549/users/da2fc9db7a184826b16f19cca75653e0/roles/d4282b64bc3b42419a613a6210a47a2b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:01:13.864311 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:13.869170 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f012ac5-cb03-4bdf-97c8-c3b626d9e15b None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:13.922273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bc40f-e5f2-4563-9c10-48b389a4a66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:13.923162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bc40f-e5f2-4563-9c10-48b389a4a66e None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:13.923441 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bc40f-e5f2-4563-9c10-48b389a4a66e None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:13.923715 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bc40f-e5f2-4563-9c10-48b389a4a66e None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:13.928829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bc40f-e5f2-4563-9c10-48b389a4a66e None admin] RBAC: Authorizing `identity:get_project(project_id=0c071ff9e8b04956814c07c7d5500549)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:13.930482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bc40f-e5f2-4563-9c10-48b389a4a66e None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:13.932724 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 145/293] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:13 2022] GET /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:13.939794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8da4e-8ede-46cf-81ad-4f804e2689a7 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:14.012184 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:14.055814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8da4e-8ede-46cf-81ad-4f804e2689a7 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:14.092452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f247f9d-5980-4efa-b322-2316fe704d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:14.093706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f247f9d-5980-4efa-b322-2316fe704d91 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:14.093990 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f247f9d-5980-4efa-b322-2316fe704d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:14.094268 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f247f9d-5980-4efa-b322-2316fe704d91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:14.095118 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f247f9d-5980-4efa-b322-2316fe704d91 None admin] RBAC: Adding query filter params (role.id=7cbf3c401d60412fbcae272fb8d191cc, scope.project.id=0c071ff9e8b04956814c07c7d5500549, user.id=ec9dccbb5d4d48e2963f76eb765cbf32) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:14.095495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f247f9d-5980-4efa-b322-2316fe704d91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:14.097061 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f247f9d-5980-4efa-b322-2316fe704d91 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:14.107587 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 149/294] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:01:13 2022] GET /identity/v3/role_assignments?user.id=ec9dccbb5d4d48e2963f76eb765cbf32&scope.project.id=0c071ff9e8b04956814c07c7d5500549&role.id=7cbf3c401d60412fbcae272fb8d191cc => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:14.578643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21706bc-e722-4c78-8104-51a6c723fb2a None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:14.578991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21706bc-e722-4c78-8104-51a6c723fb2a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:14.579193 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21706bc-e722-4c78-8104-51a6c723fb2a None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:14.580608 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 146/295] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:14.586316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e471eeb-3c0b-4460-999c-f3198fcc930f None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:14.586961 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e471eeb-3c0b-4460-999c-f3198fcc930f None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:14.586961 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e471eeb-3c0b-4460-999c-f3198fcc930f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:14.607605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-8e471eeb-3c0b-4460-999c-f3198fcc930f None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:14.609494 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8e471eeb-3c0b-4460-999c-f3198fcc930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:14.693693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 150/296] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:14.717861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21706bc-e722-4c78-8104-51a6c723fb2a None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:14.817147 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1247ccf-2408-4494-a79d-985945d092ca None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:14.817441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1247ccf-2408-4494-a79d-985945d092ca None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:14.817918 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1247ccf-2408-4494-a79d-985945d092ca None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:14.820007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 151/297] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:14.824616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c0805-1547-4212-a777-25468e02cae9 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:14.824616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c0805-1547-4212-a777-25468e02cae9 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:14.824616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c0805-1547-4212-a777-25468e02cae9 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:14.825200 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 152/298] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:01:14.829138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f2df2-0f98-4ca3-88d4-413c4aa456ab None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:14.829138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f2df2-0f98-4ca3-88d4-413c4aa456ab None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:14.829138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f2df2-0f98-4ca3-88d4-413c4aa456ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:14.830117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21706bc-e722-4c78-8104-51a6c723fb2a None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:14.847667 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-1a7f2df2-0f98-4ca3-88d4-413c4aa456ab None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:14.849035 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1a7f2df2-0f98-4ca3-88d4-413c4aa456ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:14.872497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5326a7-21b9-4eae-b4e4-0639a4e0eb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:14.880943 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5326a7-21b9-4eae-b4e4-0639a4e0eb7e None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:14.880943 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5326a7-21b9-4eae-b4e4-0639a4e0eb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:14.880943 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5326a7-21b9-4eae-b4e4-0639a4e0eb7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:14.881781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5326a7-21b9-4eae-b4e4-0639a4e0eb7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:14.883368 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5326a7-21b9-4eae-b4e4-0639a4e0eb7e None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:14.885282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 147/299] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:14.890125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd13d80-dd0b-4040-be89-f9498af7e1de None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:14.890418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd13d80-dd0b-4040-be89-f9498af7e1de None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:14.890700 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd13d80-dd0b-4040-be89-f9498af7e1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:14.907892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-1fd13d80-dd0b-4040-be89-f9498af7e1de None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:14.909145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1fd13d80-dd0b-4040-be89-f9498af7e1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:14.913650 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:14.933514 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 153/300] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:14.941600 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f2df2-0f98-4ca3-88d4-413c4aa456ab None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:14.945011 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:14.987363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 148/301] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:14.988229 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd13d80-dd0b-4040-be89-f9498af7e1de None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:15.065928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f2df2-0f98-4ca3-88d4-413c4aa456ab None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:15.092446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd13d80-dd0b-4040-be89-f9498af7e1de None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:15.109659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bc6f1-dcba-47c5-943b-f03fb7093619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:15.110614 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bc6f1-dcba-47c5-943b-f03fb7093619 None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:15.110905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bc6f1-dcba-47c5-943b-f03fb7093619 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:15.111182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bc6f1-dcba-47c5-943b-f03fb7093619 None admin] PATH_INFO: `/v3/groups` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:15.111876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bc6f1-dcba-47c5-943b-f03fb7093619 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:15.113787 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bc6f1-dcba-47c5-943b-f03fb7093619 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:15.126646 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324c30c-50c5-49ff-8e54-852ecb6bfd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:15.127450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324c30c-50c5-49ff-8e54-852ecb6bfd36 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:15.127733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324c30c-50c5-49ff-8e54-852ecb6bfd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:15.128010 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324c30c-50c5-49ff-8e54-852ecb6bfd36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:15.139527 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324c30c-50c5-49ff-8e54-852ecb6bfd36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:15.147550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-b324c30c-50c5-49ff-8e54-852ecb6bfd36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:15.147550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:15.147550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:15.147550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:15.147550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:15.147550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:15.147550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:15.147550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:15.147550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:15.147550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:15.147550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:15.147550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:15.147550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:15.147550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:15.147550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:15.147550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:15.148634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:15.148634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:15.148634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:15.148634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:15.148634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:15.148634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:15.148634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:15.148634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:15.148634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:15.148634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:15.148634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:15.148634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:15.148634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:15.148634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:15.148634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:15.148634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:15.149489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:15.149489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:15.149489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:15.149489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:15.149489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:15.149489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:15.149489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:15.149489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:15.149489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:15.149489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:15.149489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:15.149489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:15.149489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 149/302] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:15.150129 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324c30c-50c5-49ff-8e54-852ecb6bfd36 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:15.179569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:15.194722 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 154/303] 10.222.0.66 () {60 vars in 1134 bytes} [Thu May 26 21:01:14 2022] POST /identity/v3/groups => generated 229 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:01:15.208661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bc6f1-dcba-47c5-943b-f03fb7093619 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:15.253074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:15.279782 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324c30c-50c5-49ff-8e54-852ecb6bfd36 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:15.321161 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bc6f1-dcba-47c5-943b-f03fb7093619 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:15.326940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cab00-a96b-44f9-b96a-305cbef6d45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:15.328314 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cab00-a96b-44f9-b96a-305cbef6d45b None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:15.328611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cab00-a96b-44f9-b96a-305cbef6d45b None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:15.328884 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cab00-a96b-44f9-b96a-305cbef6d45b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:15.340818 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cab00-a96b-44f9-b96a-305cbef6d45b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:15.349537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-a94cab00-a96b-44f9-b96a-305cbef6d45b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 21:01:15.349537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:15.349537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:15.349537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:15.349537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:15.349537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:15.349537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:15.349537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:15.349537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:15.349537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:15.349537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:15.349537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:15.349537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:15.349537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:15.349537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:15.349537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:15.350543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:15.350543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:15.350543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:15.350543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:15.350543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:15.350543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:15.350543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:15.350543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:15.350543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:15.350543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:15.350543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:15.350543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:15.350543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:15.350543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:15.350543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:15.350543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:15.351327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:15.351327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:15.351327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:15.351327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:15.351327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:15.351327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:15.351327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:15.351327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:15.351327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:15.351327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:15.351327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 21:01:15.351327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:15.353168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 150/304] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:15.356486 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cab00-a96b-44f9-b96a-305cbef6d45b None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:15.391419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff977742-2b5f-4248-a6b8-56d4aa115af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:15.392105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff977742-2b5f-4248-a6b8-56d4aa115af1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:15.392390 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff977742-2b5f-4248-a6b8-56d4aa115af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:15.393455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff977742-2b5f-4248-a6b8-56d4aa115af1 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:15.394282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff977742-2b5f-4248-a6b8-56d4aa115af1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:15.394598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff977742-2b5f-4248-a6b8-56d4aa115af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:15.395987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff977742-2b5f-4248-a6b8-56d4aa115af1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:15.406104 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 155/305] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:01:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:15.411800 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff977742-2b5f-4248-a6b8-56d4aa115af1 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:15.474740 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:15.491896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cab00-a96b-44f9-b96a-305cbef6d45b None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:15.528408 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe1709-6836-49a9-999a-19afc963f901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:15.529147 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe1709-6836-49a9-999a-19afc963f901 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:15.529479 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe1709-6836-49a9-999a-19afc963f901 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:15.529761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe1709-6836-49a9-999a-19afc963f901 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:15.531268 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe1709-6836-49a9-999a-19afc963f901 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:15.531452 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe1709-6836-49a9-999a-19afc963f901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:15.532873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe1709-6836-49a9-999a-19afc963f901 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:15.542210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 151/306] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:01:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:15.545842 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff977742-2b5f-4248-a6b8-56d4aa115af1 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:15.547311 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe1709-6836-49a9-999a-19afc963f901 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:15.560407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:15.596042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e9c98-04a2-43ea-a988-8c4aff516aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:15.597845 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e9c98-04a2-43ea-a988-8c4aff516aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:15.598645 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e9c98-04a2-43ea-a988-8c4aff516aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:15.599629 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e9c98-04a2-43ea-a988-8c4aff516aa1 None admin] PATH_INFO: `/v3/users/a4e187ccf7cf492aba4f3b85bb8a48d5` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:15.601284 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e9c98-04a2-43ea-a988-8c4aff516aa1 None admin] RBAC: Authorizing `identity:get_user(user_id=a4e187ccf7cf492aba4f3b85bb8a48d5)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:15.603084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e9c98-04a2-43ea-a988-8c4aff516aa1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:15.605409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 156/307] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:01:15 2022] GET /identity/v3/users/a4e187ccf7cf492aba4f3b85bb8a48d5 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:15.610944 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e9c98-04a2-43ea-a988-8c4aff516aa1 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:15.664622 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe1709-6836-49a9-999a-19afc963f901 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:15.712144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd7a63-ab1a-4e4d-b3fc-3d8bc4ce24f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:15.713439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd7a63-ab1a-4e4d-b3fc-3d8bc4ce24f2 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:15.714460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd7a63-ab1a-4e4d-b3fc-3d8bc4ce24f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:15.714950 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd7a63-ab1a-4e4d-b3fc-3d8bc4ce24f2 None admin] PATH_INFO: `/v3/users/cce8f280e33e437d973f7d15240a2ace` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:15.741354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd7a63-ab1a-4e4d-b3fc-3d8bc4ce24f2 None admin] RBAC: Authorizing `identity:get_user(user_id=cce8f280e33e437d973f7d15240a2ace)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:15.741664 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e9c98-04a2-43ea-a988-8c4aff516aa1 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:15.743703 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd7a63-ab1a-4e4d-b3fc-3d8bc4ce24f2 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:15.748619 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 152/308] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:01:15 2022] GET /identity/v3/users/cce8f280e33e437d973f7d15240a2ace => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:15.752679 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd7a63-ab1a-4e4d-b3fc-3d8bc4ce24f2 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:15.761407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:15.781889 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f865819-d1e0-412d-b3dd-4307b9da1fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:15.783144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f865819-d1e0-412d-b3dd-4307b9da1fca None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:15.783628 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f865819-d1e0-412d-b3dd-4307b9da1fca None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:15.784105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f865819-d1e0-412d-b3dd-4307b9da1fca None admin] PATH_INFO: `/v3/system/users/a4e187ccf7cf492aba4f3b85bb8a48d5/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:15.785889 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f865819-d1e0-412d-b3dd-4307b9da1fca None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a4e187ccf7cf492aba4f3b85bb8a48d5, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:15.787528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f865819-d1e0-412d-b3dd-4307b9da1fca None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:15.856530 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd7a63-ab1a-4e4d-b3fc-3d8bc4ce24f2 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:15.891953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 157/309] 10.222.0.66 () {58 vars in 1334 bytes} [Thu May 26 21:01:15 2022] PUT /identity/v3/system/users/a4e187ccf7cf492aba4f3b85bb8a48d5/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:01:15.901139 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98b560-0708-4b4c-9005-d0b602bef488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:15.901879 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98b560-0708-4b4c-9005-d0b602bef488 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:15.902169 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98b560-0708-4b4c-9005-d0b602bef488 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:15.902444 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98b560-0708-4b4c-9005-d0b602bef488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:15.903310 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98b560-0708-4b4c-9005-d0b602bef488 None admin] RBAC: Adding query filter params (role.id=d4282b64bc3b42419a613a6210a47a2b, user.id=cce8f280e33e437d973f7d15240a2ace, scope.system=all) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:15.903618 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98b560-0708-4b4c-9005-d0b602bef488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:15.905320 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98b560-0708-4b4c-9005-d0b602bef488 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:15.912167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 153/310] 10.222.0.66 () {56 vars in 1308 bytes} [Thu May 26 21:01:15 2022] GET /identity/v3/role_assignments?user.id=cce8f280e33e437d973f7d15240a2ace&scope.system=all&role.id=d4282b64bc3b42419a613a6210a47a2b => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:16.295814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f8b56-cdee-44fd-a10b-fb1c5c57a872 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:16.296687 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f8b56-cdee-44fd-a10b-fb1c5c57a872 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:16.297158 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f8b56-cdee-44fd-a10b-fb1c5c57a872 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:16.298905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 158/311] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:16.304750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f9a43-80ec-4263-840b-7f53eccba9c8 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:16.305094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f9a43-80ec-4263-840b-7f53eccba9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:16.305463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f9a43-80ec-4263-840b-7f53eccba9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:16.324089 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-c66f9a43-80ec-4263-840b-7f53eccba9c8 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:16.325316 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-c66f9a43-80ec-4263-840b-7f53eccba9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:16.390793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:16.395815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 154/312] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:16.420345 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f8b56-cdee-44fd-a10b-fb1c5c57a872 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:16.470029 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:16.540327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f8b56-cdee-44fd-a10b-fb1c5c57a872 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:16.578292 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6ae3e-fa29-482a-9a74-b15cbbe03172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:16.579098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6ae3e-fa29-482a-9a74-b15cbbe03172 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:16.579383 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6ae3e-fa29-482a-9a74-b15cbbe03172 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:16.579660 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6ae3e-fa29-482a-9a74-b15cbbe03172 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:16.590374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6ae3e-fa29-482a-9a74-b15cbbe03172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:16.598630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-f1f6ae3e-fa29-482a-9a74-b15cbbe03172 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 21:01:16.598630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:16.598630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:16.598630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:16.598630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:16.598630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:16.598630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:16.598630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:16.598630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:16.598630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:16.598630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:16.598630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:16.598630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:16.598630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:16.598630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:16.598630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:16.601041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:16.601041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:16.601041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:16.601041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:16.601041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:16.601041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:16.601041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:16.601041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:16.601041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:16.601041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:16.601041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:16.601041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:16.601041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:16.601041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:16.601041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:16.601041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:16.602084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:16.602084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:16.602084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:16.602084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:16.602084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:16.602084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:16.602084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:16.602084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:16.602084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:16.602084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:16.602084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 21:01:16.602084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:16.602084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 159/313] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:16.605958 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f9a43-80ec-4263-840b-7f53eccba9c8 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:16.711253 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f9a43-80ec-4263-840b-7f53eccba9c8 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:16.746664 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d517ce0-57e4-4995-a2b2-65af9963fda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:16.747347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d517ce0-57e4-4995-a2b2-65af9963fda4 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:16.747634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d517ce0-57e4-4995-a2b2-65af9963fda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:16.747910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d517ce0-57e4-4995-a2b2-65af9963fda4 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:16.748731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d517ce0-57e4-4995-a2b2-65af9963fda4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:16.749139 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d517ce0-57e4-4995-a2b2-65af9963fda4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:16.750648 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d517ce0-57e4-4995-a2b2-65af9963fda4 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:16.759752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 155/314] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:01:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:16.766436 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6ae3e-fa29-482a-9a74-b15cbbe03172 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:16.865505 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:16.869110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6ae3e-fa29-482a-9a74-b15cbbe03172 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:16.907841 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea83702-6443-4dc1-8c19-296c079305f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:16.908762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea83702-6443-4dc1-8c19-296c079305f6 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:16.909047 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea83702-6443-4dc1-8c19-296c079305f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:16.909325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea83702-6443-4dc1-8c19-296c079305f6 None admin] PATH_INFO: `/v3/users/da2fc9db7a184826b16f19cca75653e0` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:16.910536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea83702-6443-4dc1-8c19-296c079305f6 None admin] RBAC: Authorizing `identity:get_user(user_id=da2fc9db7a184826b16f19cca75653e0)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:16.911982 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea83702-6443-4dc1-8c19-296c079305f6 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:16.914060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 160/315] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:01:16 2022] GET /identity/v3/users/da2fc9db7a184826b16f19cca75653e0 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:16.922039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d517ce0-57e4-4995-a2b2-65af9963fda4 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:16.985227 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:17.025007 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d517ce0-57e4-4995-a2b2-65af9963fda4 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:17.059652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cc453-1021-4caa-a776-ce702b5b9c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:17.060350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cc453-1021-4caa-a776-ce702b5b9c22 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:17.060992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cc453-1021-4caa-a776-ce702b5b9c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:17.061268 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cc453-1021-4caa-a776-ce702b5b9c22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:17.136922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cc453-1021-4caa-a776-ce702b5b9c22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:17.138317 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cc453-1021-4caa-a776-ce702b5b9c22 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:17.207255 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:17.246861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 156/316] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:17.248252 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea83702-6443-4dc1-8c19-296c079305f6 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:17.358814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea83702-6443-4dc1-8c19-296c079305f6 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:17.394485 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014507d-3a36-4e2c-b5e4-3ebed946d924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:17.395290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014507d-3a36-4e2c-b5e4-3ebed946d924 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:17.395576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014507d-3a36-4e2c-b5e4-3ebed946d924 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:17.395853 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014507d-3a36-4e2c-b5e4-3ebed946d924 None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:17.397146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014507d-3a36-4e2c-b5e4-3ebed946d924 None admin] RBAC: Authorizing `identity:get_project(project_id=0c071ff9e8b04956814c07c7d5500549)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:17.398636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014507d-3a36-4e2c-b5e4-3ebed946d924 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:17.400782 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 161/317] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:17 2022] GET /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:17.406986 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cc453-1021-4caa-a776-ce702b5b9c22 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:17.513124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cc453-1021-4caa-a776-ce702b5b9c22 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:17.548736 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d717fd4-c931-4f5a-9a42-fc93a551445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:17.549805 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d717fd4-c931-4f5a-9a42-fc93a551445e None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:17.550301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d717fd4-c931-4f5a-9a42-fc93a551445e None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:17.550780 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d717fd4-c931-4f5a-9a42-fc93a551445e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:17.551826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d717fd4-c931-4f5a-9a42-fc93a551445e None admin] RBAC: Adding query filter params (role.id=d4282b64bc3b42419a613a6210a47a2b, scope.project.id=0c071ff9e8b04956814c07c7d5500549, user.id=da2fc9db7a184826b16f19cca75653e0) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:17.552341 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d717fd4-c931-4f5a-9a42-fc93a551445e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:17.554048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d717fd4-c931-4f5a-9a42-fc93a551445e None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:17.568705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 157/318] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:01:17 2022] GET /identity/v3/role_assignments?user.id=da2fc9db7a184826b16f19cca75653e0&scope.project.id=0c071ff9e8b04956814c07c7d5500549&role.id=d4282b64bc3b42419a613a6210a47a2b => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:17.607771 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7524ae9-c354-410f-9d12-67d97f5775a2 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:17.608290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7524ae9-c354-410f-9d12-67d97f5775a2 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:17.608939 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7524ae9-c354-410f-9d12-67d97f5775a2 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:17.610613 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 162/319] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:17.616209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa1bc0-6286-4fc7-a2d6-ecec1cb74ffd None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:17.616488 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa1bc0-6286-4fc7-a2d6-ecec1cb74ffd None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:17.616801 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa1bc0-6286-4fc7-a2d6-ecec1cb74ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:17.635676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-d9aa1bc0-6286-4fc7-a2d6-ecec1cb74ffd None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:17.636964 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d9aa1bc0-6286-4fc7-a2d6-ecec1cb74ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:17.660452 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:17.713797 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 158/320] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:17.737677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7524ae9-c354-410f-9d12-67d97f5775a2 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:17.782123 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:17.859524 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7524ae9-c354-410f-9d12-67d97f5775a2 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:17.896334 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd516f8-4f98-43d4-8239-445e69a6ac2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:17.897506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd516f8-4f98-43d4-8239-445e69a6ac2a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:17.897989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd516f8-4f98-43d4-8239-445e69a6ac2a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:17.898483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd516f8-4f98-43d4-8239-445e69a6ac2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:17.899822 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd516f8-4f98-43d4-8239-445e69a6ac2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:17.901614 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd516f8-4f98-43d4-8239-445e69a6ac2a None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:17.903417 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 163/321] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:17.909683 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa1bc0-6286-4fc7-a2d6-ecec1cb74ffd None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:18.011293 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa1bc0-6286-4fc7-a2d6-ecec1cb74ffd None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:18.049274 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7282f-aa63-4e4f-ac16-6474924f39a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:18.049952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7282f-aa63-4e4f-ac16-6474924f39a5 None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:18.050235 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7282f-aa63-4e4f-ac16-6474924f39a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:18.050511 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7282f-aa63-4e4f-ac16-6474924f39a5 None admin] PATH_INFO: `/v3/groups` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:18.051219 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7282f-aa63-4e4f-ac16-6474924f39a5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:18.052689 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7282f-aa63-4e4f-ac16-6474924f39a5 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:18.154596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 159/322] 10.222.0.66 () {60 vars in 1134 bytes} [Thu May 26 21:01:17 2022] POST /identity/v3/groups => generated 226 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:01:18.208948 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c8f67-d8af-4055-9d7b-840ba0269ac1 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:18.209275 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c8f67-d8af-4055-9d7b-840ba0269ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:18.209512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c8f67-d8af-4055-9d7b-840ba0269ac1 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:18.211262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 164/323] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:18.217020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081c94a-209c-4a44-945d-28507465dd3b None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:18.217352 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081c94a-209c-4a44-945d-28507465dd3b None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:18.217588 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081c94a-209c-4a44-945d-28507465dd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:18.236206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-7081c94a-209c-4a44-945d-28507465dd3b None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:18.237479 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-7081c94a-209c-4a44-945d-28507465dd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:18.250059 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:18.277329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6cb5a-0728-406f-91fb-42126892360a None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:18.277656 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6cb5a-0728-406f-91fb-42126892360a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:18.277943 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6cb5a-0728-406f-91fb-42126892360a None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:18.279349 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 165/324] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:18.286218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce552f-28d4-4bb8-8534-50b0243cfdf8 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:18.286856 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce552f-28d4-4bb8-8534-50b0243cfdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:18.287229 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce552f-28d4-4bb8-8534-50b0243cfdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:18.304362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-adce552f-28d4-4bb8-8534-50b0243cfdf8 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:18.305655 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-adce552f-28d4-4bb8-8534-50b0243cfdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:18.314705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 160/325] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:18.339483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081c94a-209c-4a44-945d-28507465dd3b None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:18.392393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 166/326] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:01:18.416232 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce552f-28d4-4bb8-8534-50b0243cfdf8 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:18.455941 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:18.463010 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081c94a-209c-4a44-945d-28507465dd3b None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:18.508497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd69e75-e51f-46f6-ba13-6b99a22bc631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:18.509327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd69e75-e51f-46f6-ba13-6b99a22bc631 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:18.509734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd69e75-e51f-46f6-ba13-6b99a22bc631 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:18.510011 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd69e75-e51f-46f6-ba13-6b99a22bc631 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:18.524270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd69e75-e51f-46f6-ba13-6b99a22bc631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:18.533322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-8fd69e75-e51f-46f6-ba13-6b99a22bc631 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 21:01:18.533322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:18.533322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:18.533322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:18.533322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:18.533322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:18.533322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:18.533322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:18.533322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:18.533322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:18.533322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:18.533322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:18.533322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:18.533322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:18.533322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:18.533322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:18.534212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:18.534212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:18.534212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:18.534212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:18.534212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:18.534212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:18.534212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:18.534212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:18.534212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:18.534212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:18.534212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:18.534212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:18.534212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:18.534212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:18.534212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:18.534212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:18.534984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:18.534984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:18.534984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:18.534984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:18.534984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:18.534984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:18.534984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:18.534984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:18.534984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:18.534984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:18.534984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 21:01:18.534984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:18.534984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 161/327] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:01:18.541435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd69e75-e51f-46f6-ba13-6b99a22bc631 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:18.544039 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce552f-28d4-4bb8-8534-50b0243cfdf8 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:18.554940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:18.594490 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ac313-80cc-46d1-a38b-316410a553b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:18.595410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ac313-80cc-46d1-a38b-316410a553b5 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:18.595770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ac313-80cc-46d1-a38b-316410a553b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:18.596105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ac313-80cc-46d1-a38b-316410a553b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:18.610663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ac313-80cc-46d1-a38b-316410a553b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:18.618827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-6d7ac313-80cc-46d1-a38b-316410a553b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:18.618827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:18.618827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:18.618827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:18.618827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:18.618827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:18.618827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:18.618827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:18.618827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:18.618827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:18.618827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:18.618827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:18.618827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:18.618827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:18.618827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:18.618827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:18.619723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:18.619723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:18.619723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:18.619723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:18.619723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:18.619723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:18.619723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:18.619723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:18.619723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:18.619723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:18.619723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:18.619723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:18.619723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:18.619723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:18.619723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:18.619723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:18.620508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:18.620508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:18.620508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:18.620508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:18.620508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:18.620508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:18.620508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:18.620508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:18.620508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:18.620508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:18.620508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:18.620508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:18.620508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 167/328] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:01:18.629092 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ac313-80cc-46d1-a38b-316410a553b5 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:18.675191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd69e75-e51f-46f6-ba13-6b99a22bc631 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:18.718615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0475f-d81d-4cb7-be5d-14b51f636ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:18.719353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0475f-d81d-4cb7-be5d-14b51f636ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:18.719634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0475f-d81d-4cb7-be5d-14b51f636ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:18.719909 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0475f-d81d-4cb7-be5d-14b51f636ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:18.720747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0475f-d81d-4cb7-be5d-14b51f636ae1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:18.721528 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0475f-d81d-4cb7-be5d-14b51f636ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:18.722961 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0475f-d81d-4cb7-be5d-14b51f636ae1 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:18.734523 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 162/329] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:01:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:18.740028 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0475f-d81d-4cb7-be5d-14b51f636ae1 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:18.740750 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:18.751289 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ac313-80cc-46d1-a38b-316410a553b5 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:18.787176 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03795d3d-0f0f-4972-8439-0e618699aa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:18.787885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03795d3d-0f0f-4972-8439-0e618699aa83 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:18.788178 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03795d3d-0f0f-4972-8439-0e618699aa83 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:18.788460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03795d3d-0f0f-4972-8439-0e618699aa83 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:18.789282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03795d3d-0f0f-4972-8439-0e618699aa83 None admin] RBAC: Adding query filter params (name=member) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:18.789596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03795d3d-0f0f-4972-8439-0e618699aa83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:18.791267 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03795d3d-0f0f-4972-8439-0e618699aa83 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:18.800960 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 168/330] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:01:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:18.806898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03795d3d-0f0f-4972-8439-0e618699aa83 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:18.820103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:18.867657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0475f-d81d-4cb7-be5d-14b51f636ae1 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:18.912411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b1688-295c-4efd-a2bc-7120462cef69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:18.913319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b1688-295c-4efd-a2bc-7120462cef69 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:18.916352 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b1688-295c-4efd-a2bc-7120462cef69 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:18.916352 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b1688-295c-4efd-a2bc-7120462cef69 None admin] PATH_INFO: `/v3/users/cce8f280e33e437d973f7d15240a2ace` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:18.917161 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b1688-295c-4efd-a2bc-7120462cef69 None admin] RBAC: Authorizing `identity:get_user(user_id=cce8f280e33e437d973f7d15240a2ace)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:18.919587 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b1688-295c-4efd-a2bc-7120462cef69 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:18.921841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 163/331] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:01:18 2022] GET /identity/v3/users/cce8f280e33e437d973f7d15240a2ace => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:18.927297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b1688-295c-4efd-a2bc-7120462cef69 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:18.951237 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03795d3d-0f0f-4972-8439-0e618699aa83 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:18.992810 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec28b3-1751-4526-8998-754c538e891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:18.994110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec28b3-1751-4526-8998-754c538e891d None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:18.994590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec28b3-1751-4526-8998-754c538e891d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:18.995087 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec28b3-1751-4526-8998-754c538e891d None admin] PATH_INFO: `/v3/users/a4e187ccf7cf492aba4f3b85bb8a48d5` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:18.996723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec28b3-1751-4526-8998-754c538e891d None admin] RBAC: Authorizing `identity:get_user(user_id=a4e187ccf7cf492aba4f3b85bb8a48d5)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:18.998381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec28b3-1751-4526-8998-754c538e891d None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:19.001153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 169/332] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:01:18 2022] GET /identity/v3/users/a4e187ccf7cf492aba4f3b85bb8a48d5 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:19.013455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec28b3-1751-4526-8998-754c538e891d None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:19.051906 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:19.060378 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b1688-295c-4efd-a2bc-7120462cef69 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:19.107446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fbd6f-8a4d-458a-bb64-01aee7f38acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:19.112495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fbd6f-8a4d-458a-bb64-01aee7f38acb None admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:19.112495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fbd6f-8a4d-458a-bb64-01aee7f38acb None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:19.112495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fbd6f-8a4d-458a-bb64-01aee7f38acb None admin] PATH_INFO: `/v3/system/users/cce8f280e33e437d973f7d15240a2ace/roles/d4282b64bc3b42419a613a6210a47a2b` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:19.115825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fbd6f-8a4d-458a-bb64-01aee7f38acb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cce8f280e33e437d973f7d15240a2ace, role_id=d4282b64bc3b42419a613a6210a47a2b)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:19.117287 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fbd6f-8a4d-458a-bb64-01aee7f38acb None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:19.123125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:19.148037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec28b3-1751-4526-8998-754c538e891d None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:19.185115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d805d-b94d-479f-b43b-ed5d036fd0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:19.186103 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d805d-b94d-479f-b43b-ed5d036fd0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:19.186530 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d805d-b94d-479f-b43b-ed5d036fd0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:19.186814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d805d-b94d-479f-b43b-ed5d036fd0c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:19.187660 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d805d-b94d-479f-b43b-ed5d036fd0c4 None admin] RBAC: Adding query filter params (role.id=7cbf3c401d60412fbcae272fb8d191cc, user.id=a4e187ccf7cf492aba4f3b85bb8a48d5, scope.system=all) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:19.187970 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d805d-b94d-479f-b43b-ed5d036fd0c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:19.189439 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d805d-b94d-479f-b43b-ed5d036fd0c4 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:19.204929 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 170/333] 10.222.0.66 () {56 vars in 1308 bytes} [Thu May 26 21:01:19 2022] GET /identity/v3/role_assignments?user.id=a4e187ccf7cf492aba4f3b85bb8a48d5&scope.system=all&role.id=7cbf3c401d60412fbcae272fb8d191cc => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:19.224232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 164/334] 10.222.0.66 () {58 vars in 1334 bytes} [Thu May 26 21:01:18 2022] PUT /identity/v3/system/users/cce8f280e33e437d973f7d15240a2ace/roles/d4282b64bc3b42419a613a6210a47a2b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:01:21.137468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc9aa3-dad6-44d1-af79-d716bc6a567d None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:21.138014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc9aa3-dad6-44d1-af79-d716bc6a567d None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:21.138014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc9aa3-dad6-44d1-af79-d716bc6a567d None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:21.140112 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 171/335] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:21.145845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d37b37-3f60-46be-a2b8-77604f4a0330 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:21.146330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d37b37-3f60-46be-a2b8-77604f4a0330 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:21.146428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d37b37-3f60-46be-a2b8-77604f4a0330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:21.171361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5a27b-1c2a-4d75-aa26-dbf84808e993 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:21.171661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5a27b-1c2a-4d75-aa26-dbf84808e993 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:21.171941 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5a27b-1c2a-4d75-aa26-dbf84808e993 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:21.173589 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 172/336] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:21.173913 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-a5d37b37-3f60-46be-a2b8-77604f4a0330 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:21.175142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a5d37b37-3f60-46be-a2b8-77604f4a0330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:21.178546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0de252-536b-47f6-bb2c-b27d2502e002 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:21.178825 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0de252-536b-47f6-bb2c-b27d2502e002 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:21.179100 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0de252-536b-47f6-bb2c-b27d2502e002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:21.208830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-ea0de252-536b-47f6-bb2c-b27d2502e002 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:21.212171 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ea0de252-536b-47f6-bb2c-b27d2502e002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:21.334176 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 165/337] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:01:21.349080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 173/338] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:21.372834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d37b37-3f60-46be-a2b8-77604f4a0330 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:21.385239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0de252-536b-47f6-bb2c-b27d2502e002 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:21.409861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:21.530368 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d37b37-3f60-46be-a2b8-77604f4a0330 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:21.541368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0de252-536b-47f6-bb2c-b27d2502e002 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:21.569423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:21.580222 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a2ba8-1ef9-4918-a9ca-94c6ecfb6270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:21.581149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a2ba8-1ef9-4918-a9ca-94c6ecfb6270 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:21.581438 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a2ba8-1ef9-4918-a9ca-94c6ecfb6270 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:21.581715 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a2ba8-1ef9-4918-a9ca-94c6ecfb6270 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:21.590928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0345b-d3b1-47de-b882-c62b1df0c1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:21.591752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0345b-d3b1-47de-b882-c62b1df0c1ce None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:21.592031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0345b-d3b1-47de-b882-c62b1df0c1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:21.592304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0345b-d3b1-47de-b882-c62b1df0c1ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:21.604018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a2ba8-1ef9-4918-a9ca-94c6ecfb6270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:21.615640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-3e6a2ba8-1ef9-4918-a9ca-94c6ecfb6270 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:21.615640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:21.615640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:21.615640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:21.615640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:21.615640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:21.615640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:21.615640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:21.615640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:21.615640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:21.615640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:21.615640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:21.615640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:21.615640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:21.615640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:21.615640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:21.616535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:21.616535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:21.616535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:21.616535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:21.616535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:21.616535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:21.616535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:21.616535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:21.616535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:21.616535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:21.616535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:21.616535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:21.616535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:21.616535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:21.616535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:21.616535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:21.617367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:21.617367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:21.617367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:21.617367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:21.617367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:21.617367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:21.617367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:21.617367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:21.617367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:21.617367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:21.617367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:21.617367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:21.619591 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0345b-d3b1-47de-b882-c62b1df0c1ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:21.627747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-e3b0345b-d3b1-47de-b882-c62b1df0c1ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:21.627747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:21.627747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:21.627747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:21.627747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:21.627747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:21.627747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:21.627747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:21.627747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:21.627747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:21.627747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:21.627747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:21.627747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:21.627747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:21.627747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:21.627747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:21.628653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:21.628653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:21.628653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:21.628653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:21.628653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:21.628653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:21.628653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:21.628653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:21.628653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:21.628653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:21.628653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:21.628653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:21.628653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:21.628653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:21.628653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:21.628653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:21.629435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:21.629435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:21.629435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:21.629435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:21.629435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:21.629435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:21.629435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:21.629435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:21.629435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:21.629435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:21.629435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:21.629435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:21.629435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 174/339] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:01:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:21.633134 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 166/340] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:21.636252 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0345b-d3b1-47de-b882-c62b1df0c1ce None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:21.638886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a2ba8-1ef9-4918-a9ca-94c6ecfb6270 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:21.815698 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:21.854888 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a2ba8-1ef9-4918-a9ca-94c6ecfb6270 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:21.879558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0345b-d3b1-47de-b882-c62b1df0c1ce None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:21.914433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5440b2-9010-4758-afd9-ddf9ed97b9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:21.915114 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5440b2-9010-4758-afd9-ddf9ed97b9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:21.915395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5440b2-9010-4758-afd9-ddf9ed97b9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:21.915674 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5440b2-9010-4758-afd9-ddf9ed97b9c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:21.916430 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5440b2-9010-4758-afd9-ddf9ed97b9c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:21.916772 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5440b2-9010-4758-afd9-ddf9ed97b9c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:21.918233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5440b2-9010-4758-afd9-ddf9ed97b9c6 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:21.932782 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 167/341] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:01:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:21.942574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5440b2-9010-4758-afd9-ddf9ed97b9c6 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:21.956417 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f849f24-2a2d-411a-8e51-07237e71e88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:21.957151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f849f24-2a2d-411a-8e51-07237e71e88c None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:21.957429 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f849f24-2a2d-411a-8e51-07237e71e88c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:21.957701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f849f24-2a2d-411a-8e51-07237e71e88c None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:21.958488 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f849f24-2a2d-411a-8e51-07237e71e88c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:21.958794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f849f24-2a2d-411a-8e51-07237e71e88c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:21.960325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f849f24-2a2d-411a-8e51-07237e71e88c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:21.979858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 175/342] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:21.987980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f849f24-2a2d-411a-8e51-07237e71e88c None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:22.040955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:22.097773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5440b2-9010-4758-afd9-ddf9ed97b9c6 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:22.134809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ad493-b128-4aeb-9396-c6e519467b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:22.135476 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ad493-b128-4aeb-9396-c6e519467b49 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:22.135813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ad493-b128-4aeb-9396-c6e519467b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:22.136092 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ad493-b128-4aeb-9396-c6e519467b49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:22.177607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f849f24-2a2d-411a-8e51-07237e71e88c None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:22.215521 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ad493-b128-4aeb-9396-c6e519467b49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:22.216345 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:22.218279 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ad493-b128-4aeb-9396-c6e519467b49 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:22.227699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393e737-5a37-4f0d-90ce-3e8c2e388e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:22.228990 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393e737-5a37-4f0d-90ce-3e8c2e388e88 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:22.229265 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393e737-5a37-4f0d-90ce-3e8c2e388e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:22.229712 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393e737-5a37-4f0d-90ce-3e8c2e388e88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:22.273844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:22.328084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 168/343] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 21:01:22.329643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28dd079-911e-4e46-848c-58fe24dcc121 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:22.330004 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28dd079-911e-4e46-848c-58fe24dcc121 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:22.330354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28dd079-911e-4e46-848c-58fe24dcc121 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:22.332403 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 169/344] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:22.338402 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ff7cc-9694-4e53-befa-69dd9e8a1f63 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:22.338829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ff7cc-9694-4e53-befa-69dd9e8a1f63 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:22.339208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ff7cc-9694-4e53-befa-69dd9e8a1f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:22.352615 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393e737-5a37-4f0d-90ce-3e8c2e388e88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:22.354693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393e737-5a37-4f0d-90ce-3e8c2e388e88 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:22.369816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-0e7ff7cc-9694-4e53-befa-69dd9e8a1f63 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:22.371211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-0e7ff7cc-9694-4e53-befa-69dd9e8a1f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:22.486513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 170/345] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:01:22.488478 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ff7cc-9694-4e53-befa-69dd9e8a1f63 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:22.507253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 176/346] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:22.513042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393e737-5a37-4f0d-90ce-3e8c2e388e88 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:22.596959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:22.648416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:22.667530 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ff7cc-9694-4e53-befa-69dd9e8a1f63 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:22.679174 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393e737-5a37-4f0d-90ce-3e8c2e388e88 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:22.708165 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e3b69-979f-4ed8-be7d-010d8fd01c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:22.709415 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e3b69-979f-4ed8-be7d-010d8fd01c01 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:22.709910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e3b69-979f-4ed8-be7d-010d8fd01c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:22.710396 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e3b69-979f-4ed8-be7d-010d8fd01c01 None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:22.711662 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e3b69-979f-4ed8-be7d-010d8fd01c01 None admin] RBAC: Authorizing `identity:get_project(project_id=8e241471fdd8481c81049b886aa4ed5c)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:22.713822 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e3b69-979f-4ed8-be7d-010d8fd01c01 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:22.715749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 171/347] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:22 2022] GET /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:22.716887 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e3b69-979f-4ed8-be7d-010d8fd01c01 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:22.717831 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d03c4b-2b00-4c75-844f-fdf454e1dcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:22.718996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d03c4b-2b00-4c75-844f-fdf454e1dcd1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:22.719495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d03c4b-2b00-4c75-844f-fdf454e1dcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:22.719977 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d03c4b-2b00-4c75-844f-fdf454e1dcd1 None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:22.721784 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d03c4b-2b00-4c75-844f-fdf454e1dcd1 None admin] RBAC: Authorizing `identity:get_project(project_id=8e241471fdd8481c81049b886aa4ed5c)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:22.723571 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d03c4b-2b00-4c75-844f-fdf454e1dcd1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:22.725627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 177/348] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:22 2022] GET /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:22.727057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553a8c9-48d6-47da-a41c-7d0e1d0755bf None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:22.727353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553a8c9-48d6-47da-a41c-7d0e1d0755bf None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:22.727631 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553a8c9-48d6-47da-a41c-7d0e1d0755bf None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:22.733696 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 178/349] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:22.734360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553a8c9-48d6-47da-a41c-7d0e1d0755bf None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:22.845414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e3b69-979f-4ed8-be7d-010d8fd01c01 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:22.857170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:22.863738 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553a8c9-48d6-47da-a41c-7d0e1d0755bf None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:22.889160 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119d0ea-b031-4b3b-a5ba-fa2890518596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:22.890399 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119d0ea-b031-4b3b-a5ba-fa2890518596 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:22.890847 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119d0ea-b031-4b3b-a5ba-fa2890518596 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:22.891281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119d0ea-b031-4b3b-a5ba-fa2890518596 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:22.904168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119d0ea-b031-4b3b-a5ba-fa2890518596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:22.907950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422e6e5-8ea9-439e-a47c-a254087d00f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:22.909125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422e6e5-8ea9-439e-a47c-a254087d00f1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:22.909809 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422e6e5-8ea9-439e-a47c-a254087d00f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:22.910616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422e6e5-8ea9-439e-a47c-a254087d00f1 None admin] PATH_INFO: `/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:22.912898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-8119d0ea-b031-4b3b-a5ba-fa2890518596 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 21:01:22.912898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:22.912898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:22.912898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:22.912898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:22.912898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:22.912898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:22.912898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:22.912898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:22.912898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:22.912898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:22.912898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:22.912898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:22.912898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:22.912898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:22.912898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:22.913825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:22.913825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:22.913825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:22.913825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:22.913825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:22.913825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:22.913825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:22.913825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:22.913825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:22.913825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:22.913825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:22.913825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:22.913825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:22.913825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:22.913825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:22.913825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:22.914643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:22.914643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:22.914643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:22.914643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:22.914643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:22.914643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:22.914643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:22.914643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:22.914643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:22.914643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:22.914643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 21:01:22.914643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:22.916910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 172/350] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:22.918265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f49f6-2b60-4e37-8424-74dc03a9e375 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:22.918732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f49f6-2b60-4e37-8424-74dc03a9e375 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:22.919177 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f49f6-2b60-4e37-8424-74dc03a9e375 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:22.922378 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 173/351] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:22.923294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f49f6-2b60-4e37-8424-74dc03a9e375 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:22.927371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422e6e5-8ea9-439e-a47c-a254087d00f1 None admin] RBAC: Authorizing `identity:get_group(group_id=f0cccdc1d7e64497ab7b3d11bd2360bd)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:22.929050 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422e6e5-8ea9-439e-a47c-a254087d00f1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:22.931090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 179/352] 10.222.0.66 () {56 vars in 1180 bytes} [Thu May 26 21:01:22 2022] GET /identity/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:22.932308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b03d05-89bf-49e1-b085-b477cc9ac3c5 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:22.932701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b03d05-89bf-49e1-b085-b477cc9ac3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:22.933221 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b03d05-89bf-49e1-b085-b477cc9ac3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:22.939230 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:22.955085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-63b03d05-89bf-49e1-b085-b477cc9ac3c5 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:22.961823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-63b03d05-89bf-49e1-b085-b477cc9ac3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:23.055240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 180/353] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:23.055240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b03d05-89bf-49e1-b085-b477cc9ac3c5 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:23.063681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f49f6-2b60-4e37-8424-74dc03a9e375 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:23.109259 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6092e4-8651-4d23-ac79-fe05f056c7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:23.110117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6092e4-8651-4d23-ac79-fe05f056c7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:23.110393 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6092e4-8651-4d23-ac79-fe05f056c7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:23.110724 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6092e4-8651-4d23-ac79-fe05f056c7d5 None admin] PATH_INFO: `/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:23.111898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6092e4-8651-4d23-ac79-fe05f056c7d5 None admin] RBAC: Authorizing `identity:get_group(group_id=f0cccdc1d7e64497ab7b3d11bd2360bd)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:23.113381 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6092e4-8651-4d23-ac79-fe05f056c7d5 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:23.114990 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 174/354] 10.222.0.66 () {56 vars in 1180 bytes} [Thu May 26 21:01:22 2022] GET /identity/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:23.116129 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bda77a-9ebf-4fd5-96a3-11590df36fb2 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:23.116428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bda77a-9ebf-4fd5-96a3-11590df36fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:23.116696 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bda77a-9ebf-4fd5-96a3-11590df36fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:23.135716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-a9bda77a-9ebf-4fd5-96a3-11590df36fb2 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:23.136951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a9bda77a-9ebf-4fd5-96a3-11590df36fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:23.180468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:23.188538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b03d05-89bf-49e1-b085-b477cc9ac3c5 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:23.225196 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 175/355] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:23.226682 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bda77a-9ebf-4fd5-96a3-11590df36fb2 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:23.237609 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d496a6-a52e-4018-8a0e-9a7c9dc1a066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:23.239083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:23.239248 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d496a6-a52e-4018-8a0e-9a7c9dc1a066 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:23.240122 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d496a6-a52e-4018-8a0e-9a7c9dc1a066 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:23.240483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d496a6-a52e-4018-8a0e-9a7c9dc1a066 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:23.241430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d496a6-a52e-4018-8a0e-9a7c9dc1a066 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:23.242123 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d496a6-a52e-4018-8a0e-9a7c9dc1a066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:23.244006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d496a6-a52e-4018-8a0e-9a7c9dc1a066 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:23.255853 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 181/356] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:01:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:23.256905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d496a6-a52e-4018-8a0e-9a7c9dc1a066 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:23.341893 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bda77a-9ebf-4fd5-96a3-11590df36fb2 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:23.374014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d496a6-a52e-4018-8a0e-9a7c9dc1a066 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:23.381771 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cb84b-f0a8-4ebe-b4ad-4b84d431c4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:23.382440 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cb84b-f0a8-4ebe-b4ad-4b84d431c4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:23.382713 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cb84b-f0a8-4ebe-b4ad-4b84d431c4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:23.382985 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cb84b-f0a8-4ebe-b4ad-4b84d431c4c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:23.383818 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cb84b-f0a8-4ebe-b4ad-4b84d431c4c7 None admin] RBAC: Adding query filter params (group.id=f0cccdc1d7e64497ab7b3d11bd2360bd, role.id=7cbf3c401d60412fbcae272fb8d191cc, scope.project.id=8e241471fdd8481c81049b886aa4ed5c) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:23.384127 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cb84b-f0a8-4ebe-b4ad-4b84d431c4c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:23.385612 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cb84b-f0a8-4ebe-b4ad-4b84d431c4c7 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:23.391908 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 176/357] 10.222.0.66 () {56 vars in 1376 bytes} [Thu May 26 21:01:23 2022] GET /identity/v3/role_assignments?group.id=f0cccdc1d7e64497ab7b3d11bd2360bd&scope.project.id=8e241471fdd8481c81049b886aa4ed5c&role.id=7cbf3c401d60412fbcae272fb8d191cc => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:23.392775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cb84b-f0a8-4ebe-b4ad-4b84d431c4c7 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:23.420393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee167c-738c-4ea1-af0a-b56196eb821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:23.422005 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee167c-738c-4ea1-af0a-b56196eb821f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:23.422384 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee167c-738c-4ea1-af0a-b56196eb821f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:23.422673 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee167c-738c-4ea1-af0a-b56196eb821f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:23.439202 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee167c-738c-4ea1-af0a-b56196eb821f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:23.447181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-07ee167c-738c-4ea1-af0a-b56196eb821f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:23.447181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:23.447181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:23.447181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:23.447181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:23.447181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:23.447181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:23.447181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:23.447181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:23.447181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:23.447181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:23.447181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:23.447181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:23.447181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:23.447181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:23.447181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:23.448115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:23.448115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:23.448115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:23.448115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:23.448115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:23.448115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:23.448115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:23.448115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:23.448115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:23.448115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:23.448115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:23.448115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:23.448115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:23.448115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:23.448115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:23.448115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:23.448947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:23.448947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:23.448947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:23.448947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:23.448947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:23.448947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:23.448947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:23.448947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:23.448947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:23.448947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:23.448947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:23.448947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:23.448947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 182/358] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:23.449588 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee167c-738c-4ea1-af0a-b56196eb821f None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:23.473827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:23.487393 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:23.534853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cb84b-f0a8-4ebe-b4ad-4b84d431c4c7 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:23.587851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e9a8b-3ec1-401b-9bcc-1268cbd097d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:23.588536 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e9a8b-3ec1-401b-9bcc-1268cbd097d8 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:23.588862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e9a8b-3ec1-401b-9bcc-1268cbd097d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:23.589533 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e9a8b-3ec1-401b-9bcc-1268cbd097d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:23.590683 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e9a8b-3ec1-401b-9bcc-1268cbd097d8 None admin] RBAC: Adding query filter params (group.id=f0cccdc1d7e64497ab7b3d11bd2360bd, role.id=d45da92733d441d7bfeeb10c762c6138, scope.project.id=8e241471fdd8481c81049b886aa4ed5c) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:23.590997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e9a8b-3ec1-401b-9bcc-1268cbd097d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:23.594424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e9a8b-3ec1-401b-9bcc-1268cbd097d8 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:23.596134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee167c-738c-4ea1-af0a-b56196eb821f None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:23.601964 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 177/359] 10.222.0.66 () {56 vars in 1376 bytes} [Thu May 26 21:01:23 2022] GET /identity/v3/role_assignments?group.id=f0cccdc1d7e64497ab7b3d11bd2360bd&scope.project.id=8e241471fdd8481c81049b886aa4ed5c&role.id=d45da92733d441d7bfeeb10c762c6138 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:23.602804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e9a8b-3ec1-401b-9bcc-1268cbd097d8 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:23.648556 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00822861-7b97-41c4-8ef6-f0112050f0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:23.650174 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00822861-7b97-41c4-8ef6-f0112050f0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:23.650584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00822861-7b97-41c4-8ef6-f0112050f0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:23.650870 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00822861-7b97-41c4-8ef6-f0112050f0a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:23.667258 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00822861-7b97-41c4-8ef6-f0112050f0a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:23.678567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-00822861-7b97-41c4-8ef6-f0112050f0a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:23.678567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:23.678567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:23.678567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:23.678567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:23.678567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:23.678567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:23.678567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:23.678567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:23.678567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:23.678567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:23.678567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:23.678567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:23.678567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:23.678567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:23.678567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:23.679525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:23.679525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:23.679525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:23.679525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:23.679525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:23.679525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:23.679525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:23.679525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:23.679525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:23.679525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:23.679525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:23.679525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:23.679525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:23.679525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:23.679525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:23.679525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:23.680317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:23.680317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:23.680317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:23.680317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:23.680317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:23.680317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:23.680317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:23.680317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:23.680317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:23.680317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:23.680317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:23.680317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:23.681277 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 183/360] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:01:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:23.682907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ab0b1-5860-43ae-bf8a-7fef2f9b3aa4 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:23.683041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ab0b1-5860-43ae-bf8a-7fef2f9b3aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:23.683319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ab0b1-5860-43ae-bf8a-7fef2f9b3aa4 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:23.685577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 184/361] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:23.686424 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ab0b1-5860-43ae-bf8a-7fef2f9b3aa4 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:23.756240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e9a8b-3ec1-401b-9bcc-1268cbd097d8 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:23.786936 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:23.802180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdaf519-a599-4177-976b-757e857cc218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:23.803234 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdaf519-a599-4177-976b-757e857cc218 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:23.803517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdaf519-a599-4177-976b-757e857cc218 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:23.803841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdaf519-a599-4177-976b-757e857cc218 None admin] PATH_INFO: `/v3/users/cce8f280e33e437d973f7d15240a2ace` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:23.805185 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdaf519-a599-4177-976b-757e857cc218 None admin] RBAC: Authorizing `identity:get_user(user_id=cce8f280e33e437d973f7d15240a2ace)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:23.817345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdaf519-a599-4177-976b-757e857cc218 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:23.817345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 178/362] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:01:23 2022] GET /identity/v3/users/cce8f280e33e437d973f7d15240a2ace => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:23.817345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdaf519-a599-4177-976b-757e857cc218 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:23.817345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:23.821648 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ab0b1-5860-43ae-bf8a-7fef2f9b3aa4 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:23.864216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155fd7c-9085-422e-934c-739dcf44ab1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:23.864974 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155fd7c-9085-422e-934c-739dcf44ab1a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:23.865737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155fd7c-9085-422e-934c-739dcf44ab1a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:23.866024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155fd7c-9085-422e-934c-739dcf44ab1a None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:23.868839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155fd7c-9085-422e-934c-739dcf44ab1a None admin] RBAC: Adding query filter params (name=member) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:23.869375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155fd7c-9085-422e-934c-739dcf44ab1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:23.870969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155fd7c-9085-422e-934c-739dcf44ab1a None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:23.882469 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 185/363] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:01:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:23.884045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcf135-dd5b-49ef-ad0c-0e8e6f7f7332 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:23.884535 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcf135-dd5b-49ef-ad0c-0e8e6f7f7332 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:23.885064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcf135-dd5b-49ef-ad0c-0e8e6f7f7332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:23.907826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-72bcf135-dd5b-49ef-ad0c-0e8e6f7f7332 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:23.909459 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-72bcf135-dd5b-49ef-ad0c-0e8e6f7f7332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:23.953574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdaf519-a599-4177-976b-757e857cc218 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:23.988368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 186/364] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:23.989651 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcf135-dd5b-49ef-ad0c-0e8e6f7f7332 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:23.994011 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae546c2-5d14-4339-9f51-ea97c3fd5021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:23.994689 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae546c2-5d14-4339-9f51-ea97c3fd5021 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:23.994972 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae546c2-5d14-4339-9f51-ea97c3fd5021 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:23.995244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae546c2-5d14-4339-9f51-ea97c3fd5021 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:23.995992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae546c2-5d14-4339-9f51-ea97c3fd5021 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:23.996295 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae546c2-5d14-4339-9f51-ea97c3fd5021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:23.997721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae546c2-5d14-4339-9f51-ea97c3fd5021 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:24.008885 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 179/365] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:24.010081 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae546c2-5d14-4339-9f51-ea97c3fd5021 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:24.077069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:24.093624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:24.123701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcf135-dd5b-49ef-ad0c-0e8e6f7f7332 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:24.135398 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae546c2-5d14-4339-9f51-ea97c3fd5021 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:24.166577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce872b58-b16d-4811-9a24-6dcf79e4774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:24.167359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce872b58-b16d-4811-9a24-6dcf79e4774a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:24.167626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce872b58-b16d-4811-9a24-6dcf79e4774a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:24.167903 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce872b58-b16d-4811-9a24-6dcf79e4774a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:24.169029 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce872b58-b16d-4811-9a24-6dcf79e4774a None admin] RBAC: Adding query filter params (role.id=d4282b64bc3b42419a613a6210a47a2b, user.id=cce8f280e33e437d973f7d15240a2ace, scope.system=all) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:24.169211 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce872b58-b16d-4811-9a24-6dcf79e4774a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:24.171191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce872b58-b16d-4811-9a24-6dcf79e4774a None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:24.177452 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268f15f-ef5c-40a7-b373-688b65eb5c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:24.178580 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268f15f-ef5c-40a7-b373-688b65eb5c6c None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:24.179236 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268f15f-ef5c-40a7-b373-688b65eb5c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:24.179733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268f15f-ef5c-40a7-b373-688b65eb5c6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:24.186424 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 187/366] 10.222.0.66 () {56 vars in 1308 bytes} [Thu May 26 21:01:23 2022] GET /identity/v3/role_assignments?user.id=cce8f280e33e437d973f7d15240a2ace&scope.system=all&role.id=d4282b64bc3b42419a613a6210a47a2b => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:24.187283 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce872b58-b16d-4811-9a24-6dcf79e4774a None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:24.273636 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268f15f-ef5c-40a7-b373-688b65eb5c6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:24.275869 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268f15f-ef5c-40a7-b373-688b65eb5c6c None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:24.341386 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce872b58-b16d-4811-9a24-6dcf79e4774a None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:24.372255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:24.382996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224e332-5d38-46a1-bdfa-3924785d72c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:24.384446 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224e332-5d38-46a1-bdfa-3924785d72c2 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:24.384705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224e332-5d38-46a1-bdfa-3924785d72c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:24.385147 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224e332-5d38-46a1-bdfa-3924785d72c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:24.413752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:24.469139 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 180/367] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:24.469526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224e332-5d38-46a1-bdfa-3924785d72c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:24.470180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268f15f-ef5c-40a7-b373-688b65eb5c6c None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:24.471380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224e332-5d38-46a1-bdfa-3924785d72c2 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:24.583502 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 188/368] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:24.588617 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224e332-5d38-46a1-bdfa-3924785d72c2 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:24.591701 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268f15f-ef5c-40a7-b373-688b65eb5c6c None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:24.616049 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:24.630707 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629bda7-2942-4aeb-a384-30f1a67a1e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:24.631755 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629bda7-2942-4aeb-a384-30f1a67a1e98 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:24.632185 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629bda7-2942-4aeb-a384-30f1a67a1e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:24.632654 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629bda7-2942-4aeb-a384-30f1a67a1e98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:24.647649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629bda7-2942-4aeb-a384-30f1a67a1e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:24.655752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-a629bda7-2942-4aeb-a384-30f1a67a1e98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:01:24.655752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:24.655752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:24.655752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:24.655752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:24.655752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:24.655752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:24.655752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:24.655752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:24.655752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:24.655752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:24.655752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:24.655752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:24.655752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:24.655752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:24.655752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:24.658929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:24.658929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:24.658929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:24.658929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:24.658929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:24.658929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:24.658929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:24.658929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:24.658929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:24.658929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:24.658929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:24.658929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:24.658929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:24.658929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:24.658929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:24.658929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:24.659705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:24.659705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:24.659705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:24.659705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:24.659705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:24.659705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:24.659705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:24.659705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:24.659705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:24.659705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:24.659705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:01:24.659705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:24.661937 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 181/369] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:01:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:24.662933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629bda7-2942-4aeb-a384-30f1a67a1e98 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:24.695374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:24.707108 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224e332-5d38-46a1-bdfa-3924785d72c2 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:24.748511 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37dea0-207d-41c1-82fd-e19c9e948072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:24.750102 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37dea0-207d-41c1-82fd-e19c9e948072 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:24.750458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37dea0-207d-41c1-82fd-e19c9e948072 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:24.750750 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37dea0-207d-41c1-82fd-e19c9e948072 None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:24.752199 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37dea0-207d-41c1-82fd-e19c9e948072 None admin] RBAC: Authorizing `identity:get_project(project_id=0c071ff9e8b04956814c07c7d5500549)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:24.753923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37dea0-207d-41c1-82fd-e19c9e948072 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:24.756025 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 189/370] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:24 2022] GET /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:24.757016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37dea0-207d-41c1-82fd-e19c9e948072 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:24.777484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629bda7-2942-4aeb-a384-30f1a67a1e98 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:24.814351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eca7ee-80ab-402c-ad5e-5f098abf4e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:24.815500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eca7ee-80ab-402c-ad5e-5f098abf4e94 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:24.815975 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eca7ee-80ab-402c-ad5e-5f098abf4e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:24.816457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eca7ee-80ab-402c-ad5e-5f098abf4e94 None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:24.817975 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eca7ee-80ab-402c-ad5e-5f098abf4e94 None admin] RBAC: Authorizing `identity:get_project(project_id=0c071ff9e8b04956814c07c7d5500549)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:24.819642 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eca7ee-80ab-402c-ad5e-5f098abf4e94 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:24.821614 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 182/371] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:24 2022] GET /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:24.822631 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eca7ee-80ab-402c-ad5e-5f098abf4e94 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:24.860911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:24.868393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37dea0-207d-41c1-82fd-e19c9e948072 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:24.914679 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bc253-9ffa-45f0-8727-e99013f786cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:24.915357 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bc253-9ffa-45f0-8727-e99013f786cc None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:24.915636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bc253-9ffa-45f0-8727-e99013f786cc None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:24.915908 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bc253-9ffa-45f0-8727-e99013f786cc None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:24.916790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bc253-9ffa-45f0-8727-e99013f786cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:24.917093 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bc253-9ffa-45f0-8727-e99013f786cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:24.918571 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bc253-9ffa-45f0-8727-e99013f786cc None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:24.927290 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:24.929559 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 190/372] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:24.934861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bc253-9ffa-45f0-8727-e99013f786cc None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:24.942252 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eca7ee-80ab-402c-ad5e-5f098abf4e94 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:24.974845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d8716-82a9-463a-981e-973cc331fee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:24.976095 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d8716-82a9-463a-981e-973cc331fee3 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:24.976605 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d8716-82a9-463a-981e-973cc331fee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:24.977151 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d8716-82a9-463a-981e-973cc331fee3 None admin] PATH_INFO: `/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:24.978643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d8716-82a9-463a-981e-973cc331fee3 None admin] RBAC: Authorizing `identity:get_group(group_id=f0cccdc1d7e64497ab7b3d11bd2360bd)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:24.980308 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d8716-82a9-463a-981e-973cc331fee3 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:24.982183 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 183/373] 10.222.0.66 () {56 vars in 1180 bytes} [Thu May 26 21:01:24 2022] GET /identity/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:24.983749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d8716-82a9-463a-981e-973cc331fee3 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:25.060897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bc253-9ffa-45f0-8727-e99013f786cc None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:25.094433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d8716-82a9-463a-981e-973cc331fee3 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:25.103840 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7957826-a275-4828-a2a6-200851dca420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:25.104752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7957826-a275-4828-a2a6-200851dca420 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:25.105032 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7957826-a275-4828-a2a6-200851dca420 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:25.105303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7957826-a275-4828-a2a6-200851dca420 None admin] PATH_INFO: `/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:25.106600 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7957826-a275-4828-a2a6-200851dca420 None admin] RBAC: Authorizing `identity:get_group(group_id=f0cccdc1d7e64497ab7b3d11bd2360bd)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:25.108834 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7957826-a275-4828-a2a6-200851dca420 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:25.110376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 191/374] 10.222.0.66 () {56 vars in 1180 bytes} [Thu May 26 21:01:24 2022] GET /identity/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:25.111232 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7957826-a275-4828-a2a6-200851dca420 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:25.135576 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae307dc9-a998-4451-99c3-932428b85690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:25.136634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae307dc9-a998-4451-99c3-932428b85690 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:25.137140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae307dc9-a998-4451-99c3-932428b85690 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:25.137629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae307dc9-a998-4451-99c3-932428b85690 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:25.141881 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:25.171049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:25.215182 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae307dc9-a998-4451-99c3-932428b85690 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:25.216670 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae307dc9-a998-4451-99c3-932428b85690 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:25.239812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7957826-a275-4828-a2a6-200851dca420 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:25.278480 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68eaffc-882a-4543-905b-8741b8005fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:25.279477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eaffc-882a-4543-905b-8741b8005fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:25.279854 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eaffc-882a-4543-905b-8741b8005fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:25.280132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eaffc-882a-4543-905b-8741b8005fc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:25.281003 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68eaffc-882a-4543-905b-8741b8005fc8 None admin] RBAC: Adding query filter params (group.id=f0cccdc1d7e64497ab7b3d11bd2360bd, role.id=7cbf3c401d60412fbcae272fb8d191cc, scope.project.id=0c071ff9e8b04956814c07c7d5500549) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:25.281308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68eaffc-882a-4543-905b-8741b8005fc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:25.282982 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68eaffc-882a-4543-905b-8741b8005fc8 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:25.289382 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 192/375] 10.222.0.66 () {56 vars in 1376 bytes} [Thu May 26 21:01:25 2022] GET /identity/v3/role_assignments?group.id=f0cccdc1d7e64497ab7b3d11bd2360bd&scope.project.id=0c071ff9e8b04956814c07c7d5500549&role.id=7cbf3c401d60412fbcae272fb8d191cc => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:25.290381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68eaffc-882a-4543-905b-8741b8005fc8 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:25.324522 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 184/376] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:25.351957 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae307dc9-a998-4451-99c3-932428b85690 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:25.397851 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:25.412343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68eaffc-882a-4543-905b-8741b8005fc8 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:25.452546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1a1e7-8202-406b-a3f7-90ab585703ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:25.453250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1a1e7-8202-406b-a3f7-90ab585703ae None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:25.453574 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1a1e7-8202-406b-a3f7-90ab585703ae None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:25.453856 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1a1e7-8202-406b-a3f7-90ab585703ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:25.454840 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1a1e7-8202-406b-a3f7-90ab585703ae None admin] RBAC: Adding query filter params (group.id=f0cccdc1d7e64497ab7b3d11bd2360bd, role.id=d45da92733d441d7bfeeb10c762c6138, scope.project.id=0c071ff9e8b04956814c07c7d5500549) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:25.455150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1a1e7-8202-406b-a3f7-90ab585703ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:25.456612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1a1e7-8202-406b-a3f7-90ab585703ae None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:25.463158 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 193/377] 10.222.0.66 () {56 vars in 1376 bytes} [Thu May 26 21:01:25 2022] GET /identity/v3/role_assignments?group.id=f0cccdc1d7e64497ab7b3d11bd2360bd&scope.project.id=0c071ff9e8b04956814c07c7d5500549&role.id=d45da92733d441d7bfeeb10c762c6138 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:25.465236 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:25.537071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae307dc9-a998-4451-99c3-932428b85690 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:25.599910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88980c16-3b56-44b8-a8fd-077077c5185b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:25.600837 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88980c16-3b56-44b8-a8fd-077077c5185b None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:25.601119 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88980c16-3b56-44b8-a8fd-077077c5185b None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:25.601458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88980c16-3b56-44b8-a8fd-077077c5185b None admin] PATH_INFO: `/v3/projects/7b6a47aff4f04a489b501a19f68711d3` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:25.602812 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88980c16-3b56-44b8-a8fd-077077c5185b None admin] RBAC: Authorizing `identity:get_project(project_id=7b6a47aff4f04a489b501a19f68711d3)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:25.604262 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88980c16-3b56-44b8-a8fd-077077c5185b None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:25.606152 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 185/378] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:25 2022] GET /identity/v3/projects/7b6a47aff4f04a489b501a19f68711d3 => generated 344 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:25.612539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1a1e7-8202-406b-a3f7-90ab585703ae None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:25.728175 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1a1e7-8202-406b-a3f7-90ab585703ae None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:25.763881 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75b9c3-acf7-4f47-bc06-f03d945df424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:25.765314 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75b9c3-acf7-4f47-bc06-f03d945df424 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:25.765593 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75b9c3-acf7-4f47-bc06-f03d945df424 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:25.765862 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75b9c3-acf7-4f47-bc06-f03d945df424 None admin] PATH_INFO: `/v3/groups/f6b3678731f54d6199df0fce069ccd9e` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:25.771385 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75b9c3-acf7-4f47-bc06-f03d945df424 None admin] RBAC: Authorizing `identity:get_group(group_id=f6b3678731f54d6199df0fce069ccd9e)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:25.772869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75b9c3-acf7-4f47-bc06-f03d945df424 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:25.778198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 194/379] 10.222.0.66 () {56 vars in 1180 bytes} [Thu May 26 21:01:25 2022] GET /identity/v3/groups/f6b3678731f54d6199df0fce069ccd9e => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:25.781469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88980c16-3b56-44b8-a8fd-077077c5185b None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:25.902173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88980c16-3b56-44b8-a8fd-077077c5185b None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:25.933546 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:25.941652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfe39c-f11e-4d76-bf04-f3219683b1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:25.942318 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfe39c-f11e-4d76-bf04-f3219683b1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:25.942597 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfe39c-f11e-4d76-bf04-f3219683b1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:25.942917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfe39c-f11e-4d76-bf04-f3219683b1a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:25.943820 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfe39c-f11e-4d76-bf04-f3219683b1a6 None admin] RBAC: Adding query filter params (group.id=f6b3678731f54d6199df0fce069ccd9e, role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.project.id=7b6a47aff4f04a489b501a19f68711d3) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:25.944134 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfe39c-f11e-4d76-bf04-f3219683b1a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:25.945726 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfe39c-f11e-4d76-bf04-f3219683b1a6 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:25.956504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 186/380] 10.222.0.66 () {56 vars in 1376 bytes} [Thu May 26 21:01:25 2022] GET /identity/v3/role_assignments?group.id=f6b3678731f54d6199df0fce069ccd9e&scope.project.id=7b6a47aff4f04a489b501a19f68711d3&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:26.059759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe429c6a-7bfc-46e9-a99a-887cb94056ed None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:26.060086 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe429c6a-7bfc-46e9-a99a-887cb94056ed None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:26.060612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe429c6a-7bfc-46e9-a99a-887cb94056ed None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:26.062676 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 195/381] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:26.068417 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49800f-16f1-421b-b988-4d5ce630dfd0 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:26.068729 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49800f-16f1-421b-b988-4d5ce630dfd0 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:26.068998 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49800f-16f1-421b-b988-4d5ce630dfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:26.087697 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-1c49800f-16f1-421b-b988-4d5ce630dfd0 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:26.089280 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1c49800f-16f1-421b-b988-4d5ce630dfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:26.164961 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 187/382] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:26.189308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe429c6a-7bfc-46e9-a99a-887cb94056ed None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:26.210216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:26.322914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe429c6a-7bfc-46e9-a99a-887cb94056ed None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:26.362895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aff6f6-0638-4243-a532-a71a04bbc4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:26.364075 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aff6f6-0638-4243-a532-a71a04bbc4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:26.364554 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aff6f6-0638-4243-a532-a71a04bbc4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:26.365054 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aff6f6-0638-4243-a532-a71a04bbc4a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:26.377133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aff6f6-0638-4243-a532-a71a04bbc4a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:26.385442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-a8aff6f6-0638-4243-a532-a71a04bbc4a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:26.385442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:26.385442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:26.385442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:26.385442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:26.385442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:26.385442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:26.385442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:26.385442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:26.385442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:26.385442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:26.385442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:26.385442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:26.385442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:26.385442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:26.385442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:26.386343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:26.386343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:26.386343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:26.386343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:26.386343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:26.386343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:26.386343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:26.386343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:26.386343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:26.386343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:26.386343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:26.386343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:26.386343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:26.386343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:26.386343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:26.386343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:26.387133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:26.387133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:26.387133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:26.387133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:26.387133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:26.387133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:26.387133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:26.387133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:26.387133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:26.387133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:26.387133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:26.387133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:26.390609 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 196/383] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:26.397736 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49800f-16f1-421b-b988-4d5ce630dfd0 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:26.511498 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd0c1b-6c49-446d-bab6-476d1991bba5 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:26.511799 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd0c1b-6c49-446d-bab6-476d1991bba5 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:26.512240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd0c1b-6c49-446d-bab6-476d1991bba5 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:26.513793 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 197/384] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:26.519426 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a6e1c-3626-44ed-a152-75c1ca80516a None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:26.519713 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a6e1c-3626-44ed-a152-75c1ca80516a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:26.519990 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a6e1c-3626-44ed-a152-75c1ca80516a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:26.539295 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49800f-16f1-421b-b988-4d5ce630dfd0 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:26.567996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-e99a6e1c-3626-44ed-a152-75c1ca80516a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:26.569254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e99a6e1c-3626-44ed-a152-75c1ca80516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:26.576999 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:26.581657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d437484-6b03-4d4b-9a65-e33d541c8591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:26.582579 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d437484-6b03-4d4b-9a65-e33d541c8591 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:26.583045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d437484-6b03-4d4b-9a65-e33d541c8591 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:26.583544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d437484-6b03-4d4b-9a65-e33d541c8591 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:26.584618 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d437484-6b03-4d4b-9a65-e33d541c8591 None admin] RBAC: Adding query filter params (name=member) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:26.585280 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d437484-6b03-4d4b-9a65-e33d541c8591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:26.586891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d437484-6b03-4d4b-9a65-e33d541c8591 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:26.596009 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 188/385] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:01:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:26.601821 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d437484-6b03-4d4b-9a65-e33d541c8591 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:26.705454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 198/386] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:01:26.744796 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a6e1c-3626-44ed-a152-75c1ca80516a None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:26.754265 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:26.754595 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d437484-6b03-4d4b-9a65-e33d541c8591 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:26.833276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418aff7-6960-4a12-9a55-f91bc891b504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:26.834124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418aff7-6960-4a12-9a55-f91bc891b504 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:26.834406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418aff7-6960-4a12-9a55-f91bc891b504 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:26.834680 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418aff7-6960-4a12-9a55-f91bc891b504 None admin] PATH_INFO: `/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:26.839716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418aff7-6960-4a12-9a55-f91bc891b504 None admin] RBAC: Authorizing `identity:get_group(group_id=f0cccdc1d7e64497ab7b3d11bd2360bd)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:26.841255 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418aff7-6960-4a12-9a55-f91bc891b504 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:26.844508 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 189/387] 10.222.0.66 () {56 vars in 1180 bytes} [Thu May 26 21:01:26 2022] GET /identity/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:26.850072 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418aff7-6960-4a12-9a55-f91bc891b504 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:26.911256 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a6e1c-3626-44ed-a152-75c1ca80516a None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:26.924987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:26.968945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418aff7-6960-4a12-9a55-f91bc891b504 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:26.970965 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f12853-f3e4-4bf3-af58-c0c27d4e7255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:26.972101 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f12853-f3e4-4bf3-af58-c0c27d4e7255 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:26.972621 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f12853-f3e4-4bf3-af58-c0c27d4e7255 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:26.973089 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f12853-f3e4-4bf3-af58-c0c27d4e7255 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:26.985510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f12853-f3e4-4bf3-af58-c0c27d4e7255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:26.997421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-18f12853-f3e4-4bf3-af58-c0c27d4e7255 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:26.997421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:26.997421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:26.997421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:26.997421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:26.997421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:26.997421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:26.997421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:26.997421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:26.997421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:26.997421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:26.997421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:26.997421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:26.997421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:26.997421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:26.997421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:26.998324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:26.998324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:26.998324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:26.998324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:26.998324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:26.998324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:26.998324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:26.998324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:26.998324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:26.998324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:26.998324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:26.998324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:26.998324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:26.998324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:26.998324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:26.998324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:26.999218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:26.999218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:26.999218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:26.999218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:26.999218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:26.999218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:26.999218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:26.999218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:26.999218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:26.999218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:26.999218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:26.999218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:27.004345 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 199/388] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:01:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:01:27.007977 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f12853-f3e4-4bf3-af58-c0c27d4e7255 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:27.009007 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5877fb-193b-4ca5-b29b-e96d99a2471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:27.009898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5877fb-193b-4ca5-b29b-e96d99a2471c None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:27.010182 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5877fb-193b-4ca5-b29b-e96d99a2471c None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:27.010524 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5877fb-193b-4ca5-b29b-e96d99a2471c None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:27.012746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5877fb-193b-4ca5-b29b-e96d99a2471c None admin] RBAC: Authorizing `identity:get_project(project_id=8e241471fdd8481c81049b886aa4ed5c)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:27.014313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5877fb-193b-4ca5-b29b-e96d99a2471c None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:27.016344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 190/389] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:26 2022] GET /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:27.021566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5877fb-193b-4ca5-b29b-e96d99a2471c None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:27.084351 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:27.123437 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f12853-f3e4-4bf3-af58-c0c27d4e7255 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:27.135080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5877fb-193b-4ca5-b29b-e96d99a2471c None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:27.160376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180f17b-0074-4289-8177-5d784bcc29f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:27.161044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:27.162614 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180f17b-0074-4289-8177-5d784bcc29f0 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:27.163165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180f17b-0074-4289-8177-5d784bcc29f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:27.163660 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180f17b-0074-4289-8177-5d784bcc29f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:27.164689 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180f17b-0074-4289-8177-5d784bcc29f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:27.165210 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180f17b-0074-4289-8177-5d784bcc29f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:27.166832 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180f17b-0074-4289-8177-5d784bcc29f0 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:27.175563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c7eb7-cba5-4efe-b3cc-9bb09cfac866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:27.176481 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c7eb7-cba5-4efe-b3cc-9bb09cfac866 None admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:27.176846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c7eb7-cba5-4efe-b3cc-9bb09cfac866 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:27.177127 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c7eb7-cba5-4efe-b3cc-9bb09cfac866 None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c/groups/f0cccdc1d7e64497ab7b3d11bd2360bd/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:27.178932 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 200/390] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:27.181496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c7eb7-cba5-4efe-b3cc-9bb09cfac866 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e241471fdd8481c81049b886aa4ed5c, group_id=f0cccdc1d7e64497ab7b3d11bd2360bd, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:27.183224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c7eb7-cba5-4efe-b3cc-9bb09cfac866 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:27.185839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180f17b-0074-4289-8177-5d784bcc29f0 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:27.273566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 191/391] 10.222.0.66 () {58 vars in 1442 bytes} [Thu May 26 21:01:27 2022] PUT /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c/groups/f0cccdc1d7e64497ab7b3d11bd2360bd/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:01:27.311260 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180f17b-0074-4289-8177-5d784bcc29f0 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:27.348454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:27.361060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc574c0-caca-4def-b67d-dd7f9e1cd5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:27.362353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc574c0-caca-4def-b67d-dd7f9e1cd5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:27.365335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc574c0-caca-4def-b67d-dd7f9e1cd5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:27.365335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc574c0-caca-4def-b67d-dd7f9e1cd5f2 None admin] PATH_INFO: `/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:27.366448 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc574c0-caca-4def-b67d-dd7f9e1cd5f2 None admin] RBAC: Authorizing `identity:get_group(group_id=f0cccdc1d7e64497ab7b3d11bd2360bd)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:27.368129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc574c0-caca-4def-b67d-dd7f9e1cd5f2 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:27.370313 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 201/392] 10.222.0.66 () {56 vars in 1180 bytes} [Thu May 26 21:01:27 2022] GET /identity/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:27.376242 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c7eb7-cba5-4efe-b3cc-9bb09cfac866 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:27.511851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c7eb7-cba5-4efe-b3cc-9bb09cfac866 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:27.550324 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad2a22-0937-4336-9b7d-c1a299ce99ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:27.551198 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad2a22-0937-4336-9b7d-c1a299ce99ef None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:27.551487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad2a22-0937-4336-9b7d-c1a299ce99ef None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:27.551765 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad2a22-0937-4336-9b7d-c1a299ce99ef None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:27.553039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad2a22-0937-4336-9b7d-c1a299ce99ef None admin] RBAC: Authorizing `identity:get_project(project_id=8e241471fdd8481c81049b886aa4ed5c)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:27.554555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad2a22-0937-4336-9b7d-c1a299ce99ef None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:27.556568 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 192/393] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:27 2022] GET /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:27.563076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc574c0-caca-4def-b67d-dd7f9e1cd5f2 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:27.668917 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc574c0-caca-4def-b67d-dd7f9e1cd5f2 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:27.704651 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876e7b0-8701-4043-a352-f25bce4c0088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:27.705554 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876e7b0-8701-4043-a352-f25bce4c0088 None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:27.705840 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876e7b0-8701-4043-a352-f25bce4c0088 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:27.706119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876e7b0-8701-4043-a352-f25bce4c0088 None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c/groups/f0cccdc1d7e64497ab7b3d11bd2360bd/roles/d45da92733d441d7bfeeb10c762c6138` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:27.708387 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876e7b0-8701-4043-a352-f25bce4c0088 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e241471fdd8481c81049b886aa4ed5c, group_id=f0cccdc1d7e64497ab7b3d11bd2360bd, role_id=d45da92733d441d7bfeeb10c762c6138)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:27.709873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876e7b0-8701-4043-a352-f25bce4c0088 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:27.794776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 202/394] 10.222.0.66 () {58 vars in 1442 bytes} [Thu May 26 21:01:27 2022] PUT /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c/groups/f0cccdc1d7e64497ab7b3d11bd2360bd/roles/d45da92733d441d7bfeeb10c762c6138 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:01:28.253649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124645d8-408d-49b4-9bff-b177da430b4d None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:28.254020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124645d8-408d-49b4-9bff-b177da430b4d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:28.254213 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124645d8-408d-49b4-9bff-b177da430b4d None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:28.255932 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 193/395] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:28.261729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0a0ae-9bfe-49f8-a6a9-4e0a6b938829 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:28.262022 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0a0ae-9bfe-49f8-a6a9-4e0a6b938829 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:28.262304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0a0ae-9bfe-49f8-a6a9-4e0a6b938829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:28.281965 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-19a0a0ae-9bfe-49f8-a6a9-4e0a6b938829 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:28.283174 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-19a0a0ae-9bfe-49f8-a6a9-4e0a6b938829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:28.362182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:28.383205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 203/396] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:28.417499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124645d8-408d-49b4-9bff-b177da430b4d None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:28.490490 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:28.566344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124645d8-408d-49b4-9bff-b177da430b4d None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:28.614711 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc63fa7-d8a1-4861-9fbc-2ee9cdce8c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:28.615523 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc63fa7-d8a1-4861-9fbc-2ee9cdce8c51 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:28.615799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc63fa7-d8a1-4861-9fbc-2ee9cdce8c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:28.616067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc63fa7-d8a1-4861-9fbc-2ee9cdce8c51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:28.635502 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc63fa7-d8a1-4861-9fbc-2ee9cdce8c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:28.643339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-0cc63fa7-d8a1-4861-9fbc-2ee9cdce8c51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:28.643339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:28.643339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:28.643339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:28.643339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:28.643339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:28.643339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:28.643339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:28.643339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:28.643339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:28.643339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:28.643339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:28.643339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:28.643339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:28.643339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:28.643339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:28.644215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:28.644215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:28.644215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:28.644215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:28.644215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:28.644215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:28.644215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:28.644215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:28.644215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:28.644215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:28.644215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:28.644215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:28.644215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:28.644215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:28.644215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:28.644215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:28.645050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:28.645050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:28.645050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:28.645050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:28.645050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:28.645050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:28.645050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:28.645050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:28.645050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:28.645050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:28.645050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:28.645050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:28.645050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 194/397] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:28.650542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0a0ae-9bfe-49f8-a6a9-4e0a6b938829 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:28.685986 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88a472-9b8b-48fc-a084-d4c0629948fb None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:28.686459 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88a472-9b8b-48fc-a084-d4c0629948fb None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:28.686741 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88a472-9b8b-48fc-a084-d4c0629948fb None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:28.688267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 195/398] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:28.699352 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05656104-98b2-41ec-bd9b-28ab2eb8259b None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:28.699634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05656104-98b2-41ec-bd9b-28ab2eb8259b None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:28.699909 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05656104-98b2-41ec-bd9b-28ab2eb8259b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:28.732933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-05656104-98b2-41ec-bd9b-28ab2eb8259b None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:28.734144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-05656104-98b2-41ec-bd9b-28ab2eb8259b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:28.839363 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0a0ae-9bfe-49f8-a6a9-4e0a6b938829 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:28.878049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 196/399] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:01:28.900090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b292a-a043-40c3-ae51-6fef08418385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:28.901274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b292a-a043-40c3-ae51-6fef08418385 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:28.901774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b292a-a043-40c3-ae51-6fef08418385 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:28.902285 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b292a-a043-40c3-ae51-6fef08418385 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:28.903292 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b292a-a043-40c3-ae51-6fef08418385 None admin] RBAC: Adding query filter params (name=member) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:28.903807 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b292a-a043-40c3-ae51-6fef08418385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:28.906007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b292a-a043-40c3-ae51-6fef08418385 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:28.912034 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05656104-98b2-41ec-bd9b-28ab2eb8259b None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:28.931502 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 204/400] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:01:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:28.941728 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b292a-a043-40c3-ae51-6fef08418385 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:28.985394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:29.017104 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:29.072305 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b292a-a043-40c3-ae51-6fef08418385 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:29.116207 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329a16b-4f69-4011-8b50-a6867179cc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:29.117430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329a16b-4f69-4011-8b50-a6867179cc5c None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:29.117943 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329a16b-4f69-4011-8b50-a6867179cc5c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:29.118434 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329a16b-4f69-4011-8b50-a6867179cc5c None admin] PATH_INFO: `/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:29.119902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329a16b-4f69-4011-8b50-a6867179cc5c None admin] RBAC: Authorizing `identity:get_group(group_id=f0cccdc1d7e64497ab7b3d11bd2360bd)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:29.121574 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329a16b-4f69-4011-8b50-a6867179cc5c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:29.123752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 205/401] 10.222.0.66 () {56 vars in 1180 bytes} [Thu May 26 21:01:28 2022] GET /identity/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:29.134281 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329a16b-4f69-4011-8b50-a6867179cc5c None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:29.151498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05656104-98b2-41ec-bd9b-28ab2eb8259b None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:29.189990 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964656cf-9a31-4912-add7-eb0a54dca7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:29.191283 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964656cf-9a31-4912-add7-eb0a54dca7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:29.191800 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964656cf-9a31-4912-add7-eb0a54dca7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:29.192304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964656cf-9a31-4912-add7-eb0a54dca7f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:29.207860 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964656cf-9a31-4912-add7-eb0a54dca7f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:29.215974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-964656cf-9a31-4912-add7-eb0a54dca7f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:29.215974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:29.215974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:29.215974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:29.215974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:29.215974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:29.215974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:29.215974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:29.215974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:29.215974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:29.215974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:29.215974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:29.215974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:29.215974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:29.215974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:29.215974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:29.218739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:29.218739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:29.218739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:29.218739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:29.218739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:29.218739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:29.218739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:29.218739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:29.218739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:29.218739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:29.218739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:29.218739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:29.218739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:29.218739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:29.218739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:29.218739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:29.219610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:29.219610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:29.219610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:29.219610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:29.219610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:29.219610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:29.219610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:29.219610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:29.219610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:29.219610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:29.219610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:29.219610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:29.219610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 197/402] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:01:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:29.219610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d5186-2e2d-497d-bb87-bbe5da1deee6 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:29.220377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d5186-2e2d-497d-bb87-bbe5da1deee6 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:29.220377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d5186-2e2d-497d-bb87-bbe5da1deee6 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:29.227167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 198/403] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:29.227167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d5186-2e2d-497d-bb87-bbe5da1deee6 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:29.263704 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329a16b-4f69-4011-8b50-a6867179cc5c None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:29.281193 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:29.300391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7786b-3ad9-43cd-a2e1-1fd3cd60095a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:29.301297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7786b-3ad9-43cd-a2e1-1fd3cd60095a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:29.301584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7786b-3ad9-43cd-a2e1-1fd3cd60095a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:29.301864 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7786b-3ad9-43cd-a2e1-1fd3cd60095a None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:29.303074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7786b-3ad9-43cd-a2e1-1fd3cd60095a None admin] RBAC: Authorizing `identity:get_project(project_id=0c071ff9e8b04956814c07c7d5500549)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:29.304975 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7786b-3ad9-43cd-a2e1-1fd3cd60095a None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:29.311296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 206/404] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:29 2022] GET /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:29.312691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526ba54-ba28-486d-8144-c66f9f73790c None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:29.312984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526ba54-ba28-486d-8144-c66f9f73790c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:29.313265 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526ba54-ba28-486d-8144-c66f9f73790c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:29.330773 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-0526ba54-ba28-486d-8144-c66f9f73790c None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:29.331963 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0526ba54-ba28-486d-8144-c66f9f73790c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:29.340178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:29.345507 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d5186-2e2d-497d-bb87-bbe5da1deee6 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:29.383510 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae3812-5f76-42f8-ba57-5771190d808a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:29.384558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae3812-5f76-42f8-ba57-5771190d808a None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:29.385191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae3812-5f76-42f8-ba57-5771190d808a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:29.385681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae3812-5f76-42f8-ba57-5771190d808a None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:29.386704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae3812-5f76-42f8-ba57-5771190d808a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:29.387275 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae3812-5f76-42f8-ba57-5771190d808a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:29.388962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae3812-5f76-42f8-ba57-5771190d808a None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:29.402908 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 199/406] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:29.404078 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae3812-5f76-42f8-ba57-5771190d808a None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:29.409552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 207/406] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:29.410017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526ba54-ba28-486d-8144-c66f9f73790c None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:29.517241 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae3812-5f76-42f8-ba57-5771190d808a None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:29.535923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526ba54-ba28-486d-8144-c66f9f73790c None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:29.550821 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:29.555017 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd738b-89f3-42df-b9d0-d1744a3d9f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:29.558757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd738b-89f3-42df-b9d0-d1744a3d9f54 None admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:29.559273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd738b-89f3-42df-b9d0-d1744a3d9f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:29.559758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd738b-89f3-42df-b9d0-d1744a3d9f54 None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549/groups/f0cccdc1d7e64497ab7b3d11bd2360bd/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:29.562539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd738b-89f3-42df-b9d0-d1744a3d9f54 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c071ff9e8b04956814c07c7d5500549, group_id=f0cccdc1d7e64497ab7b3d11bd2360bd, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:29.564273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd738b-89f3-42df-b9d0-d1744a3d9f54 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:29.578753 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a2912-1773-4570-afe2-5507a8bc88ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:29.579633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a2912-1773-4570-afe2-5507a8bc88ad None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:29.579919 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a2912-1773-4570-afe2-5507a8bc88ad None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:29.580247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a2912-1773-4570-afe2-5507a8bc88ad None admin] PATH_INFO: `/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:29.582430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a2912-1773-4570-afe2-5507a8bc88ad None admin] RBAC: Authorizing `identity:get_group(group_id=f0cccdc1d7e64497ab7b3d11bd2360bd)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:29.583866 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a2912-1773-4570-afe2-5507a8bc88ad None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:29.585525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 208/407] 10.222.0.66 () {56 vars in 1180 bytes} [Thu May 26 21:01:29 2022] GET /identity/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:29.586286 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a2912-1773-4570-afe2-5507a8bc88ad None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:29.648920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 200/408] 10.222.0.66 () {58 vars in 1442 bytes} [Thu May 26 21:01:29 2022] PUT /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549/groups/f0cccdc1d7e64497ab7b3d11bd2360bd/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:01:29.649740 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd738b-89f3-42df-b9d0-d1744a3d9f54 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:29.710729 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:29.769735 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a2912-1773-4570-afe2-5507a8bc88ad None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:29.809054 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d639897-8bcf-4405-a73b-89804ab24a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:29.810716 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d639897-8bcf-4405-a73b-89804ab24a10 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:29.811768 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d639897-8bcf-4405-a73b-89804ab24a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:29.812318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d639897-8bcf-4405-a73b-89804ab24a10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:29.826230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d639897-8bcf-4405-a73b-89804ab24a10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:29.836306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-2d639897-8bcf-4405-a73b-89804ab24a10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:01:29.836306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:29.836306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:29.836306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:29.836306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:29.836306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:29.836306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:29.836306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:29.836306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:29.836306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:29.836306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:29.836306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:29.836306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:29.836306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:29.836306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:29.836306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:29.837273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:29.837273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:29.837273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:29.837273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:29.837273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:29.837273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:29.837273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:29.837273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:29.837273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:29.837273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:29.837273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:29.837273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:29.837273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:29.837273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:29.837273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:29.837273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:29.838069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:29.838069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:29.838069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:29.838069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:29.838069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:29.838069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:29.838069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:29.838069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:29.838069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:29.838069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:29.838069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:01:29.838069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:29.840984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 209/409] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:01:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:29.849882 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d639897-8bcf-4405-a73b-89804ab24a10 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:29.865445 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd738b-89f3-42df-b9d0-d1744a3d9f54 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:29.926184 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e6cb6-96c1-4c93-b604-5c3b12663cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:29.927639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e6cb6-96c1-4c93-b604-5c3b12663cec None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:29.928130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e6cb6-96c1-4c93-b604-5c3b12663cec None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:29.929642 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e6cb6-96c1-4c93-b604-5c3b12663cec None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:29.931203 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e6cb6-96c1-4c93-b604-5c3b12663cec None admin] RBAC: Authorizing `identity:get_project(project_id=0c071ff9e8b04956814c07c7d5500549)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:29.932919 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e6cb6-96c1-4c93-b604-5c3b12663cec None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:29.934861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 201/410] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:29 2022] GET /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:29.937156 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410820e0-0bd4-4631-bff7-ec2e5d76c1f1 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:29.937658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410820e0-0bd4-4631-bff7-ec2e5d76c1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:29.938156 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410820e0-0bd4-4631-bff7-ec2e5d76c1f1 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:29.940562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 202/411] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:29.941503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410820e0-0bd4-4631-bff7-ec2e5d76c1f1 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:29.946627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:30.010512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d639897-8bcf-4405-a73b-89804ab24a10 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:30.038774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:30.046684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df99ba9-38ed-42ff-ba23-7702e83dcfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:30.047452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df99ba9-38ed-42ff-ba23-7702e83dcfea None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:30.047640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df99ba9-38ed-42ff-ba23-7702e83dcfea None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:30.047982 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df99ba9-38ed-42ff-ba23-7702e83dcfea None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:30.048689 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df99ba9-38ed-42ff-ba23-7702e83dcfea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:30.048997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df99ba9-38ed-42ff-ba23-7702e83dcfea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:30.050593 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df99ba9-38ed-42ff-ba23-7702e83dcfea None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:30.051515 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410820e0-0bd4-4631-bff7-ec2e5d76c1f1 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:30.059772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 210/412] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:30.061912 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21359a-ec60-4bf9-9319-cfe8f729faa9 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:30.062198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21359a-ec60-4bf9-9319-cfe8f729faa9 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:30.062476 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21359a-ec60-4bf9-9319-cfe8f729faa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:30.081070 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-db21359a-ec60-4bf9-9319-cfe8f729faa9 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:30.082616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-db21359a-ec60-4bf9-9319-cfe8f729faa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:30.093576 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a619409-6489-40ed-8909-83142cc9ee6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:30.094842 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a619409-6489-40ed-8909-83142cc9ee6e None admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:30.095225 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a619409-6489-40ed-8909-83142cc9ee6e None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:30.095603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a619409-6489-40ed-8909-83142cc9ee6e None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549/groups/f0cccdc1d7e64497ab7b3d11bd2360bd/roles/d45da92733d441d7bfeeb10c762c6138` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:30.098067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a619409-6489-40ed-8909-83142cc9ee6e None admin] RBAC: Authorizing `identity:create_grant(project_id=0c071ff9e8b04956814c07c7d5500549, group_id=f0cccdc1d7e64497ab7b3d11bd2360bd, role_id=d45da92733d441d7bfeeb10c762c6138)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:30.099633 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a619409-6489-40ed-8909-83142cc9ee6e None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:30.160761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 211/413] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:30.160761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21359a-ec60-4bf9-9319-cfe8f729faa9 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:30.177538 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 203/414] 10.222.0.66 () {58 vars in 1442 bytes} [Thu May 26 21:01:29 2022] PUT /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549/groups/f0cccdc1d7e64497ab7b3d11bd2360bd/roles/d45da92733d441d7bfeeb10c762c6138 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:01:30.192207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a619409-6489-40ed-8909-83142cc9ee6e None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:30.210370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:30.291617 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21359a-ec60-4bf9-9319-cfe8f729faa9 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:30.343363 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679c9c5-350c-42e7-b855-5786ae7fb957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:30.344660 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679c9c5-350c-42e7-b855-5786ae7fb957 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:30.345172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679c9c5-350c-42e7-b855-5786ae7fb957 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:30.345657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679c9c5-350c-42e7-b855-5786ae7fb957 None admin] PATH_INFO: `/v3/groups/f6b3678731f54d6199df0fce069ccd9e` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:30.348348 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679c9c5-350c-42e7-b855-5786ae7fb957 None admin] RBAC: Authorizing `identity:get_group(group_id=f6b3678731f54d6199df0fce069ccd9e)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:30.350287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679c9c5-350c-42e7-b855-5786ae7fb957 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:30.353864 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 212/415] 10.222.0.66 () {56 vars in 1180 bytes} [Thu May 26 21:01:30 2022] GET /identity/v3/groups/f6b3678731f54d6199df0fce069ccd9e => generated 229 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:30.360260 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679c9c5-350c-42e7-b855-5786ae7fb957 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:30.444140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a619409-6489-40ed-8909-83142cc9ee6e None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:30.484704 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679c9c5-350c-42e7-b855-5786ae7fb957 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:30.486535 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:30.488415 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e1436-46d9-436b-9c83-7746d4d70fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:30.489387 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e1436-46d9-436b-9c83-7746d4d70fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:30.489770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e1436-46d9-436b-9c83-7746d4d70fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:30.490148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e1436-46d9-436b-9c83-7746d4d70fc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:30.501771 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e1436-46d9-436b-9c83-7746d4d70fc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:30.512178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-8b9e1436-46d9-436b-9c83-7746d4d70fc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:30.512178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:30.512178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:30.512178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:30.512178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:30.512178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:30.512178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:30.512178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:30.512178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:30.512178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:30.512178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:30.512178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:30.512178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:30.512178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:30.512178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:30.512178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:30.513131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:30.513131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:30.513131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:30.513131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:30.513131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:30.513131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:30.513131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:30.513131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:30.513131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:30.513131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:30.513131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:30.513131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:30.513131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:30.513131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:30.513131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:30.513131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:30.513963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:30.513963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:30.513963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:30.513963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:30.513963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:30.513963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:30.513963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:30.513963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:30.513963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:30.513963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:30.513963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:30.513963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:30.514597 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 204/416] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:30.520920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e1436-46d9-436b-9c83-7746d4d70fc9 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:30.530041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcf239-6782-4764-afed-29c11158fb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:30.531124 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcf239-6782-4764-afed-29c11158fb64 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:30.531408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcf239-6782-4764-afed-29c11158fb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:30.531688 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcf239-6782-4764-afed-29c11158fb64 None admin] PATH_INFO: `/v3/projects/7b6a47aff4f04a489b501a19f68711d3` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:30.532998 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dcf239-6782-4764-afed-29c11158fb64 None admin] RBAC: Authorizing `identity:get_project(project_id=7b6a47aff4f04a489b501a19f68711d3)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:30.534560 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dcf239-6782-4764-afed-29c11158fb64 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:30.540932 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 213/417] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:30 2022] GET /identity/v3/projects/7b6a47aff4f04a489b501a19f68711d3 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:30.541514 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:30.542370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcf239-6782-4764-afed-29c11158fb64 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:30.664332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e1436-46d9-436b-9c83-7746d4d70fc9 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:30.672126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcf239-6782-4764-afed-29c11158fb64 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:30.708015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b200cd-953f-4413-a8d3-f00db6860d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:30.708658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9970dd0-a881-4ed1-a0a9-78bbe2f8e292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:30.708782 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b200cd-953f-4413-a8d3-f00db6860d52 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:30.708972 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b200cd-953f-4413-a8d3-f00db6860d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:30.709242 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b200cd-953f-4413-a8d3-f00db6860d52 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:30.709543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9970dd0-a881-4ed1-a0a9-78bbe2f8e292 None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:30.709821 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9970dd0-a881-4ed1-a0a9-78bbe2f8e292 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:30.710045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b200cd-953f-4413-a8d3-f00db6860d52 None admin] RBAC: Adding query filter params (name=member) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:30.710155 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9970dd0-a881-4ed1-a0a9-78bbe2f8e292 None admin] PATH_INFO: `/v3/projects/7b6a47aff4f04a489b501a19f68711d3/groups/f6b3678731f54d6199df0fce069ccd9e/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:30.710353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b200cd-953f-4413-a8d3-f00db6860d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:30.711946 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b200cd-953f-4413-a8d3-f00db6860d52 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:30.712056 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9970dd0-a881-4ed1-a0a9-78bbe2f8e292 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b6a47aff4f04a489b501a19f68711d3, group_id=f6b3678731f54d6199df0fce069ccd9e, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:30.713809 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9970dd0-a881-4ed1-a0a9-78bbe2f8e292 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:30.721933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 205/418] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:01:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:30.723300 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed04255-9a52-43a8-aaab-d6ec34ab4eee None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:30.723574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed04255-9a52-43a8-aaab-d6ec34ab4eee None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:30.723850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed04255-9a52-43a8-aaab-d6ec34ab4eee None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:30.729121 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 206/419] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:30.729121 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed04255-9a52-43a8-aaab-d6ec34ab4eee None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:30.802867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:30.821981 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 214/420] 10.222.0.66 () {58 vars in 1442 bytes} [Thu May 26 21:01:30 2022] PUT /identity/v3/projects/7b6a47aff4f04a489b501a19f68711d3/groups/f6b3678731f54d6199df0fce069ccd9e/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:01:30.825467 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8ba6e-716d-4661-8cd2-7aa0849ef959 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:30.826300 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8ba6e-716d-4661-8cd2-7aa0849ef959 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:30.827119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8ba6e-716d-4661-8cd2-7aa0849ef959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:30.872607 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed04255-9a52-43a8-aaab-d6ec34ab4eee None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:30.883716 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-67b8ba6e-716d-4661-8cd2-7aa0849ef959 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:30.885304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-67b8ba6e-716d-4661-8cd2-7aa0849ef959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:30.935818 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:30.947146 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed708dc-b334-48fe-97f8-a78804e0b819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:30.950359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed708dc-b334-48fe-97f8-a78804e0b819 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:30.950359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed708dc-b334-48fe-97f8-a78804e0b819 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:30.950359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed708dc-b334-48fe-97f8-a78804e0b819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:31.043406 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 215/421] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:31.044734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed708dc-b334-48fe-97f8-a78804e0b819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:31.046384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed708dc-b334-48fe-97f8-a78804e0b819 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:31.081495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8ba6e-716d-4661-8cd2-7aa0849ef959 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:31.129435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:31.153372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 207/422] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:31.159831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed708dc-b334-48fe-97f8-a78804e0b819 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:31.192644 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8ba6e-716d-4661-8cd2-7aa0849ef959 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:31.230841 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef1aa0-f550-4c64-b9a9-535cb50dec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:31.231760 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef1aa0-f550-4c64-b9a9-535cb50dec10 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:31.232119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef1aa0-f550-4c64-b9a9-535cb50dec10 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:31.232470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef1aa0-f550-4c64-b9a9-535cb50dec10 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:31.243922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef1aa0-f550-4c64-b9a9-535cb50dec10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:31.252241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-13ef1aa0-f550-4c64-b9a9-535cb50dec10 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:31.252241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:31.252241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:31.252241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:31.252241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:31.252241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:31.252241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:31.252241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:31.252241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:31.252241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:31.252241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:31.252241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:31.252241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:31.252241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:31.252241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:31.252241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:31.253344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:31.253344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:31.253344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:31.253344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:31.253344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:31.253344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:31.253344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:31.253344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:31.253344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:31.253344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:31.253344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:31.253344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:31.253344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:31.253344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:31.253344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:31.253344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:31.254340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:31.254340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:31.254340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:31.254340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:31.254340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:31.254340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:31.254340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:31.254340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:31.254340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:31.254340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:31.254340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:31.254340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:31.260509 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 216/423] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:01:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:01:31.262228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef1aa0-f550-4c64-b9a9-535cb50dec10 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:31.271964 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed708dc-b334-48fe-97f8-a78804e0b819 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:31.307406 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:31.338196 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be162a5-f16e-4546-912b-72f10d722c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:31.339114 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be162a5-f16e-4546-912b-72f10d722c12 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:31.339396 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be162a5-f16e-4546-912b-72f10d722c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:31.339675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be162a5-f16e-4546-912b-72f10d722c12 None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:31.341272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be162a5-f16e-4546-912b-72f10d722c12 None admin] RBAC: Authorizing `identity:get_project(project_id=8e241471fdd8481c81049b886aa4ed5c)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:31.342791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be162a5-f16e-4546-912b-72f10d722c12 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:31.344819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 208/424] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:31 2022] GET /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:31.350036 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be162a5-f16e-4546-912b-72f10d722c12 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:31.397666 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:31.452988 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be162a5-f16e-4546-912b-72f10d722c12 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:31.470078 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef1aa0-f550-4c64-b9a9-535cb50dec10 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:31.488172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac0b17-1c8f-4818-b958-83207f36d25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:31.489426 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac0b17-1c8f-4818-b958-83207f36d25e None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:31.489927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac0b17-1c8f-4818-b958-83207f36d25e None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:31.490419 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac0b17-1c8f-4818-b958-83207f36d25e None admin] PATH_INFO: `/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:31.491785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac0b17-1c8f-4818-b958-83207f36d25e None admin] RBAC: Authorizing `identity:get_group(group_id=f0cccdc1d7e64497ab7b3d11bd2360bd)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:31.493442 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac0b17-1c8f-4818-b958-83207f36d25e None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:31.499144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 209/425] 10.222.0.66 () {56 vars in 1180 bytes} [Thu May 26 21:01:31 2022] GET /identity/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:31.502225 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac0b17-1c8f-4818-b958-83207f36d25e None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:31.526151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcd5d9-0b3b-4c77-801c-5649d4b9b35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:31.526825 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcd5d9-0b3b-4c77-801c-5649d4b9b35f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:31.527113 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcd5d9-0b3b-4c77-801c-5649d4b9b35f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:31.527388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcd5d9-0b3b-4c77-801c-5649d4b9b35f None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:31.528152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbcd5d9-0b3b-4c77-801c-5649d4b9b35f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:31.528598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbcd5d9-0b3b-4c77-801c-5649d4b9b35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:31.529995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbcd5d9-0b3b-4c77-801c-5649d4b9b35f None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:31.549315 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 217/426] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:31.553377 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcd5d9-0b3b-4c77-801c-5649d4b9b35f None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:31.674219 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac0b17-1c8f-4818-b958-83207f36d25e None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:31.685343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:31.691213 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:31.717328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1223f21-4e42-4664-a772-f2567890e466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:31.718191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1223f21-4e42-4664-a772-f2567890e466 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:31.718560 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1223f21-4e42-4664-a772-f2567890e466 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:31.718935 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1223f21-4e42-4664-a772-f2567890e466 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:31.719868 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1223f21-4e42-4664-a772-f2567890e466 None admin] RBAC: Adding query filter params (group.id=f0cccdc1d7e64497ab7b3d11bd2360bd, role.id=7cbf3c401d60412fbcae272fb8d191cc, scope.project.id=8e241471fdd8481c81049b886aa4ed5c) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:31.720278 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1223f21-4e42-4664-a772-f2567890e466 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:31.721935 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1223f21-4e42-4664-a772-f2567890e466 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:31.723848 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcd5d9-0b3b-4c77-801c-5649d4b9b35f None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:31.733260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 210/427] 10.222.0.66 () {56 vars in 1376 bytes} [Thu May 26 21:01:31 2022] GET /identity/v3/role_assignments?group.id=f0cccdc1d7e64497ab7b3d11bd2360bd&scope.project.id=8e241471fdd8481c81049b886aa4ed5c&role.id=7cbf3c401d60412fbcae272fb8d191cc => generated 611 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:31.786375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38132f20-39e3-4328-94c5-857a1c21a1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:31.787057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38132f20-39e3-4328-94c5-857a1c21a1db None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:31.787341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38132f20-39e3-4328-94c5-857a1c21a1db None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:31.787623 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38132f20-39e3-4328-94c5-857a1c21a1db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:31.885635 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38132f20-39e3-4328-94c5-857a1c21a1db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:31.887028 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38132f20-39e3-4328-94c5-857a1c21a1db None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:31.975968 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:31.996526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 218/428] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:32.002023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1223f21-4e42-4664-a772-f2567890e466 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:32.128011 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1223f21-4e42-4664-a772-f2567890e466 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:32.165616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d9d5d-8a59-4c54-8544-9325d05536c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:32.166408 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d9d5d-8a59-4c54-8544-9325d05536c8 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:32.166687 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d9d5d-8a59-4c54-8544-9325d05536c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:32.166961 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d9d5d-8a59-4c54-8544-9325d05536c8 None admin] PATH_INFO: `/v3/projects/8e241471fdd8481c81049b886aa4ed5c` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:32.168142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d9d5d-8a59-4c54-8544-9325d05536c8 None admin] RBAC: Authorizing `identity:get_project(project_id=8e241471fdd8481c81049b886aa4ed5c)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:32.169603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d9d5d-8a59-4c54-8544-9325d05536c8 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:32.175741 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 211/429] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:32 2022] GET /identity/v3/projects/8e241471fdd8481c81049b886aa4ed5c => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:32.177134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38132f20-39e3-4328-94c5-857a1c21a1db None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:32.280923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38132f20-39e3-4328-94c5-857a1c21a1db None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:32.295902 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c8cb5-4b4e-49b5-b2f6-66458e09c9cb None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:32.296327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c8cb5-4b4e-49b5-b2f6-66458e09c9cb None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:32.296732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c8cb5-4b4e-49b5-b2f6-66458e09c9cb None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:32.299675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 212/430] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:01:32.313344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9598464-2c01-41a2-96c1-9ca735835c5f None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:32.313640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9598464-2c01-41a2-96c1-9ca735835c5f None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:32.313925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9598464-2c01-41a2-96c1-9ca735835c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:32.334483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ecfc3-1425-4ebb-9cac-cd4c5025f442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:32.335598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ecfc3-1425-4ebb-9cac-cd4c5025f442 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:32.336049 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ecfc3-1425-4ebb-9cac-cd4c5025f442 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:32.336521 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ecfc3-1425-4ebb-9cac-cd4c5025f442 None admin] PATH_INFO: `/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:32.337192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-d9598464-2c01-41a2-96c1-9ca735835c5f None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:32.337937 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ecfc3-1425-4ebb-9cac-cd4c5025f442 None admin] RBAC: Authorizing `identity:get_group(group_id=f0cccdc1d7e64497ab7b3d11bd2360bd)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:32.338441 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d9598464-2c01-41a2-96c1-9ca735835c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:32.339386 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ecfc3-1425-4ebb-9cac-cd4c5025f442 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:32.341066 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 219/431] 10.222.0.66 () {56 vars in 1180 bytes} [Thu May 26 21:01:32 2022] GET /identity/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:32.347206 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ecfc3-1425-4ebb-9cac-cd4c5025f442 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:32.396294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:32.404980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:32.446090 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 213/432] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:01:32.455892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ecfc3-1425-4ebb-9cac-cd4c5025f442 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:32.475603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9598464-2c01-41a2-96c1-9ca735835c5f None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:32.495803 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e226fb-87f5-4a77-9ffa-35299b3936b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:32.496460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e226fb-87f5-4a77-9ffa-35299b3936b8 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:32.496774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e226fb-87f5-4a77-9ffa-35299b3936b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:32.497047 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e226fb-87f5-4a77-9ffa-35299b3936b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:32.497882 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e226fb-87f5-4a77-9ffa-35299b3936b8 None admin] RBAC: Adding query filter params (group.id=f0cccdc1d7e64497ab7b3d11bd2360bd, role.id=d45da92733d441d7bfeeb10c762c6138, scope.project.id=8e241471fdd8481c81049b886aa4ed5c) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:32.498192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e226fb-87f5-4a77-9ffa-35299b3936b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:32.500181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e226fb-87f5-4a77-9ffa-35299b3936b8 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:32.511841 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 220/433] 10.222.0.66 () {56 vars in 1376 bytes} [Thu May 26 21:01:32 2022] GET /identity/v3/role_assignments?group.id=f0cccdc1d7e64497ab7b3d11bd2360bd&scope.project.id=8e241471fdd8481c81049b886aa4ed5c&role.id=d45da92733d441d7bfeeb10c762c6138 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:32.625126 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9598464-2c01-41a2-96c1-9ca735835c5f None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:32.663849 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14626c1-5733-463d-8db0-4d743aad9df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:32.665077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14626c1-5733-463d-8db0-4d743aad9df5 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:32.665591 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14626c1-5733-463d-8db0-4d743aad9df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:32.666070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14626c1-5733-463d-8db0-4d743aad9df5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:32.679379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14626c1-5733-463d-8db0-4d743aad9df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:32.689025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-d14626c1-5733-463d-8db0-4d743aad9df5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:32.689025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:32.689025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:32.689025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:32.689025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:32.689025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:32.689025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:32.689025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:32.689025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:32.689025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:32.689025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:32.689025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:32.689025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:32.689025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:32.689025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:32.689025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:32.689974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:32.689974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:32.689974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:32.689974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:32.689974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:32.689974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:32.689974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:32.689974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:32.689974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:32.689974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:32.689974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:32.689974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:32.689974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:32.689974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:32.689974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:32.689974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:32.690841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:32.690841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:32.690841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:32.690841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:32.690841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:32.690841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:32.690841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:32.690841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:32.690841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:32.690841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:32.690841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 21:01:32.690841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:32.693699 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 214/434] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:01:32.700011 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e226fb-87f5-4a77-9ffa-35299b3936b8 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:32.831106 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e226fb-87f5-4a77-9ffa-35299b3936b8 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:32.847453 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:32.868784 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e4982-9541-4451-bcaf-258cc67eb00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:32.869456 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e4982-9541-4451-bcaf-258cc67eb00b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:32.869735 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e4982-9541-4451-bcaf-258cc67eb00b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:32.880361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e4982-9541-4451-bcaf-258cc67eb00b None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:32.880361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e4982-9541-4451-bcaf-258cc67eb00b None admin] RBAC: Adding query filter params (name=member) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:32.880361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e4982-9541-4451-bcaf-258cc67eb00b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:32.880361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e4982-9541-4451-bcaf-258cc67eb00b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:32.881730 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 221/435] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:01:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:32.887358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14626c1-5733-463d-8db0-4d743aad9df5 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:32.921289 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:32.990345 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c1ad7-0a17-46e6-bb2d-d18ad4e12323 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:32.990632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c1ad7-0a17-46e6-bb2d-d18ad4e12323 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:32.990901 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c1ad7-0a17-46e6-bb2d-d18ad4e12323 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:32.993737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 222/436] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:01:32.997645 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14626c1-5733-463d-8db0-4d743aad9df5 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:32.999241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e61c2-929e-4dec-8827-3abfba9f63cb None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:32.999626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e61c2-929e-4dec-8827-3abfba9f63cb None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:33.000006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e61c2-929e-4dec-8827-3abfba9f63cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:33.022060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-498e61c2-929e-4dec-8827-3abfba9f63cb None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:33.023261 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-498e61c2-929e-4dec-8827-3abfba9f63cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:33.040847 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1b725-6e1c-4bbb-8cb6-f7ff1a7377b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:33.041503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1b725-6e1c-4bbb-8cb6-f7ff1a7377b8 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:33.041780 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1b725-6e1c-4bbb-8cb6-f7ff1a7377b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:33.042050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1b725-6e1c-4bbb-8cb6-f7ff1a7377b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:33.102989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 223/437] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:01:33.120050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1b725-6e1c-4bbb-8cb6-f7ff1a7377b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:33.121565 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1b725-6e1c-4bbb-8cb6-f7ff1a7377b8 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:33.126140 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e61c2-929e-4dec-8827-3abfba9f63cb None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:33.152863 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:33.230680 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e61c2-929e-4dec-8827-3abfba9f63cb None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:33.233747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 215/438] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 21:01:33.239280 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1b725-6e1c-4bbb-8cb6-f7ff1a7377b8 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:33.243962 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:33.270306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab0613-8162-49e6-bda4-ae95b7e08186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:33.271117 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab0613-8162-49e6-bda4-ae95b7e08186 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:33.271407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab0613-8162-49e6-bda4-ae95b7e08186 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:33.271684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab0613-8162-49e6-bda4-ae95b7e08186 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:33.283694 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab0613-8162-49e6-bda4-ae95b7e08186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:33.291780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-08ab0613-8162-49e6-bda4-ae95b7e08186 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:33.291780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:33.291780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:33.291780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:33.291780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:33.291780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:33.291780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:33.291780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:33.291780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:33.291780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:33.291780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:33.291780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:33.291780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:33.291780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:33.291780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:33.291780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:33.292685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:33.292685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:33.292685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:33.292685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:33.292685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:33.292685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:33.292685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:33.292685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:33.292685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:33.292685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:33.292685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:33.292685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:33.292685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:33.292685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:33.292685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:33.292685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:33.293612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:33.293612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:33.293612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:33.293612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:33.293612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:33.293612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:33.293612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:33.293612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:33.293612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:33.293612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:33.293612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:33.293612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:33.293612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 224/439] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:01:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:01:33.298814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab0613-8162-49e6-bda4-ae95b7e08186 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:33.351535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1b725-6e1c-4bbb-8cb6-f7ff1a7377b8 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:33.382484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:33.388418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f2062-caa5-4b03-9be5-97ee04671dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:33.389952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f2062-caa5-4b03-9be5-97ee04671dee None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:33.390231 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f2062-caa5-4b03-9be5-97ee04671dee None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:33.390498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f2062-caa5-4b03-9be5-97ee04671dee None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:33.391743 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f2062-caa5-4b03-9be5-97ee04671dee None admin] RBAC: Authorizing `identity:get_project(project_id=0c071ff9e8b04956814c07c7d5500549)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:33.393445 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f2062-caa5-4b03-9be5-97ee04671dee None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:33.399540 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 216/440] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:33 2022] GET /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:33.400531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f2062-caa5-4b03-9be5-97ee04671dee None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:33.413065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab0613-8162-49e6-bda4-ae95b7e08186 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:33.446843 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e391e-2ff8-40a0-a796-3318ce879a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:33.447518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e391e-2ff8-40a0-a796-3318ce879a95 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:33.447807 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e391e-2ff8-40a0-a796-3318ce879a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:33.448087 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e391e-2ff8-40a0-a796-3318ce879a95 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:33.448872 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e391e-2ff8-40a0-a796-3318ce879a95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:33.449186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e391e-2ff8-40a0-a796-3318ce879a95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:33.450562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e391e-2ff8-40a0-a796-3318ce879a95 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:33.459326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 225/441] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:33.464541 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e391e-2ff8-40a0-a796-3318ce879a95 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:33.492814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:33.506703 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f2062-caa5-4b03-9be5-97ee04671dee None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:33.539437 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae1df9-af4e-4441-93ad-c7f9b78f5a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:33.540284 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae1df9-af4e-4441-93ad-c7f9b78f5a94 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:33.540562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae1df9-af4e-4441-93ad-c7f9b78f5a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:33.540929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae1df9-af4e-4441-93ad-c7f9b78f5a94 None admin] PATH_INFO: `/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:33.542107 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae1df9-af4e-4441-93ad-c7f9b78f5a94 None admin] RBAC: Authorizing `identity:get_group(group_id=f0cccdc1d7e64497ab7b3d11bd2360bd)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:33.543564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae1df9-af4e-4441-93ad-c7f9b78f5a94 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:33.545240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 217/442] 10.222.0.66 () {56 vars in 1180 bytes} [Thu May 26 21:01:33 2022] GET /identity/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:33.546469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcaebf-1a18-4575-bedf-a5416bd4393b None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:33.546829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcaebf-1a18-4575-bedf-a5416bd4393b None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:33.547081 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcaebf-1a18-4575-bedf-a5416bd4393b None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:33.548424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 218/443] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:33.550918 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcaebf-1a18-4575-bedf-a5416bd4393b None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:33.569062 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e391e-2ff8-40a0-a796-3318ce879a95 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:33.603459 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96f2e3-0e99-4504-b8ff-e880eeee6fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:33.604109 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96f2e3-0e99-4504-b8ff-e880eeee6fae None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:33.604401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96f2e3-0e99-4504-b8ff-e880eeee6fae None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:33.604705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96f2e3-0e99-4504-b8ff-e880eeee6fae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:33.616459 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:33.651794 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcaebf-1a18-4575-bedf-a5416bd4393b None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:33.671454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96f2e3-0e99-4504-b8ff-e880eeee6fae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:33.672940 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96f2e3-0e99-4504-b8ff-e880eeee6fae None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:33.685613 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf5496-1eda-4979-b4f4-4dd46ab57497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:33.686845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf5496-1eda-4979-b4f4-4dd46ab57497 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:33.687124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf5496-1eda-4979-b4f4-4dd46ab57497 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:33.687393 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf5496-1eda-4979-b4f4-4dd46ab57497 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:33.688228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf5496-1eda-4979-b4f4-4dd46ab57497 None admin] RBAC: Adding query filter params (group.id=f0cccdc1d7e64497ab7b3d11bd2360bd, role.id=7cbf3c401d60412fbcae272fb8d191cc, scope.project.id=0c071ff9e8b04956814c07c7d5500549) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:33.688536 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf5496-1eda-4979-b4f4-4dd46ab57497 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:33.689996 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf5496-1eda-4979-b4f4-4dd46ab57497 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:33.695697 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 219/444] 10.222.0.66 () {56 vars in 1376 bytes} [Thu May 26 21:01:33 2022] GET /identity/v3/role_assignments?group.id=f0cccdc1d7e64497ab7b3d11bd2360bd&scope.project.id=0c071ff9e8b04956814c07c7d5500549&role.id=7cbf3c401d60412fbcae272fb8d191cc => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:33.696885 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b43aa-10dd-4223-9b2a-bc265a5298e9 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:33.697168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b43aa-10dd-4223-9b2a-bc265a5298e9 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:33.697444 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b43aa-10dd-4223-9b2a-bc265a5298e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:33.709541 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:33.716418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-175b43aa-10dd-4223-9b2a-bc265a5298e9 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:33.717730 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-175b43aa-10dd-4223-9b2a-bc265a5298e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:33.804655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 220/445] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:33.804830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 226/446] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 21:01:33.805889 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b43aa-10dd-4223-9b2a-bc265a5298e9 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:33.827705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96f2e3-0e99-4504-b8ff-e880eeee6fae None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:33.874475 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:33.927626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b43aa-10dd-4223-9b2a-bc265a5298e9 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:33.940566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96f2e3-0e99-4504-b8ff-e880eeee6fae None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:33.966057 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6dfba-667b-4488-91ed-56ea14a2a37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:33.966916 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6dfba-667b-4488-91ed-56ea14a2a37e None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:33.967197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6dfba-667b-4488-91ed-56ea14a2a37e None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:33.967474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6dfba-667b-4488-91ed-56ea14a2a37e None admin] PATH_INFO: `/v3/projects/0c071ff9e8b04956814c07c7d5500549` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:33.969504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6dfba-667b-4488-91ed-56ea14a2a37e None admin] RBAC: Authorizing `identity:get_project(project_id=0c071ff9e8b04956814c07c7d5500549)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:33.970261 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:33.971898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6dfba-667b-4488-91ed-56ea14a2a37e None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:33.973842 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 221/447] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:33 2022] GET /identity/v3/projects/0c071ff9e8b04956814c07c7d5500549 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:33.979326 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6dfba-667b-4488-91ed-56ea14a2a37e None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:33.979784 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc589a-77cc-4fe6-a665-4f7c9b73f563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:33.980611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc589a-77cc-4fe6-a665-4f7c9b73f563 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:33.980924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc589a-77cc-4fe6-a665-4f7c9b73f563 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:33.981832 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc589a-77cc-4fe6-a665-4f7c9b73f563 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:33.997642 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc589a-77cc-4fe6-a665-4f7c9b73f563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:34.005255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-27dc589a-77cc-4fe6-a665-4f7c9b73f563 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:01:34.005255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:34.005255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:34.005255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:34.005255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:34.005255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:34.005255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:34.005255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:34.005255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:34.005255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:34.005255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:34.005255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:34.005255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:34.005255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:34.005255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:34.005255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:34.006408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:34.006408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:34.006408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:34.006408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:34.006408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:34.006408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:34.006408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:34.006408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:34.006408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:34.006408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:34.006408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:34.006408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:34.006408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:34.006408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:34.006408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:34.006408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:34.007294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:34.007294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:34.007294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:34.007294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:34.007294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:34.007294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:34.007294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:34.007294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:34.007294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:34.007294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:34.007294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:01:34.007294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:34.007294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 227/448] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:01:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:34.012762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc589a-77cc-4fe6-a665-4f7c9b73f563 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:34.103510 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6dfba-667b-4488-91ed-56ea14a2a37e None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:34.127512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc589a-77cc-4fe6-a665-4f7c9b73f563 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:34.129371 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:34.136890 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551e76d-c583-4364-80ab-470597ed359f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:34.137749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551e76d-c583-4364-80ab-470597ed359f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:34.138027 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551e76d-c583-4364-80ab-470597ed359f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:34.143839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551e76d-c583-4364-80ab-470597ed359f None admin] PATH_INFO: `/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:34.143839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551e76d-c583-4364-80ab-470597ed359f None admin] RBAC: Authorizing `identity:get_group(group_id=f0cccdc1d7e64497ab7b3d11bd2360bd)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:34.143839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551e76d-c583-4364-80ab-470597ed359f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:34.143839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 222/449] 10.222.0.66 () {56 vars in 1180 bytes} [Thu May 26 21:01:33 2022] GET /identity/v3/groups/f0cccdc1d7e64497ab7b3d11bd2360bd => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:34.148270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551e76d-c583-4364-80ab-470597ed359f None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:34.161872 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d78681-1568-4b6b-8a6f-4e4d34fa9dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:34.162542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d78681-1568-4b6b-8a6f-4e4d34fa9dfc None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:34.162832 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d78681-1568-4b6b-8a6f-4e4d34fa9dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:34.163111 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d78681-1568-4b6b-8a6f-4e4d34fa9dfc None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:34.163859 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d78681-1568-4b6b-8a6f-4e4d34fa9dfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:34.164165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d78681-1568-4b6b-8a6f-4e4d34fa9dfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:34.165555 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d78681-1568-4b6b-8a6f-4e4d34fa9dfc None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:34.174259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 228/450] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:34.179516 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d78681-1568-4b6b-8a6f-4e4d34fa9dfc None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:34.228765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:34.247677 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551e76d-c583-4364-80ab-470597ed359f None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:34.277909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d78681-1568-4b6b-8a6f-4e4d34fa9dfc None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:34.280530 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f20fed-d0bc-4fa4-bcf9-f0eac7a98ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:34.281237 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f20fed-d0bc-4fa4-bcf9-f0eac7a98ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:34.281516 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f20fed-d0bc-4fa4-bcf9-f0eac7a98ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:34.281795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f20fed-d0bc-4fa4-bcf9-f0eac7a98ae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:34.282640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f20fed-d0bc-4fa4-bcf9-f0eac7a98ae2 None admin] RBAC: Adding query filter params (group.id=f0cccdc1d7e64497ab7b3d11bd2360bd, role.id=d45da92733d441d7bfeeb10c762c6138, scope.project.id=0c071ff9e8b04956814c07c7d5500549) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:34.282953 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f20fed-d0bc-4fa4-bcf9-f0eac7a98ae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:34.284425 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f20fed-d0bc-4fa4-bcf9-f0eac7a98ae2 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:34.290919 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 223/451] 10.222.0.66 () {56 vars in 1376 bytes} [Thu May 26 21:01:34 2022] GET /identity/v3/role_assignments?group.id=f0cccdc1d7e64497ab7b3d11bd2360bd&scope.project.id=0c071ff9e8b04956814c07c7d5500549&role.id=d45da92733d441d7bfeeb10c762c6138 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:34.315495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870706c-2761-46ba-a99d-5786a13defd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:34.316172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870706c-2761-46ba-a99d-5786a13defd1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:34.316458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870706c-2761-46ba-a99d-5786a13defd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:34.316773 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870706c-2761-46ba-a99d-5786a13defd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:34.389299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870706c-2761-46ba-a99d-5786a13defd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:34.390701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870706c-2761-46ba-a99d-5786a13defd1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:34.443187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:34.499122 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 229/452] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 21:01:34.504562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f20fed-d0bc-4fa4-bcf9-f0eac7a98ae2 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:34.565318 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:34.610123 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f20fed-d0bc-4fa4-bcf9-f0eac7a98ae2 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:34.643030 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e352c72-9f18-406d-807b-161bc599e78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:34.643813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e352c72-9f18-406d-807b-161bc599e78c None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:34.644088 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e352c72-9f18-406d-807b-161bc599e78c None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:34.644358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e352c72-9f18-406d-807b-161bc599e78c None admin] PATH_INFO: `/v3/projects/7b6a47aff4f04a489b501a19f68711d3` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:34.645607 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e352c72-9f18-406d-807b-161bc599e78c None admin] RBAC: Authorizing `identity:get_project(project_id=7b6a47aff4f04a489b501a19f68711d3)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:34.647040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e352c72-9f18-406d-807b-161bc599e78c None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:34.648730 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 224/453] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:01:34 2022] GET /identity/v3/projects/7b6a47aff4f04a489b501a19f68711d3 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:34.654252 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870706c-2761-46ba-a99d-5786a13defd1 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:34.751078 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870706c-2761-46ba-a99d-5786a13defd1 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:34.783459 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45ac68-2589-4be7-abf2-d2a4c78804af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:34.784298 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45ac68-2589-4be7-abf2-d2a4c78804af None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:34.784573 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45ac68-2589-4be7-abf2-d2a4c78804af None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:34.784868 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45ac68-2589-4be7-abf2-d2a4c78804af None admin] PATH_INFO: `/v3/groups/f6b3678731f54d6199df0fce069ccd9e` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:34.786010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45ac68-2589-4be7-abf2-d2a4c78804af None admin] RBAC: Authorizing `identity:get_group(group_id=f6b3678731f54d6199df0fce069ccd9e)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:34.787428 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45ac68-2589-4be7-abf2-d2a4c78804af None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:34.789038 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 230/454] 10.222.0.66 () {56 vars in 1180 bytes} [Thu May 26 21:01:34 2022] GET /identity/v3/groups/f6b3678731f54d6199df0fce069ccd9e => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:34.794796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e352c72-9f18-406d-807b-161bc599e78c None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:34.889745 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e352c72-9f18-406d-807b-161bc599e78c None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:34.914849 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:34.922130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4426a7-ea6f-4263-8132-797206568ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:34.922782 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4426a7-ea6f-4263-8132-797206568ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:34.923062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4426a7-ea6f-4263-8132-797206568ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:34.923341 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4426a7-ea6f-4263-8132-797206568ae3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:34.927440 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4426a7-ea6f-4263-8132-797206568ae3 None admin] RBAC: Adding query filter params (group.id=f6b3678731f54d6199df0fce069ccd9e, role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.project.id=7b6a47aff4f04a489b501a19f68711d3) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:34.927440 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4426a7-ea6f-4263-8132-797206568ae3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:34.927440 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4426a7-ea6f-4263-8132-797206568ae3 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:34.931685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 225/455] 10.222.0.66 () {56 vars in 1376 bytes} [Thu May 26 21:01:34 2022] GET /identity/v3/role_assignments?group.id=f6b3678731f54d6199df0fce069ccd9e&scope.project.id=7b6a47aff4f04a489b501a19f68711d3&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:37.692559 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec07bb-7def-4a8e-a4fe-e4068b1352ea None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:37.693436 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec07bb-7def-4a8e-a4fe-e4068b1352ea None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:37.693863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec07bb-7def-4a8e-a4fe-e4068b1352ea None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:37.695620 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 231/456] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:37.705376 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44196757-54b2-402b-bb49-8ba8f1fd3388 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:37.705870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44196757-54b2-402b-bb49-8ba8f1fd3388 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:37.706073 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44196757-54b2-402b-bb49-8ba8f1fd3388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:37.738070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-44196757-54b2-402b-bb49-8ba8f1fd3388 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:37.739544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-44196757-54b2-402b-bb49-8ba8f1fd3388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:37.770877 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691ee3b-9bea-4994-b60f-33d1593a3513 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:37.771501 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691ee3b-9bea-4994-b60f-33d1593a3513 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:37.771979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691ee3b-9bea-4994-b60f-33d1593a3513 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:37.773890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 232/457] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:37.779900 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b3fb9-2f1a-4023-8ac2-fda45165a7fa None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:37.780488 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b3fb9-2f1a-4023-8ac2-fda45165a7fa None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:37.781030 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b3fb9-2f1a-4023-8ac2-fda45165a7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:37.817953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-1a0b3fb9-2f1a-4023-8ac2-fda45165a7fa None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:37.819090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1a0b3fb9-2f1a-4023-8ac2-fda45165a7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:37.844692 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:37.846091 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 226/458] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:01:37.871332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44196757-54b2-402b-bb49-8ba8f1fd3388 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:37.932227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 233/459] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:01:37.970204 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b3fb9-2f1a-4023-8ac2-fda45165a7fa None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:38.011558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44196757-54b2-402b-bb49-8ba8f1fd3388 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:38.037589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:38.049954 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb906c-68a0-49dd-b914-0cdd81535677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:38.057077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb906c-68a0-49dd-b914-0cdd81535677 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:38.057077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb906c-68a0-49dd-b914-0cdd81535677 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:38.057077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb906c-68a0-49dd-b914-0cdd81535677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:38.062898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb906c-68a0-49dd-b914-0cdd81535677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:38.064380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb906c-68a0-49dd-b914-0cdd81535677 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:38.081098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b3fb9-2f1a-4023-8ac2-fda45165a7fa None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:38.086923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-aafb906c-68a0-49dd-b914-0cdd81535677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:38.086923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:38.086923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:38.086923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:38.086923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:38.086923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:38.086923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:38.086923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:38.086923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:38.086923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:38.086923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:38.086923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:38.086923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:38.086923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:38.086923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:38.087866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:38.087866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:38.087866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:38.087866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:38.087866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:38.087866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:38.087866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:38.087866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:38.087866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:38.087866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:38.087866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:38.087866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:38.087866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:38.087866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:38.087866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:38.087866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:38.087866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:38.088904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:38.088904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:38.088904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:38.088904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:38.094392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 227/460] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:01:38.096739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa0409-c6e3-4448-9cad-8d67ff4346e5 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:38.097596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa0409-c6e3-4448-9cad-8d67ff4346e5 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:38.098315 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa0409-c6e3-4448-9cad-8d67ff4346e5 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:38.102235 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 228/461] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:38.104251 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa0409-c6e3-4448-9cad-8d67ff4346e5 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:38.126311 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980c1b4-bd78-42c7-a41f-ac111909384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:38.127109 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980c1b4-bd78-42c7-a41f-ac111909384c None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:38.127558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980c1b4-bd78-42c7-a41f-ac111909384c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:38.127979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980c1b4-bd78-42c7-a41f-ac111909384c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:38.139398 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980c1b4-bd78-42c7-a41f-ac111909384c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:38.141165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980c1b4-bd78-42c7-a41f-ac111909384c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:38.160553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-4980c1b4-bd78-42c7-a41f-ac111909384c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:38.160553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:38.160553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:38.160553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:38.160553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:38.160553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:38.160553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:38.160553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:38.160553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:38.160553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:38.160553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:38.160553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:38.160553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:38.160553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:38.160553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:38.161652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:38.161652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:38.161652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:38.161652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:38.161652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:38.161652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:38.161652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:38.161652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:38.161652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:38.161652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:38.161652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:38.161652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:38.161652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:38.161652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:38.161652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:38.161652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:38.161652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:38.162800 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:38.162800 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:38.162800 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:38.162800 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:38.164685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 234/462] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:01:38.166121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ffd87-0541-4baa-b778-c0e3101e5a73 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:38.166560 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ffd87-0541-4baa-b778-c0e3101e5a73 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:38.166983 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ffd87-0541-4baa-b778-c0e3101e5a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:38.172817 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:38.188233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-502ffd87-0541-4baa-b778-c0e3101e5a73 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:38.191401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-502ffd87-0541-4baa-b778-c0e3101e5a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:38.233328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa0409-c6e3-4448-9cad-8d67ff4346e5 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:38.271578 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 235/463] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:38.272838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ffd87-0541-4baa-b778-c0e3101e5a73 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:38.285630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1aa7a-4ffd-4bb1-9986-b68cad782f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:38.286904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1aa7a-4ffd-4bb1-9986-b68cad782f54 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:38.287605 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1aa7a-4ffd-4bb1-9986-b68cad782f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:38.288037 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1aa7a-4ffd-4bb1-9986-b68cad782f54 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:38.288942 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1aa7a-4ffd-4bb1-9986-b68cad782f54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:38.289553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1aa7a-4ffd-4bb1-9986-b68cad782f54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:38.291774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1aa7a-4ffd-4bb1-9986-b68cad782f54 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:38.305245 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 229/464] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:38.307749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c49a5f-2406-41bf-a4d6-376d85922a8d None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:38.308171 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c49a5f-2406-41bf-a4d6-376d85922a8d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:38.308344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c49a5f-2406-41bf-a4d6-376d85922a8d None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:38.310157 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 230/465] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:38.311428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c49a5f-2406-41bf-a4d6-376d85922a8d None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:38.349415 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:38.397054 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ffd87-0541-4baa-b778-c0e3101e5a73 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:38.428863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:38.434168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c49a5f-2406-41bf-a4d6-376d85922a8d None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:38.434960 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cfd2f-01cb-44bf-967d-f7febc271c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:38.436192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cfd2f-01cb-44bf-967d-f7febc271c0f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:38.436525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cfd2f-01cb-44bf-967d-f7febc271c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:38.436912 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cfd2f-01cb-44bf-967d-f7febc271c0f None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:38.437700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cfd2f-01cb-44bf-967d-f7febc271c0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:38.438009 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cfd2f-01cb-44bf-967d-f7febc271c0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:38.442043 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cfd2f-01cb-44bf-967d-f7febc271c0f None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:38.458000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 236/466] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:38.458663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cfd2f-01cb-44bf-967d-f7febc271c0f None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:38.476461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd905f-ff0e-4df4-a366-d8fc91a7cf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:38.477498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd905f-ff0e-4df4-a366-d8fc91a7cf84 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:38.477781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd905f-ff0e-4df4-a366-d8fc91a7cf84 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:38.478337 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd905f-ff0e-4df4-a366-d8fc91a7cf84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:38.489699 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd905f-ff0e-4df4-a366-d8fc91a7cf84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:38.491182 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd905f-ff0e-4df4-a366-d8fc91a7cf84 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:38.509569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-42bd905f-ff0e-4df4-a366-d8fc91a7cf84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:38.509569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:38.509569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:38.509569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:38.509569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:38.509569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:38.509569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:38.509569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:38.509569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:38.509569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:38.509569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:38.509569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:38.509569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:38.509569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:38.509569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:38.510457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:38.510457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:38.510457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:38.510457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:38.510457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:38.510457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:38.510457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:38.510457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:38.510457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:38.510457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:38.510457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:38.510457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:38.510457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:38.510457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:38.510457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:38.510457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:38.510457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:38.511286 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:38.511286 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:38.511286 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:38.511286 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:38.511286 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 231/467] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:38.512201 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72aff0-8e1e-4b94-93bc-f22a3215963a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:38.512313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72aff0-8e1e-4b94-93bc-f22a3215963a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:38.512524 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72aff0-8e1e-4b94-93bc-f22a3215963a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:38.530423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-8e72aff0-8e1e-4b94-93bc-f22a3215963a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:38.531616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-8e72aff0-8e1e-4b94-93bc-f22a3215963a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:38.572710 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cfd2f-01cb-44bf-967d-f7febc271c0f None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:38.610307 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 232/468] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:38.611097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72aff0-8e1e-4b94-93bc-f22a3215963a None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:38.621392 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4f6a8-363a-46da-8c94-9930449eb07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:38.622644 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4f6a8-363a-46da-8c94-9930449eb07c None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:38.623405 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4f6a8-363a-46da-8c94-9930449eb07c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:38.623871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4f6a8-363a-46da-8c94-9930449eb07c None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:38.625074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4f6a8-363a-46da-8c94-9930449eb07c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:38.627217 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4f6a8-363a-46da-8c94-9930449eb07c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:38.635936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:38.702742 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 237/469] 10.222.0.66 () {60 vars in 1132 bytes} [Thu May 26 21:01:38 2022] POST /identity/v3/users => generated 248 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:01:38.703589 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4f6a8-363a-46da-8c94-9930449eb07c None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:38.721414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72aff0-8e1e-4b94-93bc-f22a3215963a None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:38.769184 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee8f7c-681b-4097-85cd-b4f4d45fcc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:38.769943 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee8f7c-681b-4097-85cd-b4f4d45fcc40 None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:38.770229 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee8f7c-681b-4097-85cd-b4f4d45fcc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:38.770505 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee8f7c-681b-4097-85cd-b4f4d45fcc40 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:38.771911 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee8f7c-681b-4097-85cd-b4f4d45fcc40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:38.773432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee8f7c-681b-4097-85cd-b4f4d45fcc40 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:38.780118 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:38.846167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4f6a8-363a-46da-8c94-9930449eb07c None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:38.855099 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 233/470] 10.222.0.66 () {60 vars in 1132 bytes} [Thu May 26 21:01:38 2022] POST /identity/v3/users => generated 248 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:01:38.857113 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee8f7c-681b-4097-85cd-b4f4d45fcc40 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:38.913630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a07bc-2a54-4e8a-bda4-ad5f7fb60bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:38.914292 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a07bc-2a54-4e8a-bda4-ad5f7fb60bac None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:38.914581 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a07bc-2a54-4e8a-bda4-ad5f7fb60bac None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:38.914920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a07bc-2a54-4e8a-bda4-ad5f7fb60bac None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:38.915684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a07bc-2a54-4e8a-bda4-ad5f7fb60bac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:38.915997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a07bc-2a54-4e8a-bda4-ad5f7fb60bac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:38.917596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a07bc-2a54-4e8a-bda4-ad5f7fb60bac None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:38.933273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 238/471] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:38.940167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a07bc-2a54-4e8a-bda4-ad5f7fb60bac None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:38.971887 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:39.006324 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee8f7c-681b-4097-85cd-b4f4d45fcc40 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:39.051741 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a8c6b-e1c4-4607-943f-cc6a52ad85ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:39.052567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a8c6b-e1c4-4607-943f-cc6a52ad85ca None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:39.053135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a8c6b-e1c4-4607-943f-cc6a52ad85ca None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:39.053431 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a8c6b-e1c4-4607-943f-cc6a52ad85ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:39.069805 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a8c6b-e1c4-4607-943f-cc6a52ad85ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:39.071726 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a8c6b-e1c4-4607-943f-cc6a52ad85ca None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:39.077601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a07bc-2a54-4e8a-bda4-ad5f7fb60bac None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:39.088009 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:39.092652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-a15a8c6b-e1c4-4607-943f-cc6a52ad85ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:39.092652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:39.092652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:39.092652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:39.092652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:39.092652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:39.092652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:39.092652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:39.092652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:39.092652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:39.092652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:39.092652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:39.092652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:39.092652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:39.092652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:39.093537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:39.093537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:39.093537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:39.093537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:39.093537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:39.093537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:39.093537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:39.093537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:39.093537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:39.093537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:39.093537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:39.093537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:39.093537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:39.093537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:39.093537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:39.093537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:39.093537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:39.094377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:39.094377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:39.094377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:39.094377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:39.094377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 234/472] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:39.100618 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a8c6b-e1c4-4607-943f-cc6a52ad85ca None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:39.137910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78963b4b-06cb-4995-9ae2-95ff7b2a8ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:39.139325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78963b4b-06cb-4995-9ae2-95ff7b2a8ff8 None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:39.139616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78963b4b-06cb-4995-9ae2-95ff7b2a8ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:39.139904 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78963b4b-06cb-4995-9ae2-95ff7b2a8ff8 None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:39.140783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78963b4b-06cb-4995-9ae2-95ff7b2a8ff8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:39.142588 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78963b4b-06cb-4995-9ae2-95ff7b2a8ff8 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:39.227869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 239/473] 10.222.0.66 () {60 vars in 1132 bytes} [Thu May 26 21:01:38 2022] POST /identity/v3/users => generated 246 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:01:39.229685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f5f12-2030-4e59-a365-4736e2ecd8bb None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:39.230186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f5f12-2030-4e59-a365-4736e2ecd8bb None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:39.230667 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f5f12-2030-4e59-a365-4736e2ecd8bb None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:39.237226 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a8c6b-e1c4-4607-943f-cc6a52ad85ca None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:39.239695 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 240/474] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:39 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:39.243033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30ef3d-59a8-4109-a2bc-ec56ff536a6a None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:39.243596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30ef3d-59a8-4109-a2bc-ec56ff536a6a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:39.244085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30ef3d-59a8-4109-a2bc-ec56ff536a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:39.284350 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-8c30ef3d-59a8-4109-a2bc-ec56ff536a6a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:39.286000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8c30ef3d-59a8-4109-a2bc-ec56ff536a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:39.292656 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:39.320335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35156f61-b6ce-48a7-abb6-ea26181e08a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:39.321434 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35156f61-b6ce-48a7-abb6-ea26181e08a9 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:39.322843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35156f61-b6ce-48a7-abb6-ea26181e08a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:39.324212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35156f61-b6ce-48a7-abb6-ea26181e08a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:39.325224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35156f61-b6ce-48a7-abb6-ea26181e08a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:39.325924 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35156f61-b6ce-48a7-abb6-ea26181e08a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:39.329518 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35156f61-b6ce-48a7-abb6-ea26181e08a9 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:39.344142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 235/475] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:39.349351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35156f61-b6ce-48a7-abb6-ea26181e08a9 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:39.452725 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 241/476] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:39.468292 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30ef3d-59a8-4109-a2bc-ec56ff536a6a None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:39.520743 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35156f61-b6ce-48a7-abb6-ea26181e08a9 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:39.565074 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafb3e8-5aff-4e3f-bdd1-544d8b6d1f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:39.565772 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafb3e8-5aff-4e3f-bdd1-544d8b6d1f1b None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:39.566054 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafb3e8-5aff-4e3f-bdd1-544d8b6d1f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:39.566329 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafb3e8-5aff-4e3f-bdd1-544d8b6d1f1b None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:39.567043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafb3e8-5aff-4e3f-bdd1-544d8b6d1f1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:39.568494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafb3e8-5aff-4e3f-bdd1-544d8b6d1f1b None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:39.596179 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:39.609183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30ef3d-59a8-4109-a2bc-ec56ff536a6a None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:39.645974 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794da1e0-4962-4503-822e-fd6bb4cef4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:39.646656 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794da1e0-4962-4503-822e-fd6bb4cef4ce None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:39.646943 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794da1e0-4962-4503-822e-fd6bb4cef4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:39.647223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794da1e0-4962-4503-822e-fd6bb4cef4ce None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:39.648081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794da1e0-4962-4503-822e-fd6bb4cef4ce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:39.649494 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794da1e0-4962-4503-822e-fd6bb4cef4ce None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:39.663305 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 236/477] 10.222.0.66 () {60 vars in 1132 bytes} [Thu May 26 21:01:39 2022] POST /identity/v3/users => generated 249 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:01:39.685332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.sql.core [None req-794da1e0-4962-4503-822e-fd6bb4cef4ce None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 21:01:39.685332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 21:01:39.685332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [parameters: {'id': '810acc8baa354a1897c4d056fae8eea0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 21:01:39.685332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80747) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 21:01:39.709287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-794da1e0-4962-4503-822e-fd6bb4cef4ce None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 21:01:39.709287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:39.709287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 21:01:39.709287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 21:01:39.709287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 21:01:39.709287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 21:01:39.709287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 21:01:39.709287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application result = self._query(query) May 26 21:01:39.709287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 21:01:39.709287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application conn.query(q) May 26 21:01:39.709287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 21:01:39.709287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 21:01:39.709287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 21:01:39.709287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application result.read() May 26 21:01:39.709287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 21:01:39.710636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 21:01:39.710636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 21:01:39.710636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 21:01:39.710636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 21:01:39.710636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 21:01:39.710636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 21:01:39.710636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 21:01:39.710636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 21:01:39.710636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:39.710636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 21:01:39.710636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:39.710636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:39.710636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 21:01:39.710636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 21:01:39.710636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 21:01:39.710636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return ref.to_dict() May 26 21:01:39.710636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 21:01:39.710636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application next(self.gen) May 26 21:01:39.711576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 21:01:39.711576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application yield resource May 26 21:01:39.711576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 21:01:39.711576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application next(self.gen) May 26 21:01:39.711576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 21:01:39.711576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self.session.rollback() May 26 21:01:39.711576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 21:01:39.711576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self.force_reraise() May 26 21:01:39.711576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 21:01:39.711576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise self.value May 26 21:01:39.711576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 21:01:39.711576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 21:01:39.711576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 21:01:39.711576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application session.commit() May 26 21:01:39.711576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 21:01:39.711576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 21:01:39.711576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 21:01:39.718046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._prepare_impl() May 26 21:01:39.718046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 21:01:39.718046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self.session.flush() May 26 21:01:39.718046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 21:01:39.718046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._flush(objects) May 26 21:01:39.718046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 21:01:39.718046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 21:01:39.718046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 21:01:39.718046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application compat.raise_( May 26 21:01:39.718046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 21:01:39.718046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception May 26 21:01:39.718046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 21:01:39.718046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application flush_context.execute() May 26 21:01:39.718046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 21:01:39.718046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rec.execute(self) May 26 21:01:39.718046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 21:01:39.718046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 21:01:39.719107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 21:01:39.719107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 21:01:39.719107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 21:01:39.719107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 21:01:39.719107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 21:01:39.719107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 21:01:39.719107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 21:01:39.719107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 21:01:39.719107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 21:01:39.719107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 21:01:39.719107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 21:01:39.719107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 21:01:39.719107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 21:01:39.719107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 21:01:39.719107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 21:01:39.719107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception May 26 21:01:39.720057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 21:01:39.720057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 21:01:39.720057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 21:01:39.720057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 21:01:39.720057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 21:01:39.720057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application result = self._query(query) May 26 21:01:39.720057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 21:01:39.720057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application conn.query(q) May 26 21:01:39.720057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 21:01:39.720057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 21:01:39.720057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 21:01:39.720057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application result.read() May 26 21:01:39.720057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 21:01:39.720057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 21:01:39.720057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 21:01:39.720057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 21:01:39.720875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 21:01:39.720875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 21:01:39.720875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 21:01:39.720875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 21:01:39.720875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 21:01:39.720875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 21:01:39.720875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [parameters: {'id': '810acc8baa354a1897c4d056fae8eea0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 21:01:39.720875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 21:01:39.720875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:39.720875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:01:39.720875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:39.720875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:39.720875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:39.720875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:39.720875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:39.720875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:39.721790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:39.721790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:39.721790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:39.721790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:39.721790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:39.721790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:39.721790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 21:01:39.721790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 21:01:39.721790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:39.721790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:39.721790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 21:01:39.721790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 21:01:39.721790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 21:01:39.721790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 21:01:39.721790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 21:01:39.721790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:39.724706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 242/478] 10.222.0.66 () {60 vars in 1131 bytes} [Thu May 26 21:01:39 2022] POST /identity/v3/roles => generated 144 bytes in 257 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 21:01:39.730581 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafb3e8-5aff-4e3f-bdd1-544d8b6d1f1b None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:39.795694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:39.880509 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafb3e8-5aff-4e3f-bdd1-544d8b6d1f1b None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:39.925835 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f57cc-6e42-4ad3-b3ab-31033f553d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:39.927046 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f57cc-6e42-4ad3-b3ab-31033f553d2a None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:39.927523 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f57cc-6e42-4ad3-b3ab-31033f553d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:39.927988 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f57cc-6e42-4ad3-b3ab-31033f553d2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:39.939580 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f57cc-6e42-4ad3-b3ab-31033f553d2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:39.948002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-6c7f57cc-6e42-4ad3-b3ab-31033f553d2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:39.948002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:39.948002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:39.948002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:39.948002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:39.948002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:39.948002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:39.948002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:39.948002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:39.948002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:39.948002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:39.948002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:39.948002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:39.948002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:39.948002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:39.948002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:39.948925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:39.948925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:39.948925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:39.948925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:39.948925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:39.948925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:39.948925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:39.948925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:39.948925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:39.948925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:39.948925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:39.948925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:39.948925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:39.948925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:39.948925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:39.948925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:39.949714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:39.949714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:39.949714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:39.949714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:39.949714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:39.949714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:39.949714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:39.949714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:39.949714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:39.949714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:39.949714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 21:01:39.949714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:39.956703 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 237/479] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:01:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:39.961702 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794da1e0-4962-4503-822e-fd6bb4cef4ce None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:40.072046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794da1e0-4962-4503-822e-fd6bb4cef4ce None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:40.108347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43153c3-a5e6-4f37-a7bc-5292628ab11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:40.109093 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43153c3-a5e6-4f37-a7bc-5292628ab11d None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:40.109486 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43153c3-a5e6-4f37-a7bc-5292628ab11d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:40.109765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43153c3-a5e6-4f37-a7bc-5292628ab11d None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:40.110553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43153c3-a5e6-4f37-a7bc-5292628ab11d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:40.110989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43153c3-a5e6-4f37-a7bc-5292628ab11d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:40.112450 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43153c3-a5e6-4f37-a7bc-5292628ab11d None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:40.122711 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 243/480] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:41.417079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bc900-f4a3-49a0-8104-0fe20e2a7c72 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:41.417601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bc900-f4a3-49a0-8104-0fe20e2a7c72 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:41.417675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bc900-f4a3-49a0-8104-0fe20e2a7c72 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:41.419108 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 238/481] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:41.425255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbceb7b-7373-4a01-adfa-52ee4934af1a None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:41.426150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbceb7b-7373-4a01-adfa-52ee4934af1a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:41.426649 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbceb7b-7373-4a01-adfa-52ee4934af1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:41.428284 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4073567-b89b-4404-8549-33a24feb30b3 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:41.428870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4073567-b89b-4404-8549-33a24feb30b3 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:41.429338 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4073567-b89b-4404-8549-33a24feb30b3 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:41.430836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 239/482] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:41.439793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3f4a4-38fc-4a5a-bdaa-9b5c7304ac41 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:41.445904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3f4a4-38fc-4a5a-bdaa-9b5c7304ac41 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:41.446489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3f4a4-38fc-4a5a-bdaa-9b5c7304ac41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:41.458011 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-7cbceb7b-7373-4a01-adfa-52ee4934af1a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:41.464569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-7cbceb7b-7373-4a01-adfa-52ee4934af1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:41.480954 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-3cb3f4a4-38fc-4a5a-bdaa-9b5c7304ac41 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:41.482532 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3cb3f4a4-38fc-4a5a-bdaa-9b5c7304ac41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:41.492957 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:41.569956 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 244/483] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:01:41.610241 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 240/484] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:41.616528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbceb7b-7373-4a01-adfa-52ee4934af1a None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:41.651644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3f4a4-38fc-4a5a-bdaa-9b5c7304ac41 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:41.704575 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:41.730673 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbceb7b-7373-4a01-adfa-52ee4934af1a None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:41.786759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8f690-e8b9-4059-9ed6-921a83991c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:41.787565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8f690-e8b9-4059-9ed6-921a83991c0f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:41.787840 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8f690-e8b9-4059-9ed6-921a83991c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:41.788109 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8f690-e8b9-4059-9ed6-921a83991c0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:41.798494 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8f690-e8b9-4059-9ed6-921a83991c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:41.806136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-4ed8f690-e8b9-4059-9ed6-921a83991c0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:41.806136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:41.806136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:41.806136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:41.806136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:41.806136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:41.806136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:41.806136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:41.806136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:41.806136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:41.806136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:41.806136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:41.806136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:41.806136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:41.806136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:41.806136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:41.807006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:41.807006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:41.807006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:41.807006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:41.807006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:41.807006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:41.807006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:41.807006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:41.807006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:41.807006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:41.807006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:41.807006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:41.807006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:41.807006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:41.807006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:41.807006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:41.807797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:41.807797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:41.807797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:41.807797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:41.807797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:41.807797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:41.807797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:41.807797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:41.807797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:41.807797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:41.807797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:41.807797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:41.807797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 245/485] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:01:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:41.814057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8f690-e8b9-4059-9ed6-921a83991c0f None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:41.828105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:41.840564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3f4a4-38fc-4a5a-bdaa-9b5c7304ac41 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:41.907933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ef0db-f750-4373-a88a-cde196838e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:41.908830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ef0db-f750-4373-a88a-cde196838e88 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:41.909111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ef0db-f750-4373-a88a-cde196838e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:41.909391 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ef0db-f750-4373-a88a-cde196838e88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:41.919425 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8f690-e8b9-4059-9ed6-921a83991c0f None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:41.930162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ef0db-f750-4373-a88a-cde196838e88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:41.944335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-6c0ef0db-f750-4373-a88a-cde196838e88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:41.944335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:41.944335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:41.944335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:41.944335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:41.944335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:41.944335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:41.944335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:41.944335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:41.944335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:41.944335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:41.944335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:41.944335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:41.944335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:41.944335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:41.944335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:41.945312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:41.945312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:41.945312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:41.945312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:41.945312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:41.945312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:41.945312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:41.945312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:41.945312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:41.945312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:41.945312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:41.945312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:41.945312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:41.945312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:41.945312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:41.945312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:41.946075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:41.946075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:41.946075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:41.946075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:41.946075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:41.946075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:41.946075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:41.946075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:41.946075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:41.946075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:41.946075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:41.946075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:41.950283 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 241/486] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:01:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:01:41.952171 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ef0db-f750-4373-a88a-cde196838e88 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:41.958874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1002a-ef68-4e60-9d36-7435e4f6112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:41.959764 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1002a-ef68-4e60-9d36-7435e4f6112c None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:41.960239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1002a-ef68-4e60-9d36-7435e4f6112c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:41.960725 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1002a-ef68-4e60-9d36-7435e4f6112c None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:41.961648 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1002a-ef68-4e60-9d36-7435e4f6112c None admin] RBAC: Adding query filter params (name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:41.962128 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1002a-ef68-4e60-9d36-7435e4f6112c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:41.963821 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1002a-ef68-4e60-9d36-7435e4f6112c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:41.972978 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 246/487] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:01:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:41.978646 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1002a-ef68-4e60-9d36-7435e4f6112c None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:42.081016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:42.087077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1002a-ef68-4e60-9d36-7435e4f6112c None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:42.121992 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad586e-bbfe-4f14-9088-5f3f349ff90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:42.123719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad586e-bbfe-4f14-9088-5f3f349ff90d None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:42.124179 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad586e-bbfe-4f14-9088-5f3f349ff90d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:42.124655 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad586e-bbfe-4f14-9088-5f3f349ff90d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:42.135257 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad586e-bbfe-4f14-9088-5f3f349ff90d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:42.137023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad586e-bbfe-4f14-9088-5f3f349ff90d None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:42.156734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-c4ad586e-bbfe-4f14-9088-5f3f349ff90d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:42.156734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:42.156734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:42.156734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:42.156734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:42.156734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:42.156734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:42.156734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:42.156734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:42.156734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:42.156734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:42.156734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:42.156734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:42.156734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:42.156734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:42.157633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:42.157633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:42.157633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:42.157633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:42.157633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:42.157633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:42.157633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:42.157633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:42.157633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:42.157633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:42.157633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:42.157633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:42.157633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:42.157633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:42.157633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:42.157633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:42.157633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:42.158449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:42.158449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:42.158449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:42.158449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:42.160759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 247/488] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:01:42.166336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad586e-bbfe-4f14-9088-5f3f349ff90d None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:42.192942 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:42.204594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ef0db-f750-4373-a88a-cde196838e88 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:42.246256 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5918b-8611-4745-b104-c7f2710d7cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:42.247302 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5918b-8611-4745-b104-c7f2710d7cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:42.247750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5918b-8611-4745-b104-c7f2710d7cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:42.248848 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5918b-8611-4745-b104-c7f2710d7cf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:42.249834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5918b-8611-4745-b104-c7f2710d7cf5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:42.250282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5918b-8611-4745-b104-c7f2710d7cf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:42.251910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5918b-8611-4745-b104-c7f2710d7cf5 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:42.265979 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 242/489] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:01:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:42.267793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1756be-c808-4e43-b7c1-405753208dd7 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:42.268239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1756be-c808-4e43-b7c1-405753208dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:42.268888 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1756be-c808-4e43-b7c1-405753208dd7 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:42.273023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad586e-bbfe-4f14-9088-5f3f349ff90d None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:42.273420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 243/490] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:42.274358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1756be-c808-4e43-b7c1-405753208dd7 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:42.294584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:42.308385 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d365ef5-e64c-42c9-aa65-be5a2c049ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:42.309172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d365ef5-e64c-42c9-aa65-be5a2c049ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:42.309937 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d365ef5-e64c-42c9-aa65-be5a2c049ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:42.311889 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d365ef5-e64c-42c9-aa65-be5a2c049ef2 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:42.312725 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d365ef5-e64c-42c9-aa65-be5a2c049ef2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:42.313105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d365ef5-e64c-42c9-aa65-be5a2c049ef2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:42.314588 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d365ef5-e64c-42c9-aa65-be5a2c049ef2 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:42.326636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 248/491] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:42.332368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d96bb-b595-40b4-b2d9-e8824e031b65 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:42.333075 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d96bb-b595-40b4-b2d9-e8824e031b65 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:42.333699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d96bb-b595-40b4-b2d9-e8824e031b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:42.350807 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-ce3d96bb-b595-40b4-b2d9-e8824e031b65 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:42.352080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ce3d96bb-b595-40b4-b2d9-e8824e031b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:42.400108 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1756be-c808-4e43-b7c1-405753208dd7 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:42.432608 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 249/492] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:42.432608 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d96bb-b595-40b4-b2d9-e8824e031b65 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:42.458311 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecee30-451f-4c4d-bb6a-1ce0269dcfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:42.459754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecee30-451f-4c4d-bb6a-1ce0269dcfcc None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:42.460209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecee30-451f-4c4d-bb6a-1ce0269dcfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:42.460684 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecee30-451f-4c4d-bb6a-1ce0269dcfcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:42.472013 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecee30-451f-4c4d-bb6a-1ce0269dcfcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:42.473818 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecee30-451f-4c4d-bb6a-1ce0269dcfcc None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:42.493816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-e8ecee30-451f-4c4d-bb6a-1ce0269dcfcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:42.493816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:42.493816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:42.493816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:42.493816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:42.493816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:42.493816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:42.493816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:42.493816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:42.493816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:42.493816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:42.493816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:42.493816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:42.493816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:42.493816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:42.500839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:42.500839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:42.500839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:42.500839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:42.500839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:42.500839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:42.500839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:42.500839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:42.500839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:42.500839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:42.500839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:42.500839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:42.500839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:42.500839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:42.500839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:42.500839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:42.500839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:42.501896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:42.501896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:42.501896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:42.501896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:42.502221 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 244/493] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:42.503269 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecee30-451f-4c4d-bb6a-1ce0269dcfcc None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:42.507263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:42.547428 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d96bb-b595-40b4-b2d9-e8824e031b65 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:42.565042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:42.585064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab730fe-effd-4a72-9d69-a576ad65866e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:42.586032 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab730fe-effd-4a72-9d69-a576ad65866e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:42.586314 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab730fe-effd-4a72-9d69-a576ad65866e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:42.586586 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab730fe-effd-4a72-9d69-a576ad65866e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:42.595071 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab730fe-effd-4a72-9d69-a576ad65866e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:42.596535 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab730fe-effd-4a72-9d69-a576ad65866e None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:42.614419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-5ab730fe-effd-4a72-9d69-a576ad65866e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 21:01:42.614419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:42.614419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:42.614419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:42.614419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:42.614419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:42.614419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:42.614419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:42.614419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:42.614419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:42.614419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:42.614419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:42.614419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:01:42.614419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:01:42.614419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:01:42.614419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:01:42.615441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:42.615441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:42.615441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:01:42.615441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:42.615441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:01:42.615441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:42.615441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:42.615441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:42.615441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:42.615441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:42.615441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:42.615441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:42.615441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:42.615441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:42.615441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:42.615441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:42.615441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:42.615441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:42.616299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:42.616299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:42.616299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:01:42.616299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:01:42.616299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:01:42.616299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:01:42.616299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:01:42.616299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:01:42.616299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 21:01:42.616299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:42.616299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 250/494] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:42.616921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab730fe-effd-4a72-9d69-a576ad65866e None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:42.621566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecee30-451f-4c4d-bb6a-1ce0269dcfcc None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:42.656919 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e9c4c-d368-43f0-b997-6af51992fe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:42.657720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e9c4c-d368-43f0-b997-6af51992fe6c None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:42.657995 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e9c4c-d368-43f0-b997-6af51992fe6c None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:42.658266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e9c4c-d368-43f0-b997-6af51992fe6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:42.674396 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e9c4c-d368-43f0-b997-6af51992fe6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:42.682080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-df5e9c4c-d368-43f0-b997-6af51992fe6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:42.682080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:42.682080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:42.682080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:42.682080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:42.682080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:42.682080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:42.682080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:42.682080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:42.682080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:42.682080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:42.682080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:42.682080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:42.682080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:42.682080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:42.682080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:42.683060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:42.683060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:42.683060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:42.683060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:42.683060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:42.683060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:42.683060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:42.683060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:42.683060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:42.683060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:42.683060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:42.683060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:42.683060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:42.683060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:42.683060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:42.683060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:42.684117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:42.684117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:42.684117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:42.684117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:42.684117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:42.684117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:42.684117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:42.684117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:42.684117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:42.684117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:42.684117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:42.684117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:42.684117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 245/495] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:01:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:42.689165 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e9c4c-d368-43f0-b997-6af51992fe6c None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:42.745677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab730fe-effd-4a72-9d69-a576ad65866e None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:42.759216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:42.781123 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576471f1-76b2-402c-8ac1-eefa426cc5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:42.781788 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576471f1-76b2-402c-8ac1-eefa426cc5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:42.782069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576471f1-76b2-402c-8ac1-eefa426cc5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:42.782341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576471f1-76b2-402c-8ac1-eefa426cc5b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:42.783065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576471f1-76b2-402c-8ac1-eefa426cc5b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:42.783411 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576471f1-76b2-402c-8ac1-eefa426cc5b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:42.784794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576471f1-76b2-402c-8ac1-eefa426cc5b1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:42.798172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 251/496] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:42.799749 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c576b71-047e-4b7a-a271-c1c6a1b6fb57 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:42.800144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c576b71-047e-4b7a-a271-c1c6a1b6fb57 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:42.800528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c576b71-047e-4b7a-a271-c1c6a1b6fb57 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:42.802082 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 252/497] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:42.805980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e9c4c-d368-43f0-b997-6af51992fe6c None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:42.806570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c576b71-047e-4b7a-a271-c1c6a1b6fb57 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:42.841248 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:42.842912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f65dc-a3f9-4852-908f-db90de2a64b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:42.843586 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f65dc-a3f9-4852-908f-db90de2a64b1 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:42.843865 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f65dc-a3f9-4852-908f-db90de2a64b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:42.844139 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f65dc-a3f9-4852-908f-db90de2a64b1 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:42.845008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f65dc-a3f9-4852-908f-db90de2a64b1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:42.845326 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f65dc-a3f9-4852-908f-db90de2a64b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:42.846736 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f65dc-a3f9-4852-908f-db90de2a64b1 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:42.889896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 246/498] 10.222.0.66 () {56 vars in 1137 bytes} [Thu May 26 21:01:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:42.889896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f65dc-a3f9-4852-908f-db90de2a64b1 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:42.929557 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c576b71-047e-4b7a-a271-c1c6a1b6fb57 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:42.966416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc89931-56ec-4cf2-9318-95f6ab17ff9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:42.967740 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc89931-56ec-4cf2-9318-95f6ab17ff9c None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:42.968085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc89931-56ec-4cf2-9318-95f6ab17ff9c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:42.968362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc89931-56ec-4cf2-9318-95f6ab17ff9c None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:42.969133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc89931-56ec-4cf2-9318-95f6ab17ff9c None admin] RBAC: Adding query filter params (name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:42.969436 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc89931-56ec-4cf2-9318-95f6ab17ff9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:42.970821 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc89931-56ec-4cf2-9318-95f6ab17ff9c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:42.983577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 253/499] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:01:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:42.983577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbb9dd-a925-4374-9c9c-8507e6c34101 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:42.983577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbb9dd-a925-4374-9c9c-8507e6c34101 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:42.983577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbb9dd-a925-4374-9c9c-8507e6c34101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:42.997898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-bddbb9dd-a925-4374-9c9c-8507e6c34101 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:42.999073 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-bddbb9dd-a925-4374-9c9c-8507e6c34101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:43.007996 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f65dc-a3f9-4852-908f-db90de2a64b1 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:43.038853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:43.050193 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b74292-8515-4b7f-9fef-3da0e233f80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:43.051098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b74292-8515-4b7f-9fef-3da0e233f80d None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:43.051452 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b74292-8515-4b7f-9fef-3da0e233f80d None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:43.051795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b74292-8515-4b7f-9fef-3da0e233f80d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:43.059165 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b74292-8515-4b7f-9fef-3da0e233f80d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:43.061964 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b74292-8515-4b7f-9fef-3da0e233f80d None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:43.071107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 254/500] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:43.072102 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbb9dd-a925-4374-9c9c-8507e6c34101 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:43.081363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-f4b74292-8515-4b7f-9fef-3da0e233f80d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 21:01:43.081363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:43.081363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:43.081363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:43.081363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:43.081363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:43.081363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:43.081363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:43.081363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:43.081363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:43.081363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:43.081363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:43.081363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:01:43.081363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:01:43.081363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:01:43.081363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:01:43.082276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:43.082276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:43.082276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:01:43.082276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:43.082276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:01:43.082276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:43.082276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:43.082276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:43.082276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:43.082276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:43.082276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:43.082276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:43.082276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:43.082276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:43.082276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:43.082276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:43.082276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:43.082276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:43.083450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:43.083450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:43.083450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:01:43.083450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:01:43.083450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:01:43.083450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:01:43.083450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:01:43.083450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:01:43.083450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 21:01:43.083450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:43.083450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 247/501] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:43.083450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b74292-8515-4b7f-9fef-3da0e233f80d None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:43.102309 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:43.177199 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbb9dd-a925-4374-9c9c-8507e6c34101 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:43.183064 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b74292-8515-4b7f-9fef-3da0e233f80d None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:43.210914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76853d0-a3a4-4dc9-9e06-ae5671b375dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:43.211565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76853d0-a3a4-4dc9-9e06-ae5671b375dd None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:43.211849 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76853d0-a3a4-4dc9-9e06-ae5671b375dd None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:43.212126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76853d0-a3a4-4dc9-9e06-ae5671b375dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:43.216014 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14216d4f-cd8c-4ad2-9e59-da2200026f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:43.217445 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14216d4f-cd8c-4ad2-9e59-da2200026f5b None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:43.217794 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14216d4f-cd8c-4ad2-9e59-da2200026f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:43.218155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14216d4f-cd8c-4ad2-9e59-da2200026f5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:43.230458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14216d4f-cd8c-4ad2-9e59-da2200026f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:43.231943 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14216d4f-cd8c-4ad2-9e59-da2200026f5b None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:43.248809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-14216d4f-cd8c-4ad2-9e59-da2200026f5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:43.248809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:43.248809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:43.248809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:43.248809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:43.248809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:43.248809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:43.248809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:43.248809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:43.248809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:43.248809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:43.248809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:43.248809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:43.248809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:43.248809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:43.249804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:43.249804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:43.249804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:43.249804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:43.249804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:43.249804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:43.249804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:43.249804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:43.249804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:43.249804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:43.249804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:43.249804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:43.249804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:43.249804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:43.249804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:43.249804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:43.249804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:43.250814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:43.250814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:43.250814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:43.250814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:43.250814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 248/502] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:43.251666 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a821480-9f1f-45db-900a-7f932222d5e5 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:43.251956 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a821480-9f1f-45db-900a-7f932222d5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:43.252232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a821480-9f1f-45db-900a-7f932222d5e5 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:43.253522 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 249/503] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:43.254289 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a821480-9f1f-45db-900a-7f932222d5e5 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:43.284321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76853d0-a3a4-4dc9-9e06-ae5671b375dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:43.285815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76853d0-a3a4-4dc9-9e06-ae5671b375dd None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:43.290015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:43.309992 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:43.356722 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a821480-9f1f-45db-900a-7f932222d5e5 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:43.384255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 255/504] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:43.385133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76853d0-a3a4-4dc9-9e06-ae5671b375dd None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:43.394791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215b7ff-65fc-4847-88e0-567c87ea8292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:43.395469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215b7ff-65fc-4847-88e0-567c87ea8292 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:43.395755 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215b7ff-65fc-4847-88e0-567c87ea8292 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:43.396030 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215b7ff-65fc-4847-88e0-567c87ea8292 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:43.396899 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215b7ff-65fc-4847-88e0-567c87ea8292 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:43.397211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215b7ff-65fc-4847-88e0-567c87ea8292 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:43.398640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215b7ff-65fc-4847-88e0-567c87ea8292 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:43.415429 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 250/505] 10.222.0.66 () {56 vars in 1137 bytes} [Thu May 26 21:01:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:43.416245 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215b7ff-65fc-4847-88e0-567c87ea8292 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:43.487924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76853d0-a3a4-4dc9-9e06-ae5671b375dd None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:43.504576 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:43.511877 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:43.514089 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215b7ff-65fc-4847-88e0-567c87ea8292 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:43.523318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58960b-b319-4d54-a8a1-a2b5cc09915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:43.524275 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58960b-b319-4d54-a8a1-a2b5cc09915a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:43.524556 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58960b-b319-4d54-a8a1-a2b5cc09915a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:43.524867 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58960b-b319-4d54-a8a1-a2b5cc09915a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:43.536198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58960b-b319-4d54-a8a1-a2b5cc09915a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:43.544136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-3d58960b-b319-4d54-a8a1-a2b5cc09915a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:43.544136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:43.544136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:43.544136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:43.544136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:43.544136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:43.544136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:43.544136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:43.544136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:43.544136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:43.544136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:43.544136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:43.544136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:43.544136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:43.544136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:43.544136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:43.545116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:43.545116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:43.545116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:43.545116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:43.545116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:43.545116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:43.545116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:43.545116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:43.545116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:43.545116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:43.545116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:43.545116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:43.545116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:43.545116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:43.545116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:43.545116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:43.545905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:43.545905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:43.545905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:43.545905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:43.545905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:43.545905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:43.545905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:43.545905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:43.545905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:43.545905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:43.545905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:43.545905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:43.545905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 256/506] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:01:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:43.546988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b4769-64f6-44f3-8e19-4ccd035dfa3b None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:43.546988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b4769-64f6-44f3-8e19-4ccd035dfa3b None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:43.547358 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b4769-64f6-44f3-8e19-4ccd035dfa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:43.549228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97359e66-d9da-4648-97f5-92d96258817f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:43.557125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97359e66-d9da-4648-97f5-92d96258817f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:43.557125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97359e66-d9da-4648-97f5-92d96258817f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:43.557125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97359e66-d9da-4648-97f5-92d96258817f None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:43.557125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97359e66-d9da-4648-97f5-92d96258817f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:43.557125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97359e66-d9da-4648-97f5-92d96258817f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:43.557125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97359e66-d9da-4648-97f5-92d96258817f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:43.565710 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-af2b4769-64f6-44f3-8e19-4ccd035dfa3b None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:43.566933 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-af2b4769-64f6-44f3-8e19-4ccd035dfa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:43.576803 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 251/507] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:43.577883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97359e66-d9da-4648-97f5-92d96258817f None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:43.652683 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 257/508] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:43.652683 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b4769-64f6-44f3-8e19-4ccd035dfa3b None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:43.676914 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97359e66-d9da-4648-97f5-92d96258817f None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:43.712030 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec02b4-fcc4-43ea-a531-906aa9e6141f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:43.712850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec02b4-fcc4-43ea-a531-906aa9e6141f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:43.713140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec02b4-fcc4-43ea-a531-906aa9e6141f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:43.713418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec02b4-fcc4-43ea-a531-906aa9e6141f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:43.724001 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec02b4-fcc4-43ea-a531-906aa9e6141f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:43.725537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec02b4-fcc4-43ea-a531-906aa9e6141f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:43.743270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-05ec02b4-fcc4-43ea-a531-906aa9e6141f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:43.743270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:43.743270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:43.743270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:43.743270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:43.743270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:43.743270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:43.743270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:43.743270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:43.743270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:43.743270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:43.743270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:43.743270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:43.743270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:43.743270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:43.744153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:43.744153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:43.744153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:43.744153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:43.744153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:43.744153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:43.744153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:43.744153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:43.744153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:43.744153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:43.744153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:43.744153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:43.744153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:43.744153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:43.744153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:43.744153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:43.744153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:43.745205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:43.745205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:43.745205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:43.745205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:43.745205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 252/509] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:43.745602 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec02b4-fcc4-43ea-a531-906aa9e6141f None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:43.749183 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:43.753816 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b4769-64f6-44f3-8e19-4ccd035dfa3b None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:43.767878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:43.787216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4cd7b-ca2b-45fb-a1b2-450dfa04fead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:43.787864 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4cd7b-ca2b-45fb-a1b2-450dfa04fead None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:43.788141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4cd7b-ca2b-45fb-a1b2-450dfa04fead None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:43.788410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4cd7b-ca2b-45fb-a1b2-450dfa04fead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:43.843669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec02b4-fcc4-43ea-a531-906aa9e6141f None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:43.855477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4cd7b-ca2b-45fb-a1b2-450dfa04fead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:43.856982 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4cd7b-ca2b-45fb-a1b2-450dfa04fead None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:43.877993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5522ab-5b65-433d-8345-696ed7e154c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:43.878652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5522ab-5b65-433d-8345-696ed7e154c5 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:43.878932 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5522ab-5b65-433d-8345-696ed7e154c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:43.879200 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5522ab-5b65-433d-8345-696ed7e154c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:43.879929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5522ab-5b65-433d-8345-696ed7e154c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:43.880237 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5522ab-5b65-433d-8345-696ed7e154c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:43.881612 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5522ab-5b65-433d-8345-696ed7e154c5 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:43.889438 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 253/510] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:01:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:43.890415 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5522ab-5b65-433d-8345-696ed7e154c5 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:43.954686 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:43.955708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 258/511] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:43.957511 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4cd7b-ca2b-45fb-a1b2-450dfa04fead None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:43.972032 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:43.989245 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5522ab-5b65-433d-8345-696ed7e154c5 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:44.021562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0ddf5-eb9b-44fb-9580-7eed6033f336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:44.022354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0ddf5-eb9b-44fb-9580-7eed6033f336 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:44.022638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0ddf5-eb9b-44fb-9580-7eed6033f336 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:44.022914 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0ddf5-eb9b-44fb-9580-7eed6033f336 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:44.030475 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0ddf5-eb9b-44fb-9580-7eed6033f336 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:44.031931 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0ddf5-eb9b-44fb-9580-7eed6033f336 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:44.046103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-eaf0ddf5-eb9b-44fb-9580-7eed6033f336 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 21:01:44.046103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:44.046103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:44.046103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:44.046103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:44.046103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:44.046103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:44.046103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:44.046103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:44.046103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:44.046103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:44.046103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:44.046103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:01:44.046103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:01:44.046103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:01:44.046103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:01:44.046993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:44.046993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:44.046993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:01:44.046993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:44.046993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:01:44.046993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:44.046993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:44.046993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:44.046993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:44.046993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:44.046993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:44.046993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:44.046993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:44.046993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:44.046993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:44.046993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:44.046993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:44.046993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:44.047875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:44.047875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:44.047875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:01:44.047875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:01:44.047875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:01:44.047875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:01:44.047875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:01:44.047875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:01:44.047875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 21:01:44.047875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:44.047875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 254/512] 10.222.0.66 () {56 vars in 1093 bytes} [Thu May 26 21:01:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:44.048412 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0ddf5-eb9b-44fb-9580-7eed6033f336 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:44.054907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4cd7b-ca2b-45fb-a1b2-450dfa04fead None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:44.089026 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74e92b-32a7-447b-8b9d-416b345defe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:44.089820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74e92b-32a7-447b-8b9d-416b345defe9 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:44.090412 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74e92b-32a7-447b-8b9d-416b345defe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:44.090412 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74e92b-32a7-447b-8b9d-416b345defe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:44.100899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74e92b-32a7-447b-8b9d-416b345defe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:44.102276 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74e92b-32a7-447b-8b9d-416b345defe9 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:44.120095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-9d74e92b-32a7-447b-8b9d-416b345defe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:44.120095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:44.120095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:44.120095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:44.120095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:44.120095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:44.120095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:44.120095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:44.120095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:44.120095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:44.120095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:44.120095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:44.120095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:44.120095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:44.120095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:44.120980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:44.120980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:44.120980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:44.120980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:44.120980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:44.120980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:44.120980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:44.120980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:44.120980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:44.120980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:44.120980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:44.120980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:44.120980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:44.120980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:44.120980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:44.120980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:44.120980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:44.121819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:44.121819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:44.121819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:44.121819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:44.121819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 259/513] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:44.122091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74e92b-32a7-447b-8b9d-416b345defe9 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:44.148829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0ddf5-eb9b-44fb-9580-7eed6033f336 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:44.174501 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:44.182937 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8e613-2f28-4d2e-9934-627b2b495722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:44.183672 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8e613-2f28-4d2e-9934-627b2b495722 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:44.183956 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8e613-2f28-4d2e-9934-627b2b495722 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:44.186219 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8e613-2f28-4d2e-9934-627b2b495722 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:44.186219 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8e613-2f28-4d2e-9934-627b2b495722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:44.186219 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8e613-2f28-4d2e-9934-627b2b495722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:44.186950 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8e613-2f28-4d2e-9934-627b2b495722 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:44.188990 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:44.199354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 255/514] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:44.200499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8e613-2f28-4d2e-9934-627b2b495722 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:44.222633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74e92b-32a7-447b-8b9d-416b345defe9 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:44.256463 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e66f9-40f1-46ed-aaea-44884c2c99b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:44.257283 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e66f9-40f1-46ed-aaea-44884c2c99b0 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:44.257569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e66f9-40f1-46ed-aaea-44884c2c99b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:44.257846 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e66f9-40f1-46ed-aaea-44884c2c99b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:44.267747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e66f9-40f1-46ed-aaea-44884c2c99b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:44.269271 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e66f9-40f1-46ed-aaea-44884c2c99b0 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:44.287359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-f90e66f9-40f1-46ed-aaea-44884c2c99b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:44.287359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:44.287359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:44.287359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:44.287359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:44.287359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:44.287359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:44.287359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:44.287359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:44.287359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:44.287359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:44.287359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:44.287359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:44.287359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:44.287359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:44.288336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:44.288336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:44.288336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:44.288336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:44.288336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:44.288336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:44.288336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:44.288336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:44.288336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:44.288336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:44.288336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:44.288336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:44.288336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:44.288336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:44.288336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:44.288336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:44.288336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:44.289360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:44.289360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:44.289360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:44.289360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:44.290165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 260/515] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:44.291118 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e66f9-40f1-46ed-aaea-44884c2c99b0 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:44.297737 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8e613-2f28-4d2e-9934-627b2b495722 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:44.330758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6b7f8-f3cb-4e2d-9c87-123f8fa356ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:44.331545 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6b7f8-f3cb-4e2d-9c87-123f8fa356ab None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:44.331828 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6b7f8-f3cb-4e2d-9c87-123f8fa356ab None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:44.332105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6b7f8-f3cb-4e2d-9c87-123f8fa356ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:44.342512 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6b7f8-f3cb-4e2d-9c87-123f8fa356ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:44.343996 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6b7f8-f3cb-4e2d-9c87-123f8fa356ab None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:44.361668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-8fc6b7f8-f3cb-4e2d-9c87-123f8fa356ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:44.361668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:44.361668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:44.361668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:44.361668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:44.361668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:44.361668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:44.361668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:44.361668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:44.361668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:44.361668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:44.361668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:44.361668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:44.361668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:44.361668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:44.362643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:44.362643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:44.362643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:44.362643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:44.362643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:44.362643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:44.362643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:44.362643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:44.362643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:44.362643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:44.362643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:44.362643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:44.362643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:44.362643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:44.362643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:44.362643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:44.362643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:44.363598 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:44.363598 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:44.363598 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:44.363598 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:44.363598 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 256/516] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:44.363933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6b7f8-f3cb-4e2d-9c87-123f8fa356ab None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:44.389682 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e66f9-40f1-46ed-aaea-44884c2c99b0 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:44.401315 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:44.409286 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:44.426120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a10ff-946a-4b74-a255-7d929b7df3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:44.426907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a10ff-946a-4b74-a255-7d929b7df3be None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:44.427197 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a10ff-946a-4b74-a255-7d929b7df3be None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:44.432179 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a10ff-946a-4b74-a255-7d929b7df3be None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:44.432179 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a10ff-946a-4b74-a255-7d929b7df3be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:44.432179 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a10ff-946a-4b74-a255-7d929b7df3be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:44.432179 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a10ff-946a-4b74-a255-7d929b7df3be None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:44.460406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6b7f8-f3cb-4e2d-9c87-123f8fa356ab None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:44.467492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 261/517] 10.222.0.66 () {56 vars in 1133 bytes} [Thu May 26 21:01:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:44.468156 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a10ff-946a-4b74-a255-7d929b7df3be None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:44.496740 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e059c1-d75e-4e66-b50d-ab96cd310aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:44.497409 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e059c1-d75e-4e66-b50d-ab96cd310aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:44.497788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e059c1-d75e-4e66-b50d-ab96cd310aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:44.498067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e059c1-d75e-4e66-b50d-ab96cd310aa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:44.498790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e059c1-d75e-4e66-b50d-ab96cd310aa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:44.499097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e059c1-d75e-4e66-b50d-ab96cd310aa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:44.500482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e059c1-d75e-4e66-b50d-ab96cd310aa2 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:44.512195 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 257/518] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:44.513134 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e059c1-d75e-4e66-b50d-ab96cd310aa2 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:44.571420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a10ff-946a-4b74-a255-7d929b7df3be None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:44.608691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee963c-bc60-4035-94b1-3a7f14b58f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:44.609492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee963c-bc60-4035-94b1-3a7f14b58f72 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:44.609679 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:44.609781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee963c-bc60-4035-94b1-3a7f14b58f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:44.610032 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee963c-bc60-4035-94b1-3a7f14b58f72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:44.613564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e059c1-d75e-4e66-b50d-ab96cd310aa2 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:44.616856 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee963c-bc60-4035-94b1-3a7f14b58f72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:44.621203 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee963c-bc60-4035-94b1-3a7f14b58f72 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:44.632601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-18ee963c-bc60-4035-94b1-3a7f14b58f72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:44.632601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:44.632601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:44.632601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:44.632601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:44.632601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:44.632601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:44.632601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:44.632601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:44.632601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:44.632601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:44.632601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:44.632601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:01:44.632601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:01:44.632601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:01:44.633422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:01:44.633422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:44.633422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:44.633422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:44.633422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:44.633422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:44.633422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:44.633422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:44.633422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:44.633422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:44.633422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:44.633422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:44.633422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:44.633422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:44.633422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:44.633422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:44.633422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:44.634295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:01:44.634295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:01:44.634295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:01:44.634295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:01:44.634295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:01:44.634295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:01:44.634295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:44.634295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:44.634295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 262/519] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:44.634762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee963c-bc60-4035-94b1-3a7f14b58f72 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:44.650524 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642418c-747c-48ec-8b3f-b130bce8f88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:44.651184 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642418c-747c-48ec-8b3f-b130bce8f88a None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:44.651463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642418c-747c-48ec-8b3f-b130bce8f88a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:44.651734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642418c-747c-48ec-8b3f-b130bce8f88a None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:44.652450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642418c-747c-48ec-8b3f-b130bce8f88a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:44.652782 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642418c-747c-48ec-8b3f-b130bce8f88a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:44.654748 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642418c-747c-48ec-8b3f-b130bce8f88a None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:44.665657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 258/520] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:44.666441 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642418c-747c-48ec-8b3f-b130bce8f88a None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:44.674203 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:44.739912 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee963c-bc60-4035-94b1-3a7f14b58f72 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:44.763948 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642418c-747c-48ec-8b3f-b130bce8f88a None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:44.773994 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab408a-de60-481c-b012-8690243843e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:44.774841 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab408a-de60-481c-b012-8690243843e5 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:44.775116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab408a-de60-481c-b012-8690243843e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:44.775388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab408a-de60-481c-b012-8690243843e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:44.776114 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab408a-de60-481c-b012-8690243843e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:44.776416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab408a-de60-481c-b012-8690243843e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:44.777819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab408a-de60-481c-b012-8690243843e5 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:44.789349 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 263/521] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:44.790090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab408a-de60-481c-b012-8690243843e5 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:44.796976 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b85a5d-aeb8-43c3-824f-4213ee84dc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:44.797634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b85a5d-aeb8-43c3-824f-4213ee84dc97 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:44.797924 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b85a5d-aeb8-43c3-824f-4213ee84dc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:44.798201 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b85a5d-aeb8-43c3-824f-4213ee84dc97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:44.824752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:44.864778 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b85a5d-aeb8-43c3-824f-4213ee84dc97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:44.866152 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b85a5d-aeb8-43c3-824f-4213ee84dc97 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:44.885500 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:44.891651 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab408a-de60-481c-b012-8690243843e5 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:44.925332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc94870-fd67-458e-a8cd-e6e0fe926e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:44.926005 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc94870-fd67-458e-a8cd-e6e0fe926e45 None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:44.926293 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc94870-fd67-458e-a8cd-e6e0fe926e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:44.926570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc94870-fd67-458e-a8cd-e6e0fe926e45 None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:44.927273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc94870-fd67-458e-a8cd-e6e0fe926e45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:44.928752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc94870-fd67-458e-a8cd-e6e0fe926e45 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:44.960959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 259/522] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:44.961883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b85a5d-aeb8-43c3-824f-4213ee84dc97 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:45.016645 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:45.026539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 264/523] 10.222.0.66 () {60 vars in 1132 bytes} [Thu May 26 21:01:44 2022] POST /identity/v3/users => generated 247 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:01:45.027512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc94870-fd67-458e-a8cd-e6e0fe926e45 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:45.062578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b85a5d-aeb8-43c3-824f-4213ee84dc97 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:45.102151 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4530f1-abf5-4092-81e5-164f8b614110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:45.102830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4530f1-abf5-4092-81e5-164f8b614110 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:45.103118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4530f1-abf5-4092-81e5-164f8b614110 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:45.103392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4530f1-abf5-4092-81e5-164f8b614110 None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:45.104202 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4530f1-abf5-4092-81e5-164f8b614110 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:45.104514 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4530f1-abf5-4092-81e5-164f8b614110 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:45.106049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4530f1-abf5-4092-81e5-164f8b614110 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:45.128173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 260/524] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:01:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:45.129506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4530f1-abf5-4092-81e5-164f8b614110 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:45.152273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc94870-fd67-458e-a8cd-e6e0fe926e45 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:45.192668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3acad0-bfc3-473b-8c5d-5c3921869268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:45.193493 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3acad0-bfc3-473b-8c5d-5c3921869268 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:45.193823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3acad0-bfc3-473b-8c5d-5c3921869268 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:45.194218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3acad0-bfc3-473b-8c5d-5c3921869268 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:45.203907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3acad0-bfc3-473b-8c5d-5c3921869268 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:45.205420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3acad0-bfc3-473b-8c5d-5c3921869268 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:45.220319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-9c3acad0-bfc3-473b-8c5d-5c3921869268 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 21:01:45.220319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:45.220319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:45.220319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:45.220319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:45.220319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:45.220319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:45.220319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:45.220319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:45.220319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:45.220319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:45.220319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:45.220319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:01:45.220319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:01:45.220319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:01:45.220319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:01:45.222893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:45.222893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:45.222893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:01:45.222893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:45.222893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:01:45.222893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:45.222893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:45.222893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:45.222893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:45.222893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:45.222893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:45.222893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:45.222893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:45.222893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:45.222893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:45.222893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:45.222893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:45.222893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:45.223781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:45.223781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:45.223781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:01:45.223781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:01:45.223781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:01:45.223781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:01:45.223781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:01:45.223781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:01:45.223781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 21:01:45.223781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:45.223781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 265/525] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:01:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:45.223781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3acad0-bfc3-473b-8c5d-5c3921869268 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:45.240230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:45.248109 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4530f1-abf5-4092-81e5-164f8b614110 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:45.271570 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:45.288323 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344bd73-e016-40db-8b48-f792ba4db31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:45.289265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344bd73-e016-40db-8b48-f792ba4db31e None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:45.289620 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344bd73-e016-40db-8b48-f792ba4db31e None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:45.289904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344bd73-e016-40db-8b48-f792ba4db31e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:45.297810 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344bd73-e016-40db-8b48-f792ba4db31e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:45.299290 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344bd73-e016-40db-8b48-f792ba4db31e None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:45.314922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-6344bd73-e016-40db-8b48-f792ba4db31e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:45.314922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:45.314922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:45.314922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:45.314922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:45.314922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:45.314922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:45.314922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:45.314922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:45.314922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:45.314922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:45.314922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:45.314922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:01:45.314922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:01:45.314922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:01:45.315817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:01:45.315817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:45.315817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:45.315817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:45.315817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:45.315817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:45.315817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:45.315817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:45.315817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:45.315817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:45.315817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:45.315817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:45.315817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:45.315817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:45.315817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:45.315817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:45.315817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:45.316718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:01:45.316718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:01:45.316718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:01:45.316718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:01:45.316718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:01:45.316718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:01:45.316718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:45.316718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:45.316718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 261/526] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:45.317214 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344bd73-e016-40db-8b48-f792ba4db31e None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:45.345334 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3acad0-bfc3-473b-8c5d-5c3921869268 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:45.381730 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0975ea6-db11-477c-a759-3bb0d474c1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:45.382863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0975ea6-db11-477c-a759-3bb0d474c1cb None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:45.383362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0975ea6-db11-477c-a759-3bb0d474c1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:45.383833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0975ea6-db11-477c-a759-3bb0d474c1cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:45.395854 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0975ea6-db11-477c-a759-3bb0d474c1cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:45.397590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0975ea6-db11-477c-a759-3bb0d474c1cb None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:45.415869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-b0975ea6-db11-477c-a759-3bb0d474c1cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:45.415869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:45.415869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:45.415869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:45.415869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:45.415869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:45.415869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:45.415869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:45.415869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:45.415869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:45.415869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:45.415869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:45.415869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:45.415869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:45.415869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:45.416839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:45.416839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:45.416839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:45.416839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:45.416839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:45.416839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:45.416839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:45.416839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:45.416839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:45.416839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:45.416839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:45.416839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:45.416839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:45.416839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:45.416839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:45.416839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:45.416839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:45.417808 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:45.417808 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:45.417808 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:45.417808 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:45.419334 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 266/527] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:45.420303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0975ea6-db11-477c-a759-3bb0d474c1cb None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:45.428828 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344bd73-e016-40db-8b48-f792ba4db31e None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:45.470742 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331df8c-a41f-4ef4-8546-ca6d26a1c0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:45.471524 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331df8c-a41f-4ef4-8546-ca6d26a1c0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:45.471811 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331df8c-a41f-4ef4-8546-ca6d26a1c0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:45.472093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331df8c-a41f-4ef4-8546-ca6d26a1c0b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:45.472974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331df8c-a41f-4ef4-8546-ca6d26a1c0b2 None admin] RBAC: Adding query filter params (role.id=6391321aa2bd4ed5980bebfc65f307a9, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=628bac94f0c54ac7a14ff19287efd8df) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:45.473288 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331df8c-a41f-4ef4-8546-ca6d26a1c0b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:45.474732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331df8c-a41f-4ef4-8546-ca6d26a1c0b2 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:45.487678 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 262/528] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:01:45 2022] GET /identity/v3/role_assignments?user.id=628bac94f0c54ac7a14ff19287efd8df&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=6391321aa2bd4ed5980bebfc65f307a9 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:45.487678 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331df8c-a41f-4ef4-8546-ca6d26a1c0b2 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:45.499165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:45.534642 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:45.558284 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0975ea6-db11-477c-a759-3bb0d474c1cb None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:45.607776 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331df8c-a41f-4ef4-8546-ca6d26a1c0b2 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:45.608759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527ffd4-bcec-4957-8c40-0740c0c97acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:45.609460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527ffd4-bcec-4957-8c40-0740c0c97acd None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:45.609848 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527ffd4-bcec-4957-8c40-0740c0c97acd None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:45.610142 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527ffd4-bcec-4957-8c40-0740c0c97acd None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:45.611123 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527ffd4-bcec-4957-8c40-0740c0c97acd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:45.611445 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527ffd4-bcec-4957-8c40-0740c0c97acd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:45.612978 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527ffd4-bcec-4957-8c40-0740c0c97acd None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:45.638895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 267/529] 10.222.0.66 () {56 vars in 1139 bytes} [Thu May 26 21:01:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:45.641666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527ffd4-bcec-4957-8c40-0740c0c97acd None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:45.646822 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b0f9b-0a06-4f99-880f-c9fab2b9a15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:45.647503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b0f9b-0a06-4f99-880f-c9fab2b9a15c None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:45.647780 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b0f9b-0a06-4f99-880f-c9fab2b9a15c None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:45.648051 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b0f9b-0a06-4f99-880f-c9fab2b9a15c None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:45.648882 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b0f9b-0a06-4f99-880f-c9fab2b9a15c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:45.649188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b0f9b-0a06-4f99-880f-c9fab2b9a15c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:45.650786 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b0f9b-0a06-4f99-880f-c9fab2b9a15c None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:45.665031 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 263/530] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:01:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:45.666189 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b0f9b-0a06-4f99-880f-c9fab2b9a15c None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:45.754444 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527ffd4-bcec-4957-8c40-0740c0c97acd None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:45.772125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b0f9b-0a06-4f99-880f-c9fab2b9a15c None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:45.774023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:45.779932 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:45.791481 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f1692-597a-4a3e-a2c5-fda2c2613027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:45.792162 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f1692-597a-4a3e-a2c5-fda2c2613027 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:45.792452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f1692-597a-4a3e-a2c5-fda2c2613027 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:45.792763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f1692-597a-4a3e-a2c5-fda2c2613027 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:45.793501 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f1692-597a-4a3e-a2c5-fda2c2613027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:45.793813 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f1692-597a-4a3e-a2c5-fda2c2613027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:45.795842 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f1692-597a-4a3e-a2c5-fda2c2613027 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:45.809327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 268/531] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:45.811044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f1692-597a-4a3e-a2c5-fda2c2613027 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:45.817499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff79213-1c96-4fd1-8b3e-37a0a0d354d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:45.818431 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff79213-1c96-4fd1-8b3e-37a0a0d354d3 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:45.818854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff79213-1c96-4fd1-8b3e-37a0a0d354d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:45.819271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff79213-1c96-4fd1-8b3e-37a0a0d354d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:45.897930 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff79213-1c96-4fd1-8b3e-37a0a0d354d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:45.899594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff79213-1c96-4fd1-8b3e-37a0a0d354d3 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:45.924854 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f1692-597a-4a3e-a2c5-fda2c2613027 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:45.962255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7903c-a131-40be-a45d-c829830425a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:45.962925 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7903c-a131-40be-a45d-c829830425a8 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:45.963320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7903c-a131-40be-a45d-c829830425a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:45.963602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7903c-a131-40be-a45d-c829830425a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:45.964443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7903c-a131-40be-a45d-c829830425a8 None admin] RBAC: Adding query filter params (role.id=6391321aa2bd4ed5980bebfc65f307a9, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=4561bdb2d75e4025a5d73ea713c690b3) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:45.964783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7903c-a131-40be-a45d-c829830425a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:45.966951 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7903c-a131-40be-a45d-c829830425a8 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:45.973129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 269/532] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:01:45 2022] GET /identity/v3/role_assignments?user.id=4561bdb2d75e4025a5d73ea713c690b3&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=6391321aa2bd4ed5980bebfc65f307a9 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:45.973720 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7903c-a131-40be-a45d-c829830425a8 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:46.011757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 264/533] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:46.017955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff79213-1c96-4fd1-8b3e-37a0a0d354d3 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:46.020127 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:46.041063 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:46.092627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7903c-a131-40be-a45d-c829830425a8 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:46.130255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b908f9-f3b5-4997-afbf-6ef2f1415524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:46.131089 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b908f9-f3b5-4997-afbf-6ef2f1415524 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:46.131376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b908f9-f3b5-4997-afbf-6ef2f1415524 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:46.131656 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b908f9-f3b5-4997-afbf-6ef2f1415524 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:46.140549 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b908f9-f3b5-4997-afbf-6ef2f1415524 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:46.142088 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b908f9-f3b5-4997-afbf-6ef2f1415524 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:46.171420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-b5b908f9-f3b5-4997-afbf-6ef2f1415524 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:46.171420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:46.171420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:46.171420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:46.171420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:46.171420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:46.171420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:46.171420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:46.171420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:46.171420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:46.171420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:46.171420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:46.171420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:01:46.171420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:01:46.171420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:01:46.173508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:01:46.173508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:46.173508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:46.173508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:46.173508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:46.173508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:46.173508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:46.173508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:46.173508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:46.173508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:46.173508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:46.173508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:46.173508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:46.173508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:46.173508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:46.173508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:46.173508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:46.175616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:01:46.175616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:01:46.175616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:01:46.175616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:01:46.175616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:01:46.175616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:01:46.175616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:46.175616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:46.175616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 270/534] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:46.181791 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b908f9-f3b5-4997-afbf-6ef2f1415524 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:46.243511 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff79213-1c96-4fd1-8b3e-37a0a0d354d3 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:46.284775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fcef4-2df1-41be-803b-c399ae3d6cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:46.285582 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fcef4-2df1-41be-803b-c399ae3d6cbd None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:46.285866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fcef4-2df1-41be-803b-c399ae3d6cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:46.286145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fcef4-2df1-41be-803b-c399ae3d6cbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:46.297631 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fcef4-2df1-41be-803b-c399ae3d6cbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:46.299253 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fcef4-2df1-41be-803b-c399ae3d6cbd None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:46.318564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-499fcef4-2df1-41be-803b-c399ae3d6cbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:46.318564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:46.318564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:46.318564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:46.318564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:46.318564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:46.318564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:46.318564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:46.318564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:46.318564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:46.318564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:46.318564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:46.318564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:46.318564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:46.318564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:46.319447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:46.319447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:46.319447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:46.319447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:46.319447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:46.319447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:46.319447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:46.319447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:46.319447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:46.319447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:46.319447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:46.319447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:46.319447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:46.319447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:46.319447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:46.319447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:46.319447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:46.320753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:46.320753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:46.320753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:46.320753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:46.320753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 265/535] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:46.325447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fcef4-2df1-41be-803b-c399ae3d6cbd None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:46.396946 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:46.416350 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b908f9-f3b5-4997-afbf-6ef2f1415524 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:46.427145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:46.431859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fcef4-2df1-41be-803b-c399ae3d6cbd None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:46.467835 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23692b1e-4669-4344-b6ab-db1257f0d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:46.468514 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23692b1e-4669-4344-b6ab-db1257f0d870 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:46.468827 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23692b1e-4669-4344-b6ab-db1257f0d870 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:46.469104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23692b1e-4669-4344-b6ab-db1257f0d870 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:46.469841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23692b1e-4669-4344-b6ab-db1257f0d870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:46.470151 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23692b1e-4669-4344-b6ab-db1257f0d870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:46.471604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23692b1e-4669-4344-b6ab-db1257f0d870 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:46.497849 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 266/536] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:46.503042 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23692b1e-4669-4344-b6ab-db1257f0d870 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:46.510831 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce265c10-4587-41d3-ad7a-8d81e42ed5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:46.511512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce265c10-4587-41d3-ad7a-8d81e42ed5fa None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:46.511798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce265c10-4587-41d3-ad7a-8d81e42ed5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:46.512068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce265c10-4587-41d3-ad7a-8d81e42ed5fa None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:46.512901 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce265c10-4587-41d3-ad7a-8d81e42ed5fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:46.513758 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce265c10-4587-41d3-ad7a-8d81e42ed5fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:46.515206 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce265c10-4587-41d3-ad7a-8d81e42ed5fa None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:46.555880 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 271/537] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:01:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:46.562065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce265c10-4587-41d3-ad7a-8d81e42ed5fa None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:46.651268 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23692b1e-4669-4344-b6ab-db1257f0d870 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:46.672946 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:46.689308 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455ab6c-4fe1-48c8-9267-4635f4fac120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:46.690040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455ab6c-4fe1-48c8-9267-4635f4fac120 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:46.690327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455ab6c-4fe1-48c8-9267-4635f4fac120 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:46.690603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455ab6c-4fe1-48c8-9267-4635f4fac120 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:46.698035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455ab6c-4fe1-48c8-9267-4635f4fac120 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:46.699510 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455ab6c-4fe1-48c8-9267-4635f4fac120 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:46.718044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-a455ab6c-4fe1-48c8-9267-4635f4fac120 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:46.718044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:46.718044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:46.718044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:46.718044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:46.718044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:46.718044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:46.718044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:46.718044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:46.718044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:46.718044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:46.718044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:46.718044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:01:46.718044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:01:46.718044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:01:46.718933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:01:46.718933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:46.718933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:46.718933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:46.718933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:46.718933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:46.718933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:46.718933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:46.718933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:46.718933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:46.718933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:46.718933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:46.718933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:46.718933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:46.718933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:46.718933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:46.718933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:46.719760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:01:46.719760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:01:46.719760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:01:46.719760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:01:46.719760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:01:46.719760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:01:46.719760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:46.719760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:46.719760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 267/538] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:46.729525 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455ab6c-4fe1-48c8-9267-4635f4fac120 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:46.749553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce265c10-4587-41d3-ad7a-8d81e42ed5fa None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:46.821984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeae88a-202e-4a4a-badc-923cbae5fb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:46.822661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeae88a-202e-4a4a-badc-923cbae5fb2b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:46.822945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeae88a-202e-4a4a-badc-923cbae5fb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:46.823223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeae88a-202e-4a4a-badc-923cbae5fb2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:46.824069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeae88a-202e-4a4a-badc-923cbae5fb2b None admin] RBAC: Adding query filter params (role.id=6391321aa2bd4ed5980bebfc65f307a9, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=df008eed25464be387741ee7a1e5ce80) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:46.824381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeae88a-202e-4a4a-badc-923cbae5fb2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:46.826443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeae88a-202e-4a4a-badc-923cbae5fb2b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:46.841025 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 272/539] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:01:46 2022] GET /identity/v3/role_assignments?user.id=df008eed25464be387741ee7a1e5ce80&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=6391321aa2bd4ed5980bebfc65f307a9 => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:46.887104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455ab6c-4fe1-48c8-9267-4635f4fac120 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:46.925494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c383b5-d5ff-449b-b15c-74fc9d07ddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:46.926167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c383b5-d5ff-449b-b15c-74fc9d07ddcf None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:46.926449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c383b5-d5ff-449b-b15c-74fc9d07ddcf None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:46.926731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c383b5-d5ff-449b-b15c-74fc9d07ddcf None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:46.927531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c383b5-d5ff-449b-b15c-74fc9d07ddcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:46.927840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c383b5-d5ff-449b-b15c-74fc9d07ddcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:46.929316 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c383b5-d5ff-449b-b15c-74fc9d07ddcf None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:46.942915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 268/540] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:01:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:46.948810 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeae88a-202e-4a4a-badc-923cbae5fb2b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:46.983303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:47.099195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeae88a-202e-4a4a-badc-923cbae5fb2b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:47.149916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ee20b-4c40-4c5e-b943-871685d12969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:47.150581 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ee20b-4c40-4c5e-b943-871685d12969 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:47.150861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ee20b-4c40-4c5e-b943-871685d12969 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:47.151132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ee20b-4c40-4c5e-b943-871685d12969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:47.151973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ee20b-4c40-4c5e-b943-871685d12969 None admin] RBAC: Adding query filter params (role.id=6391321aa2bd4ed5980bebfc65f307a9, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=98ec4e37c2714729afec6ad805ed775a) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:47.152283 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ee20b-4c40-4c5e-b943-871685d12969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:47.153801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ee20b-4c40-4c5e-b943-871685d12969 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:47.159707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 273/541] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:01:46 2022] GET /identity/v3/role_assignments?user.id=98ec4e37c2714729afec6ad805ed775a&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=6391321aa2bd4ed5980bebfc65f307a9 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:47.512683 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf545ca-f1f8-46a9-ac9d-d2e7cc0c7273 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:47.513493 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf545ca-f1f8-46a9-ac9d-d2e7cc0c7273 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:47.514003 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf545ca-f1f8-46a9-ac9d-d2e7cc0c7273 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:47.515869 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 269/542] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:47.526142 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a47f09-0c58-47cd-affb-86d85b88e4eb None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:47.526738 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a47f09-0c58-47cd-affb-86d85b88e4eb None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:47.527207 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a47f09-0c58-47cd-affb-86d85b88e4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:47.549095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-41a47f09-0c58-47cd-affb-86d85b88e4eb None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:47.550627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-41a47f09-0c58-47cd-affb-86d85b88e4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:47.635746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 274/543] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:47.671584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf545ca-f1f8-46a9-ac9d-d2e7cc0c7273 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:47.715006 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:47.807615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf545ca-f1f8-46a9-ac9d-d2e7cc0c7273 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:47.858352 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9c2c5-f473-4495-b480-27a2d72b77ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:47.859557 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9c2c5-f473-4495-b480-27a2d72b77ed None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:47.860042 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9c2c5-f473-4495-b480-27a2d72b77ed None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:47.860513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9c2c5-f473-4495-b480-27a2d72b77ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:47.881490 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9c2c5-f473-4495-b480-27a2d72b77ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:47.890094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-60f9c2c5-f473-4495-b480-27a2d72b77ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:47.890094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:47.890094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:47.890094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:47.890094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:47.890094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:47.890094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:47.890094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:47.890094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:47.890094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:47.890094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:47.890094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:47.890094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:47.890094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:47.890094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:47.890094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:47.890947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:47.890947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:47.890947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:47.890947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:47.890947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:47.890947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:47.890947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:47.890947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:47.890947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:47.890947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:47.890947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:47.890947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:47.890947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:47.890947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:47.890947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:47.890947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:47.891721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:47.891721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:47.891721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:47.891721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:47.891721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:47.891721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:47.891721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:47.891721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:47.891721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:47.891721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:47.891721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:47.891721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:47.894239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 270/544] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:01:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:47.905743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a47f09-0c58-47cd-affb-86d85b88e4eb None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:47.940363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911aab3b-74e7-44d1-a55a-9ca3d672164e None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:47.941060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911aab3b-74e7-44d1-a55a-9ca3d672164e None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:47.941341 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911aab3b-74e7-44d1-a55a-9ca3d672164e None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:47.943061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 271/545] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:47.946776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:47.948925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c2d2-af08-4ddf-9fe9-e079b917fc0a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:47.949206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c2d2-af08-4ddf-9fe9-e079b917fc0a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:47.949484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c2d2-af08-4ddf-9fe9-e079b917fc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:47.974482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-5f37c2d2-af08-4ddf-9fe9-e079b917fc0a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:47.975679 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-5f37c2d2-af08-4ddf-9fe9-e079b917fc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:48.067997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a47f09-0c58-47cd-affb-86d85b88e4eb None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:48.106098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 272/546] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:48.121588 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7598e-eb44-44e8-984c-84a3f726e5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:48.122272 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7598e-eb44-44e8-984c-84a3f726e5ef None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:48.122588 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7598e-eb44-44e8-984c-84a3f726e5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:48.122868 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7598e-eb44-44e8-984c-84a3f726e5ef None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:48.123627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7598e-eb44-44e8-984c-84a3f726e5ef None admin] RBAC: Adding query filter params (name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:48.123937 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7598e-eb44-44e8-984c-84a3f726e5ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:48.125407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7598e-eb44-44e8-984c-84a3f726e5ef None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:48.134322 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 275/547] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:01:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:48.141288 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c2d2-af08-4ddf-9fe9-e079b917fc0a None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:48.142725 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7598e-eb44-44e8-984c-84a3f726e5ef None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:48.230215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:48.265067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c2d2-af08-4ddf-9fe9-e079b917fc0a None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:48.305358 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:48.316630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec9b5d-aac2-4ea1-bc84-c8c87c7fd95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:48.317436 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec9b5d-aac2-4ea1-bc84-c8c87c7fd95d None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:48.317715 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec9b5d-aac2-4ea1-bc84-c8c87c7fd95d None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:48.317989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec9b5d-aac2-4ea1-bc84-c8c87c7fd95d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:48.337429 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7598e-eb44-44e8-984c-84a3f726e5ef None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:48.342181 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec9b5d-aac2-4ea1-bc84-c8c87c7fd95d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:48.343718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec9b5d-aac2-4ea1-bc84-c8c87c7fd95d None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:48.381955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-87ec9b5d-aac2-4ea1-bc84-c8c87c7fd95d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:48.381955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:48.381955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:48.381955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:48.381955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:48.381955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:48.381955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:48.381955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:48.381955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:48.381955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:48.381955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:48.381955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:48.381955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:48.381955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:48.381955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:48.382846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:48.382846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:48.382846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:48.382846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:48.382846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:48.382846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:48.382846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:48.382846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:48.382846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:48.382846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:48.382846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:48.382846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:48.382846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:48.382846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:48.382846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:48.382846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:48.382846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:48.384173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:48.384173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:48.384173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:48.384173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:48.384173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 273/548] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:48.389468 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec9b5d-aac2-4ea1-bc84-c8c87c7fd95d None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:48.413326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94006201-572c-479f-b00c-cc362782b15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:48.414151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94006201-572c-479f-b00c-cc362782b15f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:48.414437 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94006201-572c-479f-b00c-cc362782b15f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:48.414713 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94006201-572c-479f-b00c-cc362782b15f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:48.457204 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94006201-572c-479f-b00c-cc362782b15f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:48.472939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:48.473090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-94006201-572c-479f-b00c-cc362782b15f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:48.473090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:48.473090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:48.473090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:48.473090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:48.473090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:48.473090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:48.473090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:48.473090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:48.473090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:48.473090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:48.473090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:48.473090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:48.473090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:48.473090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:48.473090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:48.474105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:48.474105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:48.474105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:48.474105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:48.474105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:48.474105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:48.474105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:48.474105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:48.474105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:48.474105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:48.474105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:48.474105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:48.474105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:48.474105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:48.474105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:48.474105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:48.474909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:48.474909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:48.474909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:48.474909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:48.474909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:48.474909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:48.474909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:48.474909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:48.474909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:48.474909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:48.474909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:48.474909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:48.474909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 276/549] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:01:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:48.481537 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94006201-572c-479f-b00c-cc362782b15f None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:48.495545 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec9b5d-aac2-4ea1-bc84-c8c87c7fd95d None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:48.536499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9df7a-28f4-4f0c-935b-848079f24501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:48.537209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9df7a-28f4-4f0c-935b-848079f24501 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:48.537494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9df7a-28f4-4f0c-935b-848079f24501 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:48.537775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9df7a-28f4-4f0c-935b-848079f24501 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:48.538513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9df7a-28f4-4f0c-935b-848079f24501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:48.538820 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9df7a-28f4-4f0c-935b-848079f24501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:48.540292 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9df7a-28f4-4f0c-935b-848079f24501 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:48.555872 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 274/550] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:48.565640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9df7a-28f4-4f0c-935b-848079f24501 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:48.730857 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94006201-572c-479f-b00c-cc362782b15f None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:48.766253 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9df7a-28f4-4f0c-935b-848079f24501 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:48.785077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe115b-9025-4a7b-b8c3-4c5135f092f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:48.785765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe115b-9025-4a7b-b8c3-4c5135f092f1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:48.786051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe115b-9025-4a7b-b8c3-4c5135f092f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:48.786331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe115b-9025-4a7b-b8c3-4c5135f092f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:48.787089 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe115b-9025-4a7b-b8c3-4c5135f092f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:48.787400 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe115b-9025-4a7b-b8c3-4c5135f092f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:48.789591 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe115b-9025-4a7b-b8c3-4c5135f092f1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:48.801058 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 277/551] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:01:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:48.802522 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d1203-8003-46df-b21c-055bddf8b484 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:48.802818 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d1203-8003-46df-b21c-055bddf8b484 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:48.803099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d1203-8003-46df-b21c-055bddf8b484 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:48.804376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 278/552] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:48.807004 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d1203-8003-46df-b21c-055bddf8b484 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:48.814040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fd51f-11c2-45d8-9c81-5664ffe63204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:48.814858 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fd51f-11c2-45d8-9c81-5664ffe63204 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:48.815144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fd51f-11c2-45d8-9c81-5664ffe63204 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:48.815419 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fd51f-11c2-45d8-9c81-5664ffe63204 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:48.819242 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:48.821802 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:48.825894 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3fd51f-11c2-45d8-9c81-5664ffe63204 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:48.828102 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3fd51f-11c2-45d8-9c81-5664ffe63204 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:48.846610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-2a3fd51f-11c2-45d8-9c81-5664ffe63204 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 21:01:48.846610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:48.846610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:48.846610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:48.846610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:48.846610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:48.846610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:48.846610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:48.846610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:48.846610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:48.846610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:48.846610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:48.846610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:01:48.846610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:01:48.846610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:01:48.846610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:01:48.847978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:48.847978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:48.847978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:01:48.847978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:48.847978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:01:48.847978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:48.847978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:48.847978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:48.847978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:48.847978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:48.847978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:48.847978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:48.847978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:48.847978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:48.847978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:48.847978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:48.847978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:48.847978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:48.850276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:48.850276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:48.850276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:01:48.850276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:01:48.850276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:01:48.850276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:01:48.850276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:01:48.850276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:01:48.850276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 21:01:48.850276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:48.850276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 275/553] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:01:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:48.854429 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82f351-8cdf-4a56-8aec-feb7d984a3df None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:48.854909 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82f351-8cdf-4a56-8aec-feb7d984a3df None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:48.855354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82f351-8cdf-4a56-8aec-feb7d984a3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:48.884636 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-ce82f351-8cdf-4a56-8aec-feb7d984a3df None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:48.886826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ce82f351-8cdf-4a56-8aec-feb7d984a3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:48.938764 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d1203-8003-46df-b21c-055bddf8b484 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:48.977023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 276/554] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:48.978064 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82f351-8cdf-4a56-8aec-feb7d984a3df None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:48.981431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ede1c-6517-4fdf-8973-0f3522aa580b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:48.983117 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ede1c-6517-4fdf-8973-0f3522aa580b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:48.984472 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ede1c-6517-4fdf-8973-0f3522aa580b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:48.984999 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ede1c-6517-4fdf-8973-0f3522aa580b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:48.998278 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ede1c-6517-4fdf-8973-0f3522aa580b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:49.000073 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ede1c-6517-4fdf-8973-0f3522aa580b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:49.025897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-0a2ede1c-6517-4fdf-8973-0f3522aa580b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:49.025897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:49.025897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:49.025897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:49.025897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:49.025897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:49.025897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:49.025897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:49.025897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:49.025897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:49.025897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:49.025897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:49.025897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:49.025897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:49.025897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:49.026815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:49.026815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:49.026815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:49.026815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:49.026815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:49.026815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:49.026815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:49.026815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:49.026815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:49.026815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:49.026815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:49.026815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:49.026815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:49.026815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:49.026815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:49.026815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:49.026815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:49.027668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:49.027668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:49.027668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:49.027668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:49.030684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 279/555] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:01:49.031805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ede1c-6517-4fdf-8973-0f3522aa580b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:49.106697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:49.123328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82f351-8cdf-4a56-8aec-feb7d984a3df None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:49.156402 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:49.163108 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ede1c-6517-4fdf-8973-0f3522aa580b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:49.166145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07848860-9d32-4de6-902a-f17760445cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:49.167097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848860-9d32-4de6-902a-f17760445cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:49.175555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848860-9d32-4de6-902a-f17760445cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:49.175555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848860-9d32-4de6-902a-f17760445cb1 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:49.175555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848860-9d32-4de6-902a-f17760445cb1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:49.175555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848860-9d32-4de6-902a-f17760445cb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:49.175555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848860-9d32-4de6-902a-f17760445cb1 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:49.191667 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 277/556] 10.222.0.66 () {56 vars in 1135 bytes} [Thu May 26 21:01:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:49.192923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07848860-9d32-4de6-902a-f17760445cb1 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:49.211133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa38ef7-d5fb-469a-873e-c6505c04d41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:49.211967 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa38ef7-d5fb-469a-873e-c6505c04d41e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:49.212379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa38ef7-d5fb-469a-873e-c6505c04d41e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:49.212718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa38ef7-d5fb-469a-873e-c6505c04d41e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:49.228897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa38ef7-d5fb-469a-873e-c6505c04d41e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:49.239863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-2fa38ef7-d5fb-469a-873e-c6505c04d41e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:49.239863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:49.239863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:49.239863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:49.239863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:49.239863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:49.239863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:49.239863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:49.239863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:49.239863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:49.239863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:49.239863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:49.239863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:49.239863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:49.239863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:49.239863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:49.240915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:49.240915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:49.240915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:49.240915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:49.240915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:49.240915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:49.240915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:49.240915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:49.240915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:49.240915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:49.240915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:49.240915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:49.240915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:49.240915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:49.240915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:49.240915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:49.242205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:49.242205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:49.242205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:49.242205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:49.242205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:49.242205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:49.242205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:49.242205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:49.242205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:49.242205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:49.242205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:49.242205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:49.246064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 280/557] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:01:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:49.247789 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa38ef7-d5fb-469a-873e-c6505c04d41e None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:49.319671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07848860-9d32-4de6-902a-f17760445cb1 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:49.360496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82583de-075d-41a4-9285-686b4a338233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:49.361639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82583de-075d-41a4-9285-686b4a338233 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:49.362332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82583de-075d-41a4-9285-686b4a338233 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:49.362904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82583de-075d-41a4-9285-686b4a338233 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:49.363890 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82583de-075d-41a4-9285-686b4a338233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:49.364421 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82583de-075d-41a4-9285-686b4a338233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:49.366170 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82583de-075d-41a4-9285-686b4a338233 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:49.383965 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa38ef7-d5fb-469a-873e-c6505c04d41e None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:49.384413 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 278/558] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:49.385685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82583de-075d-41a4-9285-686b4a338233 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:49.406232 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:49.424355 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54101ef2-1be5-46c2-9d39-0287cdab015a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:49.425459 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54101ef2-1be5-46c2-9d39-0287cdab015a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:49.425755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54101ef2-1be5-46c2-9d39-0287cdab015a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:49.426036 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54101ef2-1be5-46c2-9d39-0287cdab015a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:49.443453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:49.508049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82583de-075d-41a4-9285-686b4a338233 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:49.530141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54101ef2-1be5-46c2-9d39-0287cdab015a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:49.531605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54101ef2-1be5-46c2-9d39-0287cdab015a None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:49.552527 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5988c9-f25b-4192-aad5-d5f2f6df3fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:49.552527 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5988c9-f25b-4192-aad5-d5f2f6df3fdb None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:49.552527 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5988c9-f25b-4192-aad5-d5f2f6df3fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:49.552527 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5988c9-f25b-4192-aad5-d5f2f6df3fdb None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:49.552968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5988c9-f25b-4192-aad5-d5f2f6df3fdb None admin] RBAC: Adding query filter params (name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:49.552968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5988c9-f25b-4192-aad5-d5f2f6df3fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:49.553913 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5988c9-f25b-4192-aad5-d5f2f6df3fdb None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:49.563536 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 279/559] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:01:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:49.564479 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5988c9-f25b-4192-aad5-d5f2f6df3fdb None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:49.674571 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 281/560] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:49.677038 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54101ef2-1be5-46c2-9d39-0287cdab015a None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:49.696126 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5988c9-f25b-4192-aad5-d5f2f6df3fdb None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:49.702914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:49.705096 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:49.731353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7acfe-28a0-47ca-9bda-fbbbf6da8533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:49.732218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7acfe-28a0-47ca-9bda-fbbbf6da8533 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:49.732499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7acfe-28a0-47ca-9bda-fbbbf6da8533 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:49.732832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7acfe-28a0-47ca-9bda-fbbbf6da8533 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:49.740008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7acfe-28a0-47ca-9bda-fbbbf6da8533 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:49.741486 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7acfe-28a0-47ca-9bda-fbbbf6da8533 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:49.757291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-6fd7acfe-28a0-47ca-9bda-fbbbf6da8533 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 21:01:49.757291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:49.757291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:49.757291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:49.757291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:49.757291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:49.757291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:49.757291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:49.757291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:49.757291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:49.757291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:49.757291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:49.757291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:01:49.757291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:01:49.757291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:01:49.757291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:01:49.758331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:49.758331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:49.758331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:01:49.758331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:49.758331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:01:49.758331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:49.758331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:49.758331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:49.758331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:49.758331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:49.758331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:49.758331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:49.758331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:49.758331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:49.758331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:49.758331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:49.758331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:49.758331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:49.759254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:49.759254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:49.759254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:01:49.759254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:01:49.759254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:01:49.759254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:01:49.759254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:01:49.759254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:01:49.759254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 21:01:49.759254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:49.759254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 280/561] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:49.759254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7acfe-28a0-47ca-9bda-fbbbf6da8533 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:49.787515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54101ef2-1be5-46c2-9d39-0287cdab015a None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:49.822015 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859e0a8-ab12-442b-baae-f852032499ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:49.822805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859e0a8-ab12-442b-baae-f852032499ca None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:49.823088 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859e0a8-ab12-442b-baae-f852032499ca None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:49.823367 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859e0a8-ab12-442b-baae-f852032499ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:49.833939 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859e0a8-ab12-442b-baae-f852032499ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:49.835395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859e0a8-ab12-442b-baae-f852032499ca None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:49.852835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-5859e0a8-ab12-442b-baae-f852032499ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:49.852835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:49.852835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:49.852835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:49.852835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:49.852835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:49.852835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:49.852835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:49.852835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:49.852835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:49.852835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:49.852835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:49.852835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:49.852835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:49.852835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:49.853806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:49.853806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:49.853806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:49.853806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:49.853806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:49.853806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:49.853806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:49.853806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:49.853806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:49.853806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:49.853806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:49.853806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:49.853806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:49.853806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:49.853806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:49.853806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:49.853806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:49.854867 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:49.854867 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:49.854867 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:49.854867 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:49.854867 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 282/562] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:49.855655 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a56020-3d68-4aa1-a1ac-0e7353456730 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:49.855655 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a56020-3d68-4aa1-a1ac-0e7353456730 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:49.855876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a56020-3d68-4aa1-a1ac-0e7353456730 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:49.857430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 283/563] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:49.857868 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a56020-3d68-4aa1-a1ac-0e7353456730 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:49.868189 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7acfe-28a0-47ca-9bda-fbbbf6da8533 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:49.902503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc06814-073c-45f0-8ab3-8e909cbf1c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:49.903296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc06814-073c-45f0-8ab3-8e909cbf1c1f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:49.903588 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc06814-073c-45f0-8ab3-8e909cbf1c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:49.903877 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc06814-073c-45f0-8ab3-8e909cbf1c1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:49.913817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc06814-073c-45f0-8ab3-8e909cbf1c1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:49.915291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc06814-073c-45f0-8ab3-8e909cbf1c1f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:49.928951 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:49.932543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-cdc06814-073c-45f0-8ab3-8e909cbf1c1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:49.932543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:49.932543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:49.932543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:49.932543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:49.932543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:49.932543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:49.932543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:49.932543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:49.932543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:49.932543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:49.932543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:49.932543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:49.932543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:49.932543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:49.933544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:49.933544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:49.933544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:49.933544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:49.933544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:49.933544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:49.933544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:49.933544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:49.933544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:49.933544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:49.933544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:49.933544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:49.933544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:49.933544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:49.933544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:49.933544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:49.933544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:49.935726 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:49.935726 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:49.935726 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:49.935726 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:49.935726 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 281/564] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:49.936231 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912b77f-6690-4280-8b8f-afde1f644a10 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:49.936563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912b77f-6690-4280-8b8f-afde1f644a10 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:49.936781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912b77f-6690-4280-8b8f-afde1f644a10 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:49.938133 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 282/565] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:49.938750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912b77f-6690-4280-8b8f-afde1f644a10 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:49.959962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:49.963187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a56020-3d68-4aa1-a1ac-0e7353456730 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:49.996194 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8291edf-b77d-4b90-a843-e05974131994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:49.996889 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8291edf-b77d-4b90-a843-e05974131994 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:49.997170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8291edf-b77d-4b90-a843-e05974131994 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:49.997954 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8291edf-b77d-4b90-a843-e05974131994 None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:49.998830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8291edf-b77d-4b90-a843-e05974131994 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:49.999142 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8291edf-b77d-4b90-a843-e05974131994 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:50.000550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8291edf-b77d-4b90-a843-e05974131994 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:50.018239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 284/566] 10.222.0.66 () {56 vars in 1137 bytes} [Thu May 26 21:01:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:50.019222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff47fc-3d7e-4353-9d9f-de6e66c2ce83 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:50.019511 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff47fc-3d7e-4353-9d9f-de6e66c2ce83 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:50.019786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff47fc-3d7e-4353-9d9f-de6e66c2ce83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:50.035287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-52ff47fc-3d7e-4353-9d9f-de6e66c2ce83 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:50.036485 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-52ff47fc-3d7e-4353-9d9f-de6e66c2ce83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:50.043702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912b77f-6690-4280-8b8f-afde1f644a10 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:50.077614 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f645848-d6a9-4835-86e6-7ebc636fc319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:50.078277 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f645848-d6a9-4835-86e6-7ebc636fc319 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:50.078559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f645848-d6a9-4835-86e6-7ebc636fc319 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:50.078834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f645848-d6a9-4835-86e6-7ebc636fc319 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:50.079555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f645848-d6a9-4835-86e6-7ebc636fc319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:50.079863 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f645848-d6a9-4835-86e6-7ebc636fc319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:50.081266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f645848-d6a9-4835-86e6-7ebc636fc319 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:50.092149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 283/567] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:50.092976 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f645848-d6a9-4835-86e6-7ebc636fc319 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:50.103910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 285/568] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:50.103910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bd553-47b8-415e-b287-0e9d70859ec6 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:50.103910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bd553-47b8-415e-b287-0e9d70859ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:50.103910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bd553-47b8-415e-b287-0e9d70859ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:50.124117 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-d43bd553-47b8-415e-b287-0e9d70859ec6 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:50.125330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d43bd553-47b8-415e-b287-0e9d70859ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:50.170098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:50.180393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:50.191263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f645848-d6a9-4835-86e6-7ebc636fc319 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:50.192299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 286/569] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:50.192976 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bd553-47b8-415e-b287-0e9d70859ec6 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:50.230876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d73fa-bfbf-4e14-8cf3-db4bea4546b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:50.231547 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d73fa-bfbf-4e14-8cf3-db4bea4546b8 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:50.232478 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d73fa-bfbf-4e14-8cf3-db4bea4546b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:50.232837 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d73fa-bfbf-4e14-8cf3-db4bea4546b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:50.233567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d73fa-bfbf-4e14-8cf3-db4bea4546b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:50.233878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d73fa-bfbf-4e14-8cf3-db4bea4546b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:50.235254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d73fa-bfbf-4e14-8cf3-db4bea4546b8 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:50.246785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 284/570] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:50.248208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d73fa-bfbf-4e14-8cf3-db4bea4546b8 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:50.331191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bd553-47b8-415e-b287-0e9d70859ec6 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:50.357702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d73fa-bfbf-4e14-8cf3-db4bea4546b8 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:50.363859 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51998907-ff23-4cf3-9629-7d8431fc0cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:50.364680 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51998907-ff23-4cf3-9629-7d8431fc0cdc None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:50.364968 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51998907-ff23-4cf3-9629-7d8431fc0cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:50.365249 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51998907-ff23-4cf3-9629-7d8431fc0cdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:50.375729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51998907-ff23-4cf3-9629-7d8431fc0cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:50.377223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51998907-ff23-4cf3-9629-7d8431fc0cdc None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:50.390618 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436282b-e50e-414f-be16-52f5ca10376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:50.391406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436282b-e50e-414f-be16-52f5ca10376f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:50.391686 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436282b-e50e-414f-be16-52f5ca10376f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:50.391960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436282b-e50e-414f-be16-52f5ca10376f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:50.394466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-51998907-ff23-4cf3-9629-7d8431fc0cdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:50.394466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:50.394466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:50.394466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:50.394466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:50.394466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:50.394466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:50.394466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:50.394466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:50.394466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:50.394466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:50.394466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:50.394466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:50.394466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:50.394466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:50.395542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:50.395542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:50.395542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:50.395542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:50.395542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:50.395542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:50.395542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:50.395542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:50.395542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:50.395542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:50.395542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:50.395542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:50.395542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:50.395542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:50.395542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:50.395542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:50.395542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:50.396658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:50.396658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:50.396658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:50.396658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:50.396658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 287/571] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:50.396658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51998907-ff23-4cf3-9629-7d8431fc0cdc None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:50.401832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436282b-e50e-414f-be16-52f5ca10376f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:50.403279 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436282b-e50e-414f-be16-52f5ca10376f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:50.405101 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:50.418023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-8436282b-e50e-414f-be16-52f5ca10376f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 21:01:50.418023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:50.418023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:50.418023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:50.418023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:50.418023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:50.418023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:50.418023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:50.418023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:50.418023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:50.418023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:50.418023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:50.418023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:01:50.418023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:01:50.418023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:01:50.418023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:01:50.419155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:50.419155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:50.419155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:01:50.419155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:50.419155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:01:50.419155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:50.419155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:50.419155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:50.419155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:50.419155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:50.419155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:50.419155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:50.419155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:50.419155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:50.419155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:50.419155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:50.419155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:50.419155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:50.420840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:50.420840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:50.420840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:01:50.420840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:01:50.420840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:01:50.420840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:01:50.420840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:01:50.420840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:01:50.420840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 21:01:50.420840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:50.420840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 285/572] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:50.420840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436282b-e50e-414f-be16-52f5ca10376f None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:50.443324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:50.503478 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51998907-ff23-4cf3-9629-7d8431fc0cdc None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:50.520156 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436282b-e50e-414f-be16-52f5ca10376f None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:50.536785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce4e36-6cb3-4121-b235-7b9050195d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:50.537581 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce4e36-6cb3-4121-b235-7b9050195d8e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:50.537864 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce4e36-6cb3-4121-b235-7b9050195d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:50.538157 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce4e36-6cb3-4121-b235-7b9050195d8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:50.548564 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce4e36-6cb3-4121-b235-7b9050195d8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:50.556201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-cbce4e36-6cb3-4121-b235-7b9050195d8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:50.556201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:50.556201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:50.556201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:50.556201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:50.556201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:50.556201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:50.556201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:50.556201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:50.556201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:50.556201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:50.556201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:50.556201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:50.556201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:50.556201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:50.556201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:50.557325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:50.557325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:50.557325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:50.557325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:50.557325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:50.557325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:50.557325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:50.557325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:50.557325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:50.557325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:50.557325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:50.557325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:50.557325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:50.557325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:50.557325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:50.557325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:50.558325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:50.558325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:50.558325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:50.558325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:50.558325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:50.558325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:50.558325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:50.558325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:50.558325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:50.558325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:50.558325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:50.558325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:50.558325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 288/573] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:01:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:50.559134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce4e36-6cb3-4121-b235-7b9050195d8e None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:50.560256 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb74c9-62f5-4bc2-9612-b112204293ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:50.561145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb74c9-62f5-4bc2-9612-b112204293ab None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:50.561485 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb74c9-62f5-4bc2-9612-b112204293ab None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:50.562039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb74c9-62f5-4bc2-9612-b112204293ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:50.574084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb74c9-62f5-4bc2-9612-b112204293ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:50.581900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-d2eb74c9-62f5-4bc2-9612-b112204293ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:50.581900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:50.581900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:50.581900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:50.581900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:50.581900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:50.581900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:50.581900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:50.581900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:50.581900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:50.581900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:50.581900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:50.581900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:50.581900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:50.581900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:50.581900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:50.583018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:50.583018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:50.583018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:50.583018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:50.583018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:50.583018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:50.583018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:50.583018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:50.583018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:50.583018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:50.583018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:50.583018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:50.583018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:50.583018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:50.583018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:50.583018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:50.588977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:50.588977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:50.588977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:50.588977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:50.588977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:50.588977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:50.588977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:50.588977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:50.588977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:50.588977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:50.588977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:50.588977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:50.588977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 286/574] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:01:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:50.588977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb74c9-62f5-4bc2-9612-b112204293ab None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:50.645183 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:50.661794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce4e36-6cb3-4121-b235-7b9050195d8e None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:50.663325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:50.687589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb74c9-62f5-4bc2-9612-b112204293ab None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:50.694451 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3034f0-9baa-44b2-8d8f-75a540e94ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:50.695244 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3034f0-9baa-44b2-8d8f-75a540e94ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:50.695526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3034f0-9baa-44b2-8d8f-75a540e94ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:50.695803 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3034f0-9baa-44b2-8d8f-75a540e94ae0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:50.702702 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3034f0-9baa-44b2-8d8f-75a540e94ae0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:50.704154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3034f0-9baa-44b2-8d8f-75a540e94ae0 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:50.718921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-6e3034f0-9baa-44b2-8d8f-75a540e94ae0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:50.718921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:50.718921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:50.718921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:50.718921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:50.718921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:50.718921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:50.718921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:50.718921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:50.718921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:50.718921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:50.718921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:50.718921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:01:50.718921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:01:50.718921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:01:50.719765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:01:50.719765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:50.719765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:50.719765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:50.719765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:50.719765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:50.719765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:50.719765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:50.719765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:50.719765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:50.719765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:50.719765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:50.719765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:50.719765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:50.719765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:50.719765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:50.719765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:50.720675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:01:50.720675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:01:50.720675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:01:50.720675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:01:50.720675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:01:50.720675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:01:50.720675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:50.720675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:50.721116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3cfd4-8ca6-4c98-b20f-56dd2c824591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:50.721203 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 289/575] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:50.721271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3cfd4-8ca6-4c98-b20f-56dd2c824591 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:50.721271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3cfd4-8ca6-4c98-b20f-56dd2c824591 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:50.721400 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3034f0-9baa-44b2-8d8f-75a540e94ae0 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:50.721474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3cfd4-8ca6-4c98-b20f-56dd2c824591 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:50.722181 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3cfd4-8ca6-4c98-b20f-56dd2c824591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:50.722494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3cfd4-8ca6-4c98-b20f-56dd2c824591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:50.723877 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3cfd4-8ca6-4c98-b20f-56dd2c824591 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:50.736364 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 287/576] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:50.737211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3cfd4-8ca6-4c98-b20f-56dd2c824591 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:50.827229 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3034f0-9baa-44b2-8d8f-75a540e94ae0 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:50.833071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3cfd4-8ca6-4c98-b20f-56dd2c824591 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:50.850196 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:50.860635 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485399b1-e58d-4314-93c7-925c12860e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:50.861307 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485399b1-e58d-4314-93c7-925c12860e3d None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:50.861594 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485399b1-e58d-4314-93c7-925c12860e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:50.864459 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485399b1-e58d-4314-93c7-925c12860e3d None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:50.864459 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485399b1-e58d-4314-93c7-925c12860e3d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:50.864459 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485399b1-e58d-4314-93c7-925c12860e3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:50.864459 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485399b1-e58d-4314-93c7-925c12860e3d None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:50.866162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e380844-40e9-4ff4-bd4b-f802b5b42991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:50.866816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e380844-40e9-4ff4-bd4b-f802b5b42991 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:50.867112 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e380844-40e9-4ff4-bd4b-f802b5b42991 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:50.867385 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e380844-40e9-4ff4-bd4b-f802b5b42991 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:50.868131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e380844-40e9-4ff4-bd4b-f802b5b42991 None admin] RBAC: Adding query filter params (name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:50.868440 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e380844-40e9-4ff4-bd4b-f802b5b42991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:50.869835 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e380844-40e9-4ff4-bd4b-f802b5b42991 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:50.877657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 288/577] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:01:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:50.878455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e380844-40e9-4ff4-bd4b-f802b5b42991 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:50.890583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 290/578] 10.222.0.66 () {56 vars in 1137 bytes} [Thu May 26 21:01:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:50.890583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485399b1-e58d-4314-93c7-925c12860e3d None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:50.909268 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:50.976290 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e380844-40e9-4ff4-bd4b-f802b5b42991 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:50.984988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485399b1-e58d-4314-93c7-925c12860e3d None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:51.008075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691f6fd-c91b-440e-b861-d0dd1eff3748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:51.008776 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691f6fd-c91b-440e-b861-d0dd1eff3748 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:51.009069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691f6fd-c91b-440e-b861-d0dd1eff3748 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:51.009349 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691f6fd-c91b-440e-b861-d0dd1eff3748 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:51.010157 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691f6fd-c91b-440e-b861-d0dd1eff3748 None admin] RBAC: Adding query filter params (name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:51.010480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691f6fd-c91b-440e-b861-d0dd1eff3748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:51.011853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691f6fd-c91b-440e-b861-d0dd1eff3748 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:51.017552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ab818-7c7c-49f6-8a2b-33a3a900c575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:51.018278 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ab818-7c7c-49f6-8a2b-33a3a900c575 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:51.018487 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ab818-7c7c-49f6-8a2b-33a3a900c575 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:51.018758 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ab818-7c7c-49f6-8a2b-33a3a900c575 None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:51.019572 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ab818-7c7c-49f6-8a2b-33a3a900c575 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:51.019891 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ab818-7c7c-49f6-8a2b-33a3a900c575 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:51.020300 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 289/579] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:01:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:51.021141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691f6fd-c91b-440e-b861-d0dd1eff3748 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:51.021322 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ab818-7c7c-49f6-8a2b-33a3a900c575 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:51.035765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 291/580] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:01:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:51.037451 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ab818-7c7c-49f6-8a2b-33a3a900c575 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:51.063595 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:51.118591 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691f6fd-c91b-440e-b861-d0dd1eff3748 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:51.119025 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:51.137838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ab818-7c7c-49f6-8a2b-33a3a900c575 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:51.152013 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43679d-7d71-4697-8913-2882311a968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:51.152905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43679d-7d71-4697-8913-2882311a968e None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:51.153192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43679d-7d71-4697-8913-2882311a968e None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:51.153470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43679d-7d71-4697-8913-2882311a968e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:51.160634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43679d-7d71-4697-8913-2882311a968e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:51.162087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43679d-7d71-4697-8913-2882311a968e None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:51.171052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926a0e6-98ae-4c96-8be0-1d6efcab48f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:51.171839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926a0e6-98ae-4c96-8be0-1d6efcab48f4 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:51.172122 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926a0e6-98ae-4c96-8be0-1d6efcab48f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:51.172399 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926a0e6-98ae-4c96-8be0-1d6efcab48f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:51.175965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-0e43679d-7d71-4697-8913-2882311a968e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:51.175965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:51.175965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:51.175965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:51.175965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:51.175965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:51.175965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:51.175965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:51.175965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:51.175965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:51.175965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:51.175965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:51.175965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:01:51.175965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:01:51.175965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:01:51.176960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:01:51.176960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:51.176960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:51.176960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:51.176960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:51.176960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:51.176960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:51.176960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:51.176960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:51.176960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:51.176960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:51.176960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:51.176960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:51.176960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:51.176960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:51.176960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:51.176960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:51.177830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:01:51.177830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:01:51.177830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:01:51.177830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:01:51.177830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:01:51.177830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:01:51.177830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:51.177830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:51.177830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 290/581] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:51.178944 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43679d-7d71-4697-8913-2882311a968e None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:51.187316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926a0e6-98ae-4c96-8be0-1d6efcab48f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:51.189135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926a0e6-98ae-4c96-8be0-1d6efcab48f4 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:51.206774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-2926a0e6-98ae-4c96-8be0-1d6efcab48f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:51.206774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:51.206774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:51.206774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:51.206774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:51.206774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:51.206774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:51.206774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:51.206774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:51.206774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:51.206774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:51.206774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:51.206774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:51.206774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:51.206774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:51.212654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:51.212654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:51.212654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:51.212654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:51.212654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:51.212654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:51.212654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:51.212654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:51.212654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:51.212654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:51.212654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:51.212654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:51.212654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:51.212654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:51.212654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:51.212654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:51.212654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:51.213545 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:51.213545 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:51.213545 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:51.213545 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:51.213545 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 292/582] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:51.213545 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926a0e6-98ae-4c96-8be0-1d6efcab48f4 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:51.279929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43679d-7d71-4697-8913-2882311a968e None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:51.281488 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:51.307168 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926a0e6-98ae-4c96-8be0-1d6efcab48f4 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:51.315644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ef55b-fd33-4683-b05a-1908cc962fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:51.316443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ef55b-fd33-4683-b05a-1908cc962fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:51.317097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ef55b-fd33-4683-b05a-1908cc962fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:51.317382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ef55b-fd33-4683-b05a-1908cc962fa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:51.328213 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ef55b-fd33-4683-b05a-1908cc962fa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:51.329700 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ef55b-fd33-4683-b05a-1908cc962fa0 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:51.337140 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:51.341956 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d180e2a-1d60-4da4-bfe0-e8fdd1b1212b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:51.343677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d180e2a-1d60-4da4-bfe0-e8fdd1b1212b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:51.343677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d180e2a-1d60-4da4-bfe0-e8fdd1b1212b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:51.343677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d180e2a-1d60-4da4-bfe0-e8fdd1b1212b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:51.347140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-945ef55b-fd33-4683-b05a-1908cc962fa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:51.347140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:51.347140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:51.347140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:51.347140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:51.347140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:51.347140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:51.347140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:51.347140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:51.347140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:51.347140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:51.347140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:51.347140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:51.347140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:51.347140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:51.348138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:51.348138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:51.348138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:51.348138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:51.348138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:51.348138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:51.348138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:51.348138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:51.348138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:51.348138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:51.348138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:51.348138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:51.348138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:51.348138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:51.348138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:51.348138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:51.348138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:51.353635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:51.353635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:51.353635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:51.353635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:51.353635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 291/583] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:51.353635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ef55b-fd33-4683-b05a-1908cc962fa0 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:51.356498 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d180e2a-1d60-4da4-bfe0-e8fdd1b1212b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:51.358023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d180e2a-1d60-4da4-bfe0-e8fdd1b1212b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:51.375454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-8d180e2a-1d60-4da4-bfe0-e8fdd1b1212b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:51.375454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:51.375454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:51.375454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:51.375454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:51.375454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:51.375454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:51.375454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:51.375454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:51.375454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:51.375454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:51.375454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:51.375454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:51.375454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:51.375454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:51.376326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:51.376326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:51.376326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:51.376326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:51.376326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:51.376326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:51.376326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:51.376326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:51.376326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:51.376326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:51.376326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:51.376326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:51.376326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:51.376326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:51.376326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:51.376326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:51.376326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:51.377259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:51.377259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:51.377259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:51.377259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:51.377259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 293/584] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:51.377549 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d180e2a-1d60-4da4-bfe0-e8fdd1b1212b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:51.446873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ef55b-fd33-4683-b05a-1908cc962fa0 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:51.477983 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d180e2a-1d60-4da4-bfe0-e8fdd1b1212b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:51.479281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3fb9a-4833-40cf-8118-010d6408d997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:51.479923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3fb9a-4833-40cf-8118-010d6408d997 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:51.480199 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3fb9a-4833-40cf-8118-010d6408d997 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:51.480476 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3fb9a-4833-40cf-8118-010d6408d997 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:51.481355 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3fb9a-4833-40cf-8118-010d6408d997 None admin] RBAC: Adding query filter params (role.id=6391321aa2bd4ed5980bebfc65f307a9, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=6304e47844214d2db0acfae11e4714ee) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:51.481663 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3fb9a-4833-40cf-8118-010d6408d997 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:51.483075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3fb9a-4833-40cf-8118-010d6408d997 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:51.488331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 292/585] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:01:51 2022] GET /identity/v3/role_assignments?user.id=6304e47844214d2db0acfae11e4714ee&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=6391321aa2bd4ed5980bebfc65f307a9 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:51.489135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3fb9a-4833-40cf-8118-010d6408d997 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:51.517028 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac103a2a-ad51-4c19-9dfe-012e0b82d2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:51.517358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:51.517810 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac103a2a-ad51-4c19-9dfe-012e0b82d2dc None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:51.518102 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac103a2a-ad51-4c19-9dfe-012e0b82d2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:51.518385 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac103a2a-ad51-4c19-9dfe-012e0b82d2dc None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:51.519226 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac103a2a-ad51-4c19-9dfe-012e0b82d2dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:51.519541 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac103a2a-ad51-4c19-9dfe-012e0b82d2dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:51.521088 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac103a2a-ad51-4c19-9dfe-012e0b82d2dc None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:51.534731 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 294/586] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:01:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:51.535606 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac103a2a-ad51-4c19-9dfe-012e0b82d2dc None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:51.595324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:51.621436 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3fb9a-4833-40cf-8118-010d6408d997 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:51.658573 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac103a2a-ad51-4c19-9dfe-012e0b82d2dc None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:51.663119 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa0e69-3c56-49e5-814c-443f36cdde6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:51.663813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa0e69-3c56-49e5-814c-443f36cdde6a None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:51.664098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa0e69-3c56-49e5-814c-443f36cdde6a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:51.664377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa0e69-3c56-49e5-814c-443f36cdde6a None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:51.665160 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa0e69-3c56-49e5-814c-443f36cdde6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:51.665473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa0e69-3c56-49e5-814c-443f36cdde6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:51.667103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa0e69-3c56-49e5-814c-443f36cdde6a None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:51.682162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 293/587] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:51.683463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa0e69-3c56-49e5-814c-443f36cdde6a None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:51.700221 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc840c-6987-4a3d-9035-dddad3673deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:51.701011 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc840c-6987-4a3d-9035-dddad3673deb None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:51.701307 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc840c-6987-4a3d-9035-dddad3673deb None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:51.701587 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc840c-6987-4a3d-9035-dddad3673deb None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:51.702329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc840c-6987-4a3d-9035-dddad3673deb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:51.702642 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc840c-6987-4a3d-9035-dddad3673deb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:51.704028 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc840c-6987-4a3d-9035-dddad3673deb None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:51.716135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 295/588] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:51.717000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc840c-6987-4a3d-9035-dddad3673deb None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:51.779925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:51.801332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa0e69-3c56-49e5-814c-443f36cdde6a None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:51.825744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc840c-6987-4a3d-9035-dddad3673deb None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:51.828166 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:51.841576 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e336c-d828-45da-8b3d-a9cf25c0ccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:51.842271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e336c-d828-45da-8b3d-a9cf25c0ccdd None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:51.842558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e336c-d828-45da-8b3d-a9cf25c0ccdd None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:51.842839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e336c-d828-45da-8b3d-a9cf25c0ccdd None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:51.843585 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e336c-d828-45da-8b3d-a9cf25c0ccdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:51.843893 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e336c-d828-45da-8b3d-a9cf25c0ccdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:51.845306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e336c-d828-45da-8b3d-a9cf25c0ccdd None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:51.862192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 294/589] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:51.862192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e336c-d828-45da-8b3d-a9cf25c0ccdd None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:51.865224 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26e0df-1aa4-4d63-92b8-eae6764208c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:51.866133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26e0df-1aa4-4d63-92b8-eae6764208c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:51.866413 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26e0df-1aa4-4d63-92b8-eae6764208c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:51.866685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26e0df-1aa4-4d63-92b8-eae6764208c2 None admin] PATH_INFO: `/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/628bac94f0c54ac7a14ff19287efd8df/roles/6391321aa2bd4ed5980bebfc65f307a9` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:51.883318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26e0df-1aa4-4d63-92b8-eae6764208c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3db24bf0708446e9b05197fafeb00e4, user_id=628bac94f0c54ac7a14ff19287efd8df, role_id=6391321aa2bd4ed5980bebfc65f307a9)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:51.884790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26e0df-1aa4-4d63-92b8-eae6764208c2 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:51.957899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 296/590] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:01:51 2022] PUT /identity/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/628bac94f0c54ac7a14ff19287efd8df/roles/6391321aa2bd4ed5980bebfc65f307a9 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:01:51.958657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26e0df-1aa4-4d63-92b8-eae6764208c2 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:51.977207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e336c-d828-45da-8b3d-a9cf25c0ccdd None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:52.029124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a5454-7e29-4c7b-afd9-af9aee4e42e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:52.030369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a5454-7e29-4c7b-afd9-af9aee4e42e8 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:52.030808 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a5454-7e29-4c7b-afd9-af9aee4e42e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:52.031530 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a5454-7e29-4c7b-afd9-af9aee4e42e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:52.045437 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a5454-7e29-4c7b-afd9-af9aee4e42e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:52.048040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a5454-7e29-4c7b-afd9-af9aee4e42e8 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:52.050691 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:52.067769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-d89a5454-7e29-4c7b-afd9-af9aee4e42e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 21:01:52.067769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:52.067769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:52.067769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:52.067769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:52.067769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:52.067769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:52.067769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:52.067769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:52.067769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:52.067769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:52.067769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:52.067769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:01:52.067769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:01:52.067769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:01:52.067769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:01:52.068861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:52.068861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:52.068861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:01:52.068861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:52.068861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:01:52.068861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:52.068861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:52.068861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:52.068861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:52.068861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:52.068861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:52.068861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:52.068861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:52.068861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:52.068861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:52.068861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:52.068861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:52.068861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:52.069796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:52.069796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:52.069796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:01:52.069796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:01:52.069796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:01:52.069796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:01:52.069796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:01:52.069796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:01:52.069796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 21:01:52.069796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:52.076033 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 295/591] 10.222.0.66 () {56 vars in 1093 bytes} [Thu May 26 21:01:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:52.076033 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a5454-7e29-4c7b-afd9-af9aee4e42e8 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:52.103966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26e0df-1aa4-4d63-92b8-eae6764208c2 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:52.144375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2b5ca-a8f3-4cf1-934f-1577a128d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:52.145188 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2b5ca-a8f3-4cf1-934f-1577a128d250 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:52.145469 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2b5ca-a8f3-4cf1-934f-1577a128d250 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:52.145744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2b5ca-a8f3-4cf1-934f-1577a128d250 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:52.155144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2b5ca-a8f3-4cf1-934f-1577a128d250 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:52.156985 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2b5ca-a8f3-4cf1-934f-1577a128d250 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:52.173304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-cde2b5ca-a8f3-4cf1-934f-1577a128d250 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:52.173304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:52.173304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:52.173304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:52.173304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:52.173304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:52.173304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:52.173304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:52.173304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:52.173304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:52.173304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:52.173304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:52.173304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:01:52.173304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:01:52.173304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:01:52.174255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:01:52.174255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:52.174255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:52.174255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:52.174255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:52.174255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:52.174255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:52.174255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:52.174255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:52.174255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:52.174255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:52.174255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:52.174255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:52.174255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:52.174255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:52.174255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:52.174255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:52.175113 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:01:52.175113 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:01:52.175113 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:01:52.175113 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:01:52.175113 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:01:52.175113 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:01:52.175113 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:52.175113 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:52.175113 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 297/592] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:52.175830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2b5ca-a8f3-4cf1-934f-1577a128d250 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:52.193749 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:52.210076 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a5454-7e29-4c7b-afd9-af9aee4e42e8 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:52.250653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21a0bc-3052-46b2-9934-c99a4ebe9fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:52.251618 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21a0bc-3052-46b2-9934-c99a4ebe9fce None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:52.252721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21a0bc-3052-46b2-9934-c99a4ebe9fce None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:52.253006 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21a0bc-3052-46b2-9934-c99a4ebe9fce None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:52.261799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21a0bc-3052-46b2-9934-c99a4ebe9fce None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:52.263615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21a0bc-3052-46b2-9934-c99a4ebe9fce None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:52.285467 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2b5ca-a8f3-4cf1-934f-1577a128d250 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:52.285673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-fb21a0bc-3052-46b2-9934-c99a4ebe9fce None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 21:01:52.285673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:52.285673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:52.285673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:52.285673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:52.285673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:52.285673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:52.285673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:52.285673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:52.285673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:52.285673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:52.285673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:52.285673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:01:52.285673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:01:52.285673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:01:52.285673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:01:52.286758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:52.286758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:52.286758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:01:52.286758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:52.286758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:01:52.286758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:52.286758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:52.286758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:52.286758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:52.286758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:52.286758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:52.286758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:52.286758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:52.286758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:52.286758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:52.286758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:52.286758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:52.286758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:52.287770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:52.287770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:52.287770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:01:52.287770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:01:52.287770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:01:52.287770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:01:52.287770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:01:52.287770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:01:52.287770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 21:01:52.287770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:52.287770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 296/593] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:01:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:52.288340 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21a0bc-3052-46b2-9934-c99a4ebe9fce None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:52.336716 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d48b9-b05c-428e-9905-2e082ea82e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:52.337549 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d48b9-b05c-428e-9905-2e082ea82e54 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:52.338026 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d48b9-b05c-428e-9905-2e082ea82e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:52.338417 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d48b9-b05c-428e-9905-2e082ea82e54 None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:52.339417 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d48b9-b05c-428e-9905-2e082ea82e54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:52.339827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d48b9-b05c-428e-9905-2e082ea82e54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:52.341973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d48b9-b05c-428e-9905-2e082ea82e54 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:52.361989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 298/594] 10.222.0.66 () {56 vars in 1133 bytes} [Thu May 26 21:01:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:52.363067 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d48b9-b05c-428e-9905-2e082ea82e54 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:52.375944 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:52.433764 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21a0bc-3052-46b2-9934-c99a4ebe9fce None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:52.444924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:52.477760 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d48b9-b05c-428e-9905-2e082ea82e54 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:52.479042 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb72483-b4e9-4eed-b6ed-5c830b30e57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:52.480050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb72483-b4e9-4eed-b6ed-5c830b30e57d None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:52.480965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb72483-b4e9-4eed-b6ed-5c830b30e57d None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:52.484944 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb72483-b4e9-4eed-b6ed-5c830b30e57d None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:52.486418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb72483-b4e9-4eed-b6ed-5c830b30e57d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:52.486942 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb72483-b4e9-4eed-b6ed-5c830b30e57d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:52.489519 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb72483-b4e9-4eed-b6ed-5c830b30e57d None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:52.507341 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 297/595] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:01:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:52.508739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb72483-b4e9-4eed-b6ed-5c830b30e57d None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:52.515705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8b57e-f716-423a-a612-991c613dc3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:52.516432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8b57e-f716-423a-a612-991c613dc3ae None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:52.516896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8b57e-f716-423a-a612-991c613dc3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:52.517173 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8b57e-f716-423a-a612-991c613dc3ae None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:52.518021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8b57e-f716-423a-a612-991c613dc3ae None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:52.518329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8b57e-f716-423a-a612-991c613dc3ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:52.519821 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8b57e-f716-423a-a612-991c613dc3ae None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:52.542879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 299/596] 10.222.0.66 () {56 vars in 1139 bytes} [Thu May 26 21:01:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:52.542879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8b57e-f716-423a-a612-991c613dc3ae None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:52.653030 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb72483-b4e9-4eed-b6ed-5c830b30e57d None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:52.664316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8b57e-f716-423a-a612-991c613dc3ae None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:52.677476 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:52.696838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:52.703372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230984a-8e19-46a4-8f26-a451a70d0f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:52.704046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b29e4-5e4f-47cd-917c-8e0d1adf0a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:52.704733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230984a-8e19-46a4-8f26-a451a70d0f47 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:52.705180 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b29e4-5e4f-47cd-917c-8e0d1adf0a39 None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:52.705411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230984a-8e19-46a4-8f26-a451a70d0f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:52.705565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b29e4-5e4f-47cd-917c-8e0d1adf0a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:52.705968 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b29e4-5e4f-47cd-917c-8e0d1adf0a39 None admin] PATH_INFO: `/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/4561bdb2d75e4025a5d73ea713c690b3/roles/6391321aa2bd4ed5980bebfc65f307a9` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:52.706205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230984a-8e19-46a4-8f26-a451a70d0f47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:52.718212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230984a-8e19-46a4-8f26-a451a70d0f47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:52.721070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230984a-8e19-46a4-8f26-a451a70d0f47 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:52.723529 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b29e4-5e4f-47cd-917c-8e0d1adf0a39 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3db24bf0708446e9b05197fafeb00e4, user_id=4561bdb2d75e4025a5d73ea713c690b3, role_id=6391321aa2bd4ed5980bebfc65f307a9)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:52.725100 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b29e4-5e4f-47cd-917c-8e0d1adf0a39 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:52.739162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-0230984a-8e19-46a4-8f26-a451a70d0f47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:52.739162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:52.739162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:52.739162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:52.739162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:52.739162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:52.739162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:52.739162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:52.739162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:52.739162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:52.739162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:52.739162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:52.739162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:52.739162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:52.739162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:52.740330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:52.740330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:52.740330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:52.740330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:52.740330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:52.740330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:52.740330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:52.740330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:52.740330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:52.740330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:52.740330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:52.740330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:52.740330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:52.740330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:52.740330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:52.740330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:52.740330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:52.741925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:52.741925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:52.741925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:52.741925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:52.741925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 298/597] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:52.741925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230984a-8e19-46a4-8f26-a451a70d0f47 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:52.841348 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 300/598] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:01:52 2022] PUT /identity/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/4561bdb2d75e4025a5d73ea713c690b3/roles/6391321aa2bd4ed5980bebfc65f307a9 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:01:52.843034 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b29e4-5e4f-47cd-917c-8e0d1adf0a39 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:52.874681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230984a-8e19-46a4-8f26-a451a70d0f47 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:52.935571 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4061774-2432-4666-927e-20c917136d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:52.936860 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4061774-2432-4666-927e-20c917136d26 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:52.937472 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4061774-2432-4666-927e-20c917136d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:52.937971 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4061774-2432-4666-927e-20c917136d26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:52.952722 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4061774-2432-4666-927e-20c917136d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:52.954734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4061774-2432-4666-927e-20c917136d26 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:52.976626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-a4061774-2432-4666-927e-20c917136d26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:52.976626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:52.976626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:52.976626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:52.976626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:52.976626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:52.976626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:52.976626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:52.976626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:52.976626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:52.976626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:52.976626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:52.976626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:52.976626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:52.976626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:52.978071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:52.978071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:52.978071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:52.978071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:52.978071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:52.978071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:52.978071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:52.978071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:52.978071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:52.978071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:52.978071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:52.978071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:52.978071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:52.978071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:52.978071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:52.978071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:52.978071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:52.978962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:52.978962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:52.978962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:52.978962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:52.981382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 299/599] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:52.987174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4061774-2432-4666-927e-20c917136d26 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:53.015907 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:53.048976 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b29e4-5e4f-47cd-917c-8e0d1adf0a39 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:53.108619 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4061774-2432-4666-927e-20c917136d26 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:53.108845 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f8efe-9f27-4c1e-a68c-cefc902e214b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:53.109438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f8efe-9f27-4c1e-a68c-cefc902e214b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:53.109630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f8efe-9f27-4c1e-a68c-cefc902e214b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:53.109911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f8efe-9f27-4c1e-a68c-cefc902e214b None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:53.110647 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f8efe-9f27-4c1e-a68c-cefc902e214b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:53.110956 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f8efe-9f27-4c1e-a68c-cefc902e214b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:53.112335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f8efe-9f27-4c1e-a68c-cefc902e214b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:53.137413 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 301/600] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:53.138647 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f8efe-9f27-4c1e-a68c-cefc902e214b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:53.164263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b46d3-fd9f-4109-84e0-2895a50ba0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:53.165313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b46d3-fd9f-4109-84e0-2895a50ba0ac None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:53.165779 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b46d3-fd9f-4109-84e0-2895a50ba0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:53.166249 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b46d3-fd9f-4109-84e0-2895a50ba0ac None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:53.167192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b46d3-fd9f-4109-84e0-2895a50ba0ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:53.167696 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b46d3-fd9f-4109-84e0-2895a50ba0ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:53.169864 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b46d3-fd9f-4109-84e0-2895a50ba0ac None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:53.185719 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 300/601] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:53.191259 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b46d3-fd9f-4109-84e0-2895a50ba0ac None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:53.203298 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:53.260219 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f8efe-9f27-4c1e-a68c-cefc902e214b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:53.296078 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:53.296259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b97a2-7ea4-43ac-852a-3fad8a73cc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:53.296857 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b97a2-7ea4-43ac-852a-3fad8a73cc15 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:53.297132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b97a2-7ea4-43ac-852a-3fad8a73cc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:53.297409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b97a2-7ea4-43ac-852a-3fad8a73cc15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:53.304598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b97a2-7ea4-43ac-852a-3fad8a73cc15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:53.306053 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b97a2-7ea4-43ac-852a-3fad8a73cc15 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:53.316002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b46d3-fd9f-4109-84e0-2895a50ba0ac None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:53.321920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-596b97a2-7ea4-43ac-852a-3fad8a73cc15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:53.321920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:53.321920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:53.321920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:53.321920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:53.321920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:53.321920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:53.321920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:53.321920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:53.321920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:53.321920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:53.321920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:53.321920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:01:53.321920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:01:53.321920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:01:53.323059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:01:53.323059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:53.323059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:53.323059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:53.323059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:53.323059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:53.323059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:53.323059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:53.323059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:53.323059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:53.323059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:53.323059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:53.323059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:53.323059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:53.323059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:53.323059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:53.323059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:53.324148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:01:53.324148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:01:53.324148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:01:53.324148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:01:53.324148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:01:53.324148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:01:53.324148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:53.324148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:53.324148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 302/602] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:53.329610 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b97a2-7ea4-43ac-852a-3fad8a73cc15 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:53.379558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2d33a-c74d-4a53-8010-764d5e4d5286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:53.380366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2d33a-c74d-4a53-8010-764d5e4d5286 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:53.380675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2d33a-c74d-4a53-8010-764d5e4d5286 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:53.380979 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2d33a-c74d-4a53-8010-764d5e4d5286 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:53.396429 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2d33a-c74d-4a53-8010-764d5e4d5286 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:53.397943 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2d33a-c74d-4a53-8010-764d5e4d5286 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:53.435471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-ffa2d33a-c74d-4a53-8010-764d5e4d5286 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:53.435471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:53.435471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:53.435471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:53.435471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:53.435471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:53.435471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:53.435471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:53.435471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:53.435471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:53.435471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:53.435471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:53.435471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:01:53.435471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:01:53.435471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:01:53.436428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:01:53.436428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:53.436428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:53.436428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:53.436428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:53.436428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:53.436428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:53.436428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:53.436428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:53.436428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:53.436428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:53.436428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:53.436428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:53.436428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:53.436428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:53.436428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:53.436428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:53.437328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:01:53.437328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:01:53.437328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:01:53.437328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:01:53.437328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:01:53.437328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:01:53.437328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:53.437328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:53.437328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 301/603] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:01:53.443808 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2d33a-c74d-4a53-8010-764d5e4d5286 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:53.457124 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:53.462497 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b97a2-7ea4-43ac-852a-3fad8a73cc15 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:53.529370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93625432-487b-449a-af49-e2b8811b293d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:53.530041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93625432-487b-449a-af49-e2b8811b293d None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:53.530324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93625432-487b-449a-af49-e2b8811b293d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:53.530594 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93625432-487b-449a-af49-e2b8811b293d None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:53.531391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93625432-487b-449a-af49-e2b8811b293d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:53.531698 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93625432-487b-449a-af49-e2b8811b293d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:53.534212 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93625432-487b-449a-af49-e2b8811b293d None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:53.555840 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 303/604] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:01:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:53.559471 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93625432-487b-449a-af49-e2b8811b293d None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:53.638890 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2d33a-c74d-4a53-8010-764d5e4d5286 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:53.684865 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93625432-487b-449a-af49-e2b8811b293d None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:53.701467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a4baf-567b-4171-850f-145297658128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:53.702150 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a4baf-567b-4171-850f-145297658128 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:53.702432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a4baf-567b-4171-850f-145297658128 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:53.702707 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a4baf-567b-4171-850f-145297658128 None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:53.703511 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a4baf-567b-4171-850f-145297658128 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:53.703819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a4baf-567b-4171-850f-145297658128 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:53.705287 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a4baf-567b-4171-850f-145297658128 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:53.720392 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb7a5a-0af3-4011-bdd1-cc91c7558138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:53.721387 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb7a5a-0af3-4011-bdd1-cc91c7558138 None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:53.721681 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb7a5a-0af3-4011-bdd1-cc91c7558138 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:53.721969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb7a5a-0af3-4011-bdd1-cc91c7558138 None admin] PATH_INFO: `/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/df008eed25464be387741ee7a1e5ce80/roles/6391321aa2bd4ed5980bebfc65f307a9` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:53.728109 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 302/605] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:01:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:53.734444 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a4baf-567b-4171-850f-145297658128 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:53.738669 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb7a5a-0af3-4011-bdd1-cc91c7558138 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3db24bf0708446e9b05197fafeb00e4, user_id=df008eed25464be387741ee7a1e5ce80, role_id=6391321aa2bd4ed5980bebfc65f307a9)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:53.739416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:53.741451 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb7a5a-0af3-4011-bdd1-cc91c7558138 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:53.855186 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a4baf-567b-4171-850f-145297658128 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:53.856206 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 304/606] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:01:53 2022] PUT /identity/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/df008eed25464be387741ee7a1e5ce80/roles/6391321aa2bd4ed5980bebfc65f307a9 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:01:53.858027 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2903380-391a-4274-a591-7f783a4b231c None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:53.858321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2903380-391a-4274-a591-7f783a4b231c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:53.859774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2903380-391a-4274-a591-7f783a4b231c None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:53.861503 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 305/607] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:53.867992 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85eba7-c234-4fed-9a4c-4ea6c23598b8 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:53.868279 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85eba7-c234-4fed-9a4c-4ea6c23598b8 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:53.868564 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85eba7-c234-4fed-9a4c-4ea6c23598b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:53.893209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-2f85eba7-c234-4fed-9a4c-4ea6c23598b8 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:53.894650 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-2f85eba7-c234-4fed-9a4c-4ea6c23598b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:53.898736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:53.900886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccafe40-0353-4ed9-bbdd-de5da7166761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:53.902050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccafe40-0353-4ed9-bbdd-de5da7166761 None admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:53.902484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccafe40-0353-4ed9-bbdd-de5da7166761 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:53.902998 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccafe40-0353-4ed9-bbdd-de5da7166761 None admin] PATH_INFO: `/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/98ec4e37c2714729afec6ad805ed775a/roles/6391321aa2bd4ed5980bebfc65f307a9` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:53.922305 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccafe40-0353-4ed9-bbdd-de5da7166761 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3db24bf0708446e9b05197fafeb00e4, user_id=98ec4e37c2714729afec6ad805ed775a, role_id=6391321aa2bd4ed5980bebfc65f307a9)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:53.925877 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccafe40-0353-4ed9-bbdd-de5da7166761 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:53.976279 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 306/608] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:53.999421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85eba7-c234-4fed-9a4c-4ea6c23598b8 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:54.057001 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 303/609] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:01:53 2022] PUT /identity/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/98ec4e37c2714729afec6ad805ed775a/roles/6391321aa2bd4ed5980bebfc65f307a9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:01:54.137261 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85eba7-c234-4fed-9a4c-4ea6c23598b8 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:54.188715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff5450-4997-446d-8d07-d5c9e5ddaf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:54.189550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff5450-4997-446d-8d07-d5c9e5ddaf4e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:54.189837 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff5450-4997-446d-8d07-d5c9e5ddaf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:54.190117 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff5450-4997-446d-8d07-d5c9e5ddaf4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:54.202601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:54.212294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff5450-4997-446d-8d07-d5c9e5ddaf4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:54.220368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-bdff5450-4997-446d-8d07-d5c9e5ddaf4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:54.220368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:54.220368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:54.220368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:54.220368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:54.220368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:54.220368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:54.220368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:54.220368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:54.220368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:54.220368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:54.220368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:54.220368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:54.220368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:54.220368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:54.220368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:54.221339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:54.221339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:54.221339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:54.221339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:54.221339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:54.221339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:54.221339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:54.221339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:54.221339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:54.221339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:54.221339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:54.221339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:54.221339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:54.221339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:54.221339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:54.221339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:54.222770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:54.222770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:54.222770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:54.222770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:54.222770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:54.222770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:54.222770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:54.222770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:54.222770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:54.222770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:54.222770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:54.222770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:54.222770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 307/610] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:01:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:54.227671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccafe40-0353-4ed9-bbdd-de5da7166761 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:54.411757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:54.472800 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccafe40-0353-4ed9-bbdd-de5da7166761 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:54.523273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ff480-e408-42ba-b961-49cdd12347d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:54.524348 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff480-e408-42ba-b961-49cdd12347d5 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:54.524857 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff480-e408-42ba-b961-49cdd12347d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:54.525351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff480-e408-42ba-b961-49cdd12347d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:54.526338 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ff480-e408-42ba-b961-49cdd12347d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:54.526845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ff480-e408-42ba-b961-49cdd12347d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:54.528518 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ff480-e408-42ba-b961-49cdd12347d5 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:54.542814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 304/611] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:01:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:54.548659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff5450-4997-446d-8d07-d5c9e5ddaf4e None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:54.586893 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063cf31-9555-4c18-aa2b-aef9f2b75f6d None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:54.587526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063cf31-9555-4c18-aa2b-aef9f2b75f6d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:54.588011 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063cf31-9555-4c18-aa2b-aef9f2b75f6d None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:54.589850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 305/612] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:54.595259 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858d385-42ba-479b-8d2c-9cb3bc563460 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:54.595790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858d385-42ba-479b-8d2c-9cb3bc563460 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:54.596279 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858d385-42ba-479b-8d2c-9cb3bc563460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:54.614045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-b858d385-42ba-479b-8d2c-9cb3bc563460 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:54.615648 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b858d385-42ba-479b-8d2c-9cb3bc563460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:54.719781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff5450-4997-446d-8d07-d5c9e5ddaf4e None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:54.720319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 306/613] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:01:54.753976 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc59df-8002-495c-b734-3122652dc74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:54.754778 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc59df-8002-495c-b734-3122652dc74f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:54.755058 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc59df-8002-495c-b734-3122652dc74f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:54.755330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc59df-8002-495c-b734-3122652dc74f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:54.765889 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc59df-8002-495c-b734-3122652dc74f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:54.767341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc59df-8002-495c-b734-3122652dc74f None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:54.769811 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858d385-42ba-479b-8d2c-9cb3bc563460 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:54.785145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-42fc59df-8002-495c-b734-3122652dc74f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:54.785145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:54.785145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:54.785145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:54.785145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:54.785145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:54.785145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:54.785145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:54.785145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:54.785145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:54.785145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:54.785145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:54.785145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:54.785145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:54.785145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:54.786120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:54.786120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:54.786120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:54.786120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:54.786120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:54.786120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:54.786120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:54.786120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:54.786120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:54.786120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:54.786120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:54.786120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:54.786120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:54.786120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:54.786120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:54.786120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:54.786120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:54.787515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:54.787515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:54.787515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:54.787515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:54.787515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 308/614] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:54.792410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc59df-8002-495c-b734-3122652dc74f None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:54.854251 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:54.888714 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:54.933626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858d385-42ba-479b-8d2c-9cb3bc563460 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:54.972547 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc59df-8002-495c-b734-3122652dc74f None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:54.985872 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8833463-420d-48e4-a584-2e6a94dac963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:54.986680 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8833463-420d-48e4-a584-2e6a94dac963 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:54.986959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8833463-420d-48e4-a584-2e6a94dac963 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:54.987227 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8833463-420d-48e4-a584-2e6a94dac963 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:55.013176 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8833463-420d-48e4-a584-2e6a94dac963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:55.022830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-c8833463-420d-48e4-a584-2e6a94dac963 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:55.022830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:55.022830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:55.022830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:55.022830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:55.022830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:55.022830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:55.022830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:55.022830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:55.022830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:55.022830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:55.022830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:55.022830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:55.022830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:55.022830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:55.022830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:55.023792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:55.023792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:55.023792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:55.023792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:55.023792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:55.023792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:55.023792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:55.023792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:55.023792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:55.023792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:55.023792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:55.023792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:55.023792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:55.023792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:55.023792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:55.023792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:55.025053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:55.025053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:55.025053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:55.025053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:55.025053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:55.025053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:55.025053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:55.025053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:55.025053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:55.025053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:55.025053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:55.025053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:55.025053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 307/615] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:01:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:01:55.032322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8833463-420d-48e4-a584-2e6a94dac963 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:55.053931 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827a93a-3e28-4a69-b34f-f418464f6d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:55.054612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827a93a-3e28-4a69-b34f-f418464f6d46 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:55.054893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827a93a-3e28-4a69-b34f-f418464f6d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:55.055167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827a93a-3e28-4a69-b34f-f418464f6d46 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:55.055901 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827a93a-3e28-4a69-b34f-f418464f6d46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:55.056205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827a93a-3e28-4a69-b34f-f418464f6d46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:55.057599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827a93a-3e28-4a69-b34f-f418464f6d46 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:55.094885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 309/616] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:55.105580 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827a93a-3e28-4a69-b34f-f418464f6d46 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:55.143383 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8833463-420d-48e4-a584-2e6a94dac963 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:55.145869 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:55.183479 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b04a9-7f53-478d-a92e-4b6ce7e7ad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:55.184417 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b04a9-7f53-478d-a92e-4b6ce7e7ad44 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:55.184761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b04a9-7f53-478d-a92e-4b6ce7e7ad44 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:55.185046 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b04a9-7f53-478d-a92e-4b6ce7e7ad44 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:55.185804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b04a9-7f53-478d-a92e-4b6ce7e7ad44 None admin] RBAC: Adding query filter params (name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:55.186116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b04a9-7f53-478d-a92e-4b6ce7e7ad44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:55.187501 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b04a9-7f53-478d-a92e-4b6ce7e7ad44 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:55.207877 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 308/617] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:01:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:01:55.217562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b04a9-7f53-478d-a92e-4b6ce7e7ad44 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:55.301880 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827a93a-3e28-4a69-b34f-f418464f6d46 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:55.324916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:55.365894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08115c90-b490-4c17-b7b0-4104e84bf2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:55.366701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08115c90-b490-4c17-b7b0-4104e84bf2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:55.366981 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08115c90-b490-4c17-b7b0-4104e84bf2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:55.367256 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08115c90-b490-4c17-b7b0-4104e84bf2a1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:55.377712 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08115c90-b490-4c17-b7b0-4104e84bf2a1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:55.380973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08115c90-b490-4c17-b7b0-4104e84bf2a1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:55.390523 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b04a9-7f53-478d-a92e-4b6ce7e7ad44 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:55.410996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-08115c90-b490-4c17-b7b0-4104e84bf2a1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 21:01:55.410996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:55.410996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:55.410996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:55.410996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:55.410996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:55.410996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:55.410996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:55.410996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:55.410996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:55.410996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:55.410996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:55.410996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:01:55.410996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:01:55.410996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:01:55.410996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:01:55.412205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:55.412205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:55.412205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:01:55.412205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:55.412205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:01:55.412205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:55.412205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:55.412205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:55.412205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:55.412205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:55.412205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:55.412205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:55.412205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:55.412205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:55.412205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:55.412205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:55.412205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:55.412205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:55.413187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:55.413187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:55.413187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:01:55.413187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:01:55.413187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:01:55.413187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:01:55.413187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:01:55.413187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:01:55.413187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 21:01:55.413187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:55.414530 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 310/618] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:01:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:55.420119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08115c90-b490-4c17-b7b0-4104e84bf2a1 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:55.471837 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4d7cf-1205-454e-a3e1-aa8c14c92fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:55.472661 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4d7cf-1205-454e-a3e1-aa8c14c92fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:55.473112 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4d7cf-1205-454e-a3e1-aa8c14c92fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:55.473390 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4d7cf-1205-454e-a3e1-aa8c14c92fa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:55.494907 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4d7cf-1205-454e-a3e1-aa8c14c92fa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:55.496357 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4d7cf-1205-454e-a3e1-aa8c14c92fa2 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:55.529498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-4cd4d7cf-1205-454e-a3e1-aa8c14c92fa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:55.529498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:55.529498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:55.529498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:55.529498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:55.529498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:55.529498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:55.529498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:55.529498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:55.529498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:55.529498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:55.529498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:55.529498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:55.529498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:55.529498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:55.530461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:55.530461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:55.530461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:55.530461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:55.530461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:55.530461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:55.530461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:55.530461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:55.530461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:55.530461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:55.530461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:55.530461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:55.530461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:55.530461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:55.530461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:55.530461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:55.530461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:55.531358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:55.531358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:55.531358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:55.531358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:55.532138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 309/619] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:55.539085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4d7cf-1205-454e-a3e1-aa8c14c92fa2 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:55.582104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:55.609989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08115c90-b490-4c17-b7b0-4104e84bf2a1 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:55.670536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b9fe8-3845-4c12-84df-0cb61e548683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:55.671801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b9fe8-3845-4c12-84df-0cb61e548683 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:55.672158 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b9fe8-3845-4c12-84df-0cb61e548683 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:55.672507 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b9fe8-3845-4c12-84df-0cb61e548683 None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:55.673754 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b9fe8-3845-4c12-84df-0cb61e548683 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:55.674134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b9fe8-3845-4c12-84df-0cb61e548683 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:55.676575 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b9fe8-3845-4c12-84df-0cb61e548683 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:55.699133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 311/620] 10.222.0.66 () {56 vars in 1135 bytes} [Thu May 26 21:01:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:55.704624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b011b43-54f3-4841-b0b1-d581ade87364 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:55.704624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b011b43-54f3-4841-b0b1-d581ade87364 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:55.704624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b011b43-54f3-4841-b0b1-d581ade87364 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:55.704624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 312/621] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:55.708574 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b011b43-54f3-4841-b0b1-d581ade87364 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:55.717596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4d7cf-1205-454e-a3e1-aa8c14c92fa2 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:55.745702 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:55.761858 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b727065-6a30-4cad-acc1-6847c7e791e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:55.763692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b727065-6a30-4cad-acc1-6847c7e791e0 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:55.764154 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b727065-6a30-4cad-acc1-6847c7e791e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:55.764869 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b727065-6a30-4cad-acc1-6847c7e791e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:55.765805 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b727065-6a30-4cad-acc1-6847c7e791e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:55.766429 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b727065-6a30-4cad-acc1-6847c7e791e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:55.769161 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b727065-6a30-4cad-acc1-6847c7e791e0 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:55.784756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 310/622] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:55.786234 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d158bc2-2e62-46ef-b00c-94e9ffe87c29 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:55.786697 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d158bc2-2e62-46ef-b00c-94e9ffe87c29 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:55.787148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d158bc2-2e62-46ef-b00c-94e9ffe87c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:55.807049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-7d158bc2-2e62-46ef-b00c-94e9ffe87c29 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:55.809468 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-7d158bc2-2e62-46ef-b00c-94e9ffe87c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:55.835810 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b011b43-54f3-4841-b0b1-d581ade87364 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:55.884374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e53ff1-5f6c-4e2c-b644-a0f1029c50cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:55.885445 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e53ff1-5f6c-4e2c-b644-a0f1029c50cc None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:55.885726 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e53ff1-5f6c-4e2c-b644-a0f1029c50cc None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:55.885997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e53ff1-5f6c-4e2c-b644-a0f1029c50cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:55.898464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e53ff1-5f6c-4e2c-b644-a0f1029c50cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:55.899915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e53ff1-5f6c-4e2c-b644-a0f1029c50cc None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:55.908987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 311/623] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:55.909608 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d158bc2-2e62-46ef-b00c-94e9ffe87c29 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:55.928375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-c7e53ff1-5f6c-4e2c-b644-a0f1029c50cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:55.928375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:55.928375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:55.928375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:55.928375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:55.928375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:55.928375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:55.928375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:55.928375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:55.928375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:55.928375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:55.928375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:55.928375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:55.928375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:55.928375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:55.929338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:55.929338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:55.929338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:55.929338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:55.929338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:55.929338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:55.929338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:55.929338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:55.929338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:55.929338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:55.929338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:55.929338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:55.929338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:55.929338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:55.929338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:55.929338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:55.929338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:55.930197 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:55.930197 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:55.930197 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:55.930197 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:55.931593 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:55.931706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 313/624] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:55.933041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e53ff1-5f6c-4e2c-b644-a0f1029c50cc None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:56.029905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:56.030102 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d158bc2-2e62-46ef-b00c-94e9ffe87c29 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:56.050139 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e53ff1-5f6c-4e2c-b644-a0f1029c50cc None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:56.065248 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc466744-6150-4bd8-aa47-73714177c2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:56.066049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc466744-6150-4bd8-aa47-73714177c2ca None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:56.066330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc466744-6150-4bd8-aa47-73714177c2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:56.066597 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc466744-6150-4bd8-aa47-73714177c2ca None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:56.074445 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc466744-6150-4bd8-aa47-73714177c2ca None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:56.076839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc466744-6150-4bd8-aa47-73714177c2ca None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:56.091756 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153db3f-d4b8-4eb5-af13-66e3e5d7831e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:56.091959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-bc466744-6150-4bd8-aa47-73714177c2ca None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 21:01:56.091959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:56.091959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:56.091959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:56.091959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:56.091959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:56.091959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:56.091959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:56.091959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:56.091959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:56.091959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:56.091959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:56.091959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:01:56.091959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:01:56.091959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:01:56.091959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:01:56.092876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:56.092876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:56.092876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:01:56.092876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:56.092876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:01:56.092876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:56.092876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:56.092876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:56.092876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:56.092876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:56.092876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:56.092876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:56.092876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:56.092876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:56.092876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:56.092876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:56.092876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:56.092876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:56.094526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:56.094526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:56.094526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:01:56.094526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:01:56.094526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:01:56.094526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:01:56.094526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:01:56.094526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:01:56.094526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 21:01:56.094526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:56.094526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 312/625] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:56.094526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc466744-6150-4bd8-aa47-73714177c2ca None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:56.096369 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153db3f-d4b8-4eb5-af13-66e3e5d7831e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:56.096956 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153db3f-d4b8-4eb5-af13-66e3e5d7831e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:56.097594 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153db3f-d4b8-4eb5-af13-66e3e5d7831e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:56.110402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153db3f-d4b8-4eb5-af13-66e3e5d7831e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:56.119081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-4153db3f-d4b8-4eb5-af13-66e3e5d7831e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:56.119081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:56.119081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:56.119081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:56.119081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:56.119081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:56.119081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:56.119081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:56.119081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:56.119081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:56.119081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:56.119081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:56.119081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:56.119081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:56.119081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:56.119081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:56.120019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:56.120019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:56.120019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:56.120019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:56.120019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:56.120019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:56.120019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:56.120019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:56.120019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:56.120019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:56.120019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:56.120019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:56.120019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:56.120019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:56.120019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:56.120019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:56.121259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:56.121259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:56.121259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:56.121259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:56.121259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:56.121259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:56.121259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:56.121259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:56.121259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:56.121259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:56.121259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:56.121259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:56.128700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 314/626] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:01:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:56.129849 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153db3f-d4b8-4eb5-af13-66e3e5d7831e None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:56.163159 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:56.199147 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc466744-6150-4bd8-aa47-73714177c2ca None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:56.234614 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb5816-730b-4e15-b649-38f6b2650165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:56.235221 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb5816-730b-4e15-b649-38f6b2650165 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:56.235498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb5816-730b-4e15-b649-38f6b2650165 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:56.235771 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb5816-730b-4e15-b649-38f6b2650165 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:56.236612 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb5816-730b-4e15-b649-38f6b2650165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:56.236846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb5816-730b-4e15-b649-38f6b2650165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:56.238177 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb5816-730b-4e15-b649-38f6b2650165 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:56.246510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153db3f-d4b8-4eb5-af13-66e3e5d7831e None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:56.251472 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 313/627] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:56.252329 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb5816-730b-4e15-b649-38f6b2650165 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:56.285557 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947a55b-4828-44f4-a2a5-cb78fd0652d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:56.286593 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947a55b-4828-44f4-a2a5-cb78fd0652d9 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:56.287084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947a55b-4828-44f4-a2a5-cb78fd0652d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:56.287662 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947a55b-4828-44f4-a2a5-cb78fd0652d9 None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:56.288876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947a55b-4828-44f4-a2a5-cb78fd0652d9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:56.289408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947a55b-4828-44f4-a2a5-cb78fd0652d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:56.291096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947a55b-4828-44f4-a2a5-cb78fd0652d9 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:56.307290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:56.313867 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 315/628] 10.222.0.66 () {56 vars in 1137 bytes} [Thu May 26 21:01:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:56.315124 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947a55b-4828-44f4-a2a5-cb78fd0652d9 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:56.361557 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb5816-730b-4e15-b649-38f6b2650165 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:56.392724 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:56.402372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04447381-32a6-492d-ad00-a090ac3b6f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:56.410812 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04447381-32a6-492d-ad00-a090ac3b6f33 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:56.410812 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04447381-32a6-492d-ad00-a090ac3b6f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:56.410812 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04447381-32a6-492d-ad00-a090ac3b6f33 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:56.410812 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04447381-32a6-492d-ad00-a090ac3b6f33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:56.410812 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04447381-32a6-492d-ad00-a090ac3b6f33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:56.410812 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04447381-32a6-492d-ad00-a090ac3b6f33 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:56.415966 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 314/629] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:01:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:56.417033 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04447381-32a6-492d-ad00-a090ac3b6f33 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:56.441752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947a55b-4828-44f4-a2a5-cb78fd0652d9 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:56.479185 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0299ef-ff3b-472b-9600-6962ceb92f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:56.480083 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0299ef-ff3b-472b-9600-6962ceb92f9b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:56.480456 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0299ef-ff3b-472b-9600-6962ceb92f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:56.480821 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0299ef-ff3b-472b-9600-6962ceb92f9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:56.489089 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0299ef-ff3b-472b-9600-6962ceb92f9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:56.490689 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0299ef-ff3b-472b-9600-6962ceb92f9b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:56.505380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-2f0299ef-ff3b-472b-9600-6962ceb92f9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:56.505380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:56.505380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:56.505380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:56.505380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:56.505380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:56.505380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:56.505380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:56.505380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:56.505380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:56.505380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:56.505380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:56.505380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:01:56.505380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:01:56.505380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:01:56.506339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:01:56.506339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:56.506339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:56.506339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:56.506339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:56.506339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:56.506339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:56.506339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:56.506339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:56.506339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:56.506339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:56.506339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:56.506339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:56.506339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:56.506339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:56.506339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:56.506339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:56.507230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:01:56.507230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:01:56.507230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:01:56.507230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:01:56.507230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:01:56.507230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:01:56.507230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:56.507230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:56.507230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 316/630] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:56.508072 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0299ef-ff3b-472b-9600-6962ceb92f9b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:56.546478 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04447381-32a6-492d-ad00-a090ac3b6f33 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:56.571703 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:56.586504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa0198-7642-4f22-a541-4837e18aca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:56.587158 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa0198-7642-4f22-a541-4837e18aca39 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:56.588418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa0198-7642-4f22-a541-4837e18aca39 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:56.588418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa0198-7642-4f22-a541-4837e18aca39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:56.617236 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0299ef-ff3b-472b-9600-6962ceb92f9b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:56.644324 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:56.651257 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafc15e-6dca-4e69-a8ad-59b0bcd17dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:56.652047 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafc15e-6dca-4e69-a8ad-59b0bcd17dff None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:56.652335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafc15e-6dca-4e69-a8ad-59b0bcd17dff None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:56.652643 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafc15e-6dca-4e69-a8ad-59b0bcd17dff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:56.654570 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa0198-7642-4f22-a541-4837e18aca39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:56.656029 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa0198-7642-4f22-a541-4837e18aca39 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:56.663364 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafc15e-6dca-4e69-a8ad-59b0bcd17dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:56.664827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafc15e-6dca-4e69-a8ad-59b0bcd17dff None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:56.681546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-bfafc15e-6dca-4e69-a8ad-59b0bcd17dff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:56.681546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:56.681546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:56.681546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:56.681546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:56.681546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:56.681546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:56.681546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:56.681546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:56.681546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:56.681546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:56.681546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:56.681546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:56.681546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:56.681546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:56.682510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:56.682510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:56.682510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:56.682510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:56.682510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:56.682510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:56.682510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:56.682510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:56.682510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:56.682510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:56.682510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:56.682510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:56.682510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:56.682510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:56.682510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:56.682510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:56.682510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:56.683409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:56.683409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:56.683409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:56.683409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:56.683409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 317/631] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:56.683691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafc15e-6dca-4e69-a8ad-59b0bcd17dff None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:56.759394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 315/632] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:56.761024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce22f69-6a84-4011-929f-e5d639116c21 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:56.761318 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce22f69-6a84-4011-929f-e5d639116c21 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:56.761596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce22f69-6a84-4011-929f-e5d639116c21 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:56.763428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 316/633] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:56.764633 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6191b-aa00-4b3a-ae3b-a13e67337298 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:56.764874 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6191b-aa00-4b3a-ae3b-a13e67337298 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:56.765149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6191b-aa00-4b3a-ae3b-a13e67337298 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:56.766358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 317/634] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:56.767057 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6191b-aa00-4b3a-ae3b-a13e67337298 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:56.791001 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafc15e-6dca-4e69-a8ad-59b0bcd17dff None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:56.804214 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:56.826327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126bbcd-1e63-4d7e-bdd1-90875cb5ed9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:56.827207 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126bbcd-1e63-4d7e-bdd1-90875cb5ed9d None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:56.827497 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126bbcd-1e63-4d7e-bdd1-90875cb5ed9d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:56.827775 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126bbcd-1e63-4d7e-bdd1-90875cb5ed9d None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:56.828571 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126bbcd-1e63-4d7e-bdd1-90875cb5ed9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:56.828909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126bbcd-1e63-4d7e-bdd1-90875cb5ed9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:56.830345 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126bbcd-1e63-4d7e-bdd1-90875cb5ed9d None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:56.842418 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 318/635] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:01:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:56.843236 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126bbcd-1e63-4d7e-bdd1-90875cb5ed9d None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:56.859012 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:56.872794 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6191b-aa00-4b3a-ae3b-a13e67337298 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:56.904770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c67770-7540-4399-8302-097833860bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:56.905432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c67770-7540-4399-8302-097833860bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:56.905718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c67770-7540-4399-8302-097833860bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:56.905993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c67770-7540-4399-8302-097833860bd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:56.906714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c67770-7540-4399-8302-097833860bd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:56.907020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c67770-7540-4399-8302-097833860bd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:56.908427 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c67770-7540-4399-8302-097833860bd5 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:56.919916 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 318/636] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:56.921158 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55143c27-e7b3-4819-b5b7-e8fa7861a4f6 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:56.921447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55143c27-e7b3-4819-b5b7-e8fa7861a4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:56.921727 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55143c27-e7b3-4819-b5b7-e8fa7861a4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:56.938163 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-55143c27-e7b3-4819-b5b7-e8fa7861a4f6 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:56.939353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-55143c27-e7b3-4819-b5b7-e8fa7861a4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:56.945968 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126bbcd-1e63-4d7e-bdd1-90875cb5ed9d None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:56.978416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b686e-1c7a-49cf-bf20-e8346e0e71ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:56.979214 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b686e-1c7a-49cf-bf20-e8346e0e71ac None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:56.979498 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b686e-1c7a-49cf-bf20-e8346e0e71ac None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:56.979772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b686e-1c7a-49cf-bf20-e8346e0e71ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:56.990224 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b686e-1c7a-49cf-bf20-e8346e0e71ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:56.991669 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b686e-1c7a-49cf-bf20-e8346e0e71ac None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:57.005425 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 319/637] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:57.006722 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ece93a-f8aa-4c59-b633-e56f4e7782a4 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:57.007011 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ece93a-f8aa-4c59-b633-e56f4e7782a4 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:57.007289 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ece93a-f8aa-4c59-b633-e56f4e7782a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:57.009820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-d15b686e-1c7a-49cf-bf20-e8346e0e71ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:57.009820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:57.009820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:57.009820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:57.009820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:57.009820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:57.009820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:57.009820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:57.009820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:57.009820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:57.009820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:57.009820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:57.009820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:57.009820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:57.009820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:57.010871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:57.010871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:57.010871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:57.010871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:57.010871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:57.010871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:57.010871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:57.010871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:57.010871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:57.010871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:57.010871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:57.010871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:57.010871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:57.010871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:57.010871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:57.010871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:57.010871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:57.011790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:57.011790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:57.011790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:57.011790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:57.011790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 319/638] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:57.011790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b686e-1c7a-49cf-bf20-e8346e0e71ac None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:57.030241 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-81ece93a-f8aa-4c59-b633-e56f4e7782a4 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:57.031432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-81ece93a-f8aa-4c59-b633-e56f4e7782a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:57.041037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:57.097623 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 320/639] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:01:57.098844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ece93a-f8aa-4c59-b633-e56f4e7782a4 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:57.110617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:57.118660 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b686e-1c7a-49cf-bf20-e8346e0e71ac None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:57.154271 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b050042-7d34-4688-a314-e0bf3d6206c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:57.155095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b050042-7d34-4688-a314-e0bf3d6206c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:57.155379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b050042-7d34-4688-a314-e0bf3d6206c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:57.155655 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b050042-7d34-4688-a314-e0bf3d6206c4 None admin] PATH_INFO: `/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/6304e47844214d2db0acfae11e4714ee/roles/6391321aa2bd4ed5980bebfc65f307a9` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:57.170599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b050042-7d34-4688-a314-e0bf3d6206c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3db24bf0708446e9b05197fafeb00e4, user_id=6304e47844214d2db0acfae11e4714ee, role_id=6391321aa2bd4ed5980bebfc65f307a9)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:57.172047 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b050042-7d34-4688-a314-e0bf3d6206c4 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:57.197120 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ece93a-f8aa-4c59-b633-e56f4e7782a4 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:57.230498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603a8f2-7336-4ff1-b40e-415b06ed3cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:57.231295 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603a8f2-7336-4ff1-b40e-415b06ed3cce None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:57.232244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603a8f2-7336-4ff1-b40e-415b06ed3cce None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:57.232478 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603a8f2-7336-4ff1-b40e-415b06ed3cce None admin] PATH_INFO: `/v3/users/glance` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:57.232874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 320/640] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:01:57 2022] PUT /identity/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/6304e47844214d2db0acfae11e4714ee/roles/6391321aa2bd4ed5980bebfc65f307a9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:01:57.233736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b050042-7d34-4688-a314-e0bf3d6206c4 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:57.246643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603a8f2-7336-4ff1-b40e-415b06ed3cce None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:57.248181 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603a8f2-7336-4ff1-b40e-415b06ed3cce None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:57.264297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-c603a8f2-7336-4ff1-b40e-415b06ed3cce None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 21:01:57.264297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:57.264297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:57.264297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:57.264297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:57.264297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:57.264297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:57.264297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:57.264297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:57.264297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:57.264297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:57.264297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:57.264297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:01:57.264297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:01:57.264297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:01:57.264297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:01:57.267980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:57.267980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:57.267980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:01:57.267980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:57.267980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:01:57.267980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:57.267980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:57.267980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:57.267980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:57.267980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:57.267980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:57.267980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:57.267980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:57.267980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:57.267980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:57.267980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:57.267980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:57.267980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:57.268997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:57.268997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:57.268997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:01:57.268997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:01:57.268997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:01:57.268997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:01:57.268997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:01:57.268997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:01:57.268997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 21:01:57.268997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:57.268997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 321/641] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:01:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:57.268997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603a8f2-7336-4ff1-b40e-415b06ed3cce None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:57.336717 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:57.349130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:57.367536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b050042-7d34-4688-a314-e0bf3d6206c4 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:57.383465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603a8f2-7336-4ff1-b40e-415b06ed3cce None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:57.406207 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180d8db-eea7-45e8-9d61-7374be7f17f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:57.406803 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180d8db-eea7-45e8-9d61-7374be7f17f9 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:57.407095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180d8db-eea7-45e8-9d61-7374be7f17f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:57.407372 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180d8db-eea7-45e8-9d61-7374be7f17f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:57.408117 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180d8db-eea7-45e8-9d61-7374be7f17f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:57.408427 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180d8db-eea7-45e8-9d61-7374be7f17f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:57.409893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180d8db-eea7-45e8-9d61-7374be7f17f9 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:57.423535 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 321/642] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:57.423976 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180d8db-eea7-45e8-9d61-7374be7f17f9 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:57.427985 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb11bf9-fadb-4719-bcd4-80bdff1898ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:57.429915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb11bf9-fadb-4719-bcd4-80bdff1898ad None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:57.429915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb11bf9-fadb-4719-bcd4-80bdff1898ad None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:57.429915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb11bf9-fadb-4719-bcd4-80bdff1898ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:57.443049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb11bf9-fadb-4719-bcd4-80bdff1898ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:57.450912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-2bb11bf9-fadb-4719-bcd4-80bdff1898ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:57.450912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:57.450912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:57.450912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:57.450912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:57.450912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:57.450912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:57.450912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:57.450912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:57.450912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:57.450912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:57.450912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:57.450912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:57.450912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:57.450912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:57.450912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:57.451969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:57.451969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:57.451969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:57.451969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:57.451969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:57.451969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:57.451969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:57.451969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:57.451969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:57.451969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:57.451969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:57.451969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:57.451969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:57.451969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:57.451969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:57.451969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:57.453539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:57.453539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:57.453539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:57.453539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:57.453539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:57.453539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:57.453539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:57.453539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:57.453539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:57.453539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:57.453539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:57.453539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:57.453539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 322/643] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:01:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:57.453539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb11bf9-fadb-4719-bcd4-80bdff1898ad None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:57.536546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180d8db-eea7-45e8-9d61-7374be7f17f9 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:57.558792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb11bf9-fadb-4719-bcd4-80bdff1898ad None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:57.575856 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485fed1-a265-414d-80b1-ab4ab03789dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:57.576960 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485fed1-a265-414d-80b1-ab4ab03789dd None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:57.577389 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485fed1-a265-414d-80b1-ab4ab03789dd None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:57.577808 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485fed1-a265-414d-80b1-ab4ab03789dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:57.580078 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:57.589279 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485fed1-a265-414d-80b1-ab4ab03789dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:01:57.594179 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:57.598051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-d485fed1-a265-414d-80b1-ab4ab03789dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:57.598051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:57.598051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:57.598051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:57.598051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:57.598051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:57.598051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:57.598051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:57.598051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:57.598051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:57.598051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:57.598051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:57.598051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:01:57.598051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:01:57.598051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:01:57.598051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:01:57.599033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:01:57.599033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:01:57.599033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:01:57.599033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:01:57.599033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:57.599033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:57.599033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:57.599033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:57.599033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:57.599033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:57.599033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:57.599033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:57.599033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:57.599033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:57.599033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:57.599033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:57.600552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:57.600552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:57.600552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:57.600552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:57.600552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:01:57.600552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:01:57.600552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:01:57.600552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:01:57.600552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:01:57.600552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:01:57.600552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:01:57.600552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:57.600552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 322/644] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:01:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:57.602930 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d866a-ec0c-43bc-b866-833239afe231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:57.603623 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d866a-ec0c-43bc-b866-833239afe231 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:57.604190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d866a-ec0c-43bc-b866-833239afe231 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:57.604484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d866a-ec0c-43bc-b866-833239afe231 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:57.604865 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485fed1-a265-414d-80b1-ab4ab03789dd None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:57.605418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d866a-ec0c-43bc-b866-833239afe231 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:57.605733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d866a-ec0c-43bc-b866-833239afe231 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:57.607208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d866a-ec0c-43bc-b866-833239afe231 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:57.625968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 323/645] 10.222.0.66 () {56 vars in 1137 bytes} [Thu May 26 21:01:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:57.627296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d866a-ec0c-43bc-b866-833239afe231 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:57.714624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485fed1-a265-414d-80b1-ab4ab03789dd None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:57.731393 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d866a-ec0c-43bc-b866-833239afe231 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:57.750714 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4c13b-2585-4ff9-9e49-f25d204fefb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:57.751523 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4c13b-2585-4ff9-9e49-f25d204fefb6 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:57.751808 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4c13b-2585-4ff9-9e49-f25d204fefb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:57.752083 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4c13b-2585-4ff9-9e49-f25d204fefb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:57.759095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4c13b-2585-4ff9-9e49-f25d204fefb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:57.760613 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4c13b-2585-4ff9-9e49-f25d204fefb6 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:57.768515 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441c12a-3860-4d22-9ab5-88b13a9c0941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:57.769220 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441c12a-3860-4d22-9ab5-88b13a9c0941 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:57.769505 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441c12a-3860-4d22-9ab5-88b13a9c0941 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:57.769785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441c12a-3860-4d22-9ab5-88b13a9c0941 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:57.770535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441c12a-3860-4d22-9ab5-88b13a9c0941 None admin] RBAC: Adding query filter params (name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:57.770846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441c12a-3860-4d22-9ab5-88b13a9c0941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:57.772208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441c12a-3860-4d22-9ab5-88b13a9c0941 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:57.776045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-f2a4c13b-2585-4ff9-9e49-f25d204fefb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:57.776045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:57.776045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:57.776045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:57.776045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:57.776045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:57.776045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:57.776045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:57.776045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:57.776045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:57.776045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:57.776045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:57.776045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:01:57.776045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:01:57.776045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:01:57.776922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:01:57.776922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:57.776922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:57.776922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:57.776922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:57.776922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:57.776922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:57.776922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:57.776922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:57.776922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:57.776922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:57.776922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:57.776922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:57.776922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:57.776922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:57.776922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:57.776922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:57.777798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:01:57.777798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:01:57.777798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:01:57.777798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:01:57.777798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:01:57.777798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:01:57.777798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:57.777798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:57.777798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 323/646] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:57.778337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4c13b-2585-4ff9-9e49-f25d204fefb6 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:57.789937 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 324/647] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:01:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:57.789937 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441c12a-3860-4d22-9ab5-88b13a9c0941 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:57.841379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:57.842739 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:57.890832 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4c13b-2585-4ff9-9e49-f25d204fefb6 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:57.893956 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441c12a-3860-4d22-9ab5-88b13a9c0941 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:57.927779 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb73922-eb61-4ee2-9333-19048488f928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:57.928466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb73922-eb61-4ee2-9333-19048488f928 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:57.928784 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb73922-eb61-4ee2-9333-19048488f928 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:57.929059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb73922-eb61-4ee2-9333-19048488f928 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:57.929817 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb73922-eb61-4ee2-9333-19048488f928 None admin] RBAC: Adding query filter params (name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:57.930129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb73922-eb61-4ee2-9333-19048488f928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:57.931502 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb73922-eb61-4ee2-9333-19048488f928 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:57.931739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca529c-8e0d-42f5-b95a-bd4e674aa15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:57.932628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca529c-8e0d-42f5-b95a-bd4e674aa15f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:57.933074 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca529c-8e0d-42f5-b95a-bd4e674aa15f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:57.933360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca529c-8e0d-42f5-b95a-bd4e674aa15f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:57.945872 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 324/648] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:01:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:57.945872 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb73922-eb61-4ee2-9333-19048488f928 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:58.009225 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca529c-8e0d-42f5-b95a-bd4e674aa15f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:58.010689 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca529c-8e0d-42f5-b95a-bd4e674aa15f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:58.046701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb73922-eb61-4ee2-9333-19048488f928 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:58.066802 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:58.071145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:58.084941 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623b913-b480-4905-92df-10362348b7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:58.085619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623b913-b480-4905-92df-10362348b7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:58.085899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623b913-b480-4905-92df-10362348b7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:58.086229 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623b913-b480-4905-92df-10362348b7f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:58.087026 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623b913-b480-4905-92df-10362348b7f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:58.087337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623b913-b480-4905-92df-10362348b7f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:58.088779 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623b913-b480-4905-92df-10362348b7f1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:58.101492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 325/649] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:01:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:58.102722 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623b913-b480-4905-92df-10362348b7f1 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:58.127861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 325/650] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:58.129410 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca529c-8e0d-42f5-b95a-bd4e674aa15f None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:58.212293 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623b913-b480-4905-92df-10362348b7f1 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:58.238667 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca529c-8e0d-42f5-b95a-bd4e674aa15f None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:58.250072 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de8a5b-0d22-4e88-ade0-3dd6adbd835e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:58.250973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de8a5b-0d22-4e88-ade0-3dd6adbd835e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:58.251258 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de8a5b-0d22-4e88-ade0-3dd6adbd835e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:58.251532 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de8a5b-0d22-4e88-ade0-3dd6adbd835e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:58.263495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de8a5b-0d22-4e88-ade0-3dd6adbd835e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:58.265061 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de8a5b-0d22-4e88-ade0-3dd6adbd835e None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:58.274433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c0031-2790-4e6b-a125-52a64c9d8ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:58.275273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c0031-2790-4e6b-a125-52a64c9d8ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:58.275556 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c0031-2790-4e6b-a125-52a64c9d8ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:58.275830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c0031-2790-4e6b-a125-52a64c9d8ea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:58.284969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-f2de8a5b-0d22-4e88-ade0-3dd6adbd835e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:58.284969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:58.284969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:58.284969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:58.284969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:58.284969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:58.284969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:58.284969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:58.284969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:58.284969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:58.284969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:58.284969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:58.284969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:58.284969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:58.284969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:58.285971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:58.285971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:58.285971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:58.285971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:58.285971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:58.285971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:58.285971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:58.285971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:58.285971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:58.285971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:58.285971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:58.285971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:58.285971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:58.285971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:58.285971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:58.285971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:58.285971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:58.286862 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:58.286862 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:58.286862 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:58.286862 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:58.286862 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 326/651] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:58.287143 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de8a5b-0d22-4e88-ade0-3dd6adbd835e None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:58.289789 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c0031-2790-4e6b-a125-52a64c9d8ea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:58.291711 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c0031-2790-4e6b-a125-52a64c9d8ea9 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:58.311643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-7c3c0031-2790-4e6b-a125-52a64c9d8ea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:58.311643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:58.311643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:58.311643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:58.311643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:58.311643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:58.311643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:58.311643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:58.311643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:58.311643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:58.311643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:58.311643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:58.311643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:58.311643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:58.311643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:58.312825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:58.312825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:58.312825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:58.312825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:58.312825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:58.312825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:58.312825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:58.312825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:58.312825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:58.312825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:58.312825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:58.312825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:58.312825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:58.312825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:58.312825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:58.312825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:58.312825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:58.313933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:58.313933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:58.313933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:58.313933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:58.315603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 326/652] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:58.316536 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c0031-2790-4e6b-a125-52a64c9d8ea9 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:58.319441 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:58.325830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:58.406443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de8a5b-0d22-4e88-ade0-3dd6adbd835e None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:58.429873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c0031-2790-4e6b-a125-52a64c9d8ea9 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:58.444192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec737f5-9244-40ca-b6ab-1270b184aef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:58.444889 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec737f5-9244-40ca-b6ab-1270b184aef1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:58.445172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec737f5-9244-40ca-b6ab-1270b184aef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:58.445447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec737f5-9244-40ca-b6ab-1270b184aef1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:58.446286 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec737f5-9244-40ca-b6ab-1270b184aef1 None admin] RBAC: Adding query filter params (role.id=6391321aa2bd4ed5980bebfc65f307a9, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=628bac94f0c54ac7a14ff19287efd8df) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:58.446600 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec737f5-9244-40ca-b6ab-1270b184aef1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:58.448105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec737f5-9244-40ca-b6ab-1270b184aef1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:58.464615 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 327/653] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:01:58 2022] GET /identity/v3/role_assignments?user.id=628bac94f0c54ac7a14ff19287efd8df&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=6391321aa2bd4ed5980bebfc65f307a9 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:58.464615 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec737f5-9244-40ca-b6ab-1270b184aef1 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:58.483439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10787ac5-522c-4222-abc9-05399c3e0d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:58.484487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10787ac5-522c-4222-abc9-05399c3e0d8c None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:58.484961 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10787ac5-522c-4222-abc9-05399c3e0d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:58.485309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10787ac5-522c-4222-abc9-05399c3e0d8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:58.499964 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10787ac5-522c-4222-abc9-05399c3e0d8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:58.501715 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10787ac5-522c-4222-abc9-05399c3e0d8c None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:58.523892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-10787ac5-522c-4222-abc9-05399c3e0d8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:58.523892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:58.523892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:58.523892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:58.523892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:58.523892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:58.523892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:58.523892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:58.523892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:58.523892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:58.523892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:58.523892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:58.523892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:01:58.523892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:01:58.523892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:01:58.524873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:01:58.524873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:58.524873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:58.524873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:58.524873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:58.524873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:58.524873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:58.524873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:58.524873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:58.524873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:58.524873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:58.524873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:58.524873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:58.524873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:58.524873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:58.524873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:58.524873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:58.525770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:01:58.525770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:01:58.525770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:01:58.525770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:58.525770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 327/654] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:58.527032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10787ac5-522c-4222-abc9-05399c3e0d8c None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:58.594466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:58.604874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec737f5-9244-40ca-b6ab-1270b184aef1 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:58.609878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:58.646446 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d4966-2fb0-46be-9b62-8a3184468b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:58.647224 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d4966-2fb0-46be-9b62-8a3184468b0b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:58.647801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d4966-2fb0-46be-9b62-8a3184468b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:58.647801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d4966-2fb0-46be-9b62-8a3184468b0b None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:58.649886 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d4966-2fb0-46be-9b62-8a3184468b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:58.650203 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d4966-2fb0-46be-9b62-8a3184468b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:58.651810 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d4966-2fb0-46be-9b62-8a3184468b0b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:58.665250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 328/655] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:58.666127 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d4966-2fb0-46be-9b62-8a3184468b0b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:58.672022 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10787ac5-522c-4222-abc9-05399c3e0d8c None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:58.717399 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b367170-0f38-495c-8895-dd0d018e51cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:58.718388 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b367170-0f38-495c-8895-dd0d018e51cd None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:58.718870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b367170-0f38-495c-8895-dd0d018e51cd None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:58.719153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b367170-0f38-495c-8895-dd0d018e51cd None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:58.719892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b367170-0f38-495c-8895-dd0d018e51cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:58.720204 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b367170-0f38-495c-8895-dd0d018e51cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:58.722130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b367170-0f38-495c-8895-dd0d018e51cd None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:58.741804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 328/656] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:58.742680 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b367170-0f38-495c-8895-dd0d018e51cd None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:58.797286 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d4966-2fb0-46be-9b62-8a3184468b0b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:58.832195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925e7ea-0191-492f-92a8-04f9a2ba0d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:58.833562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925e7ea-0191-492f-92a8-04f9a2ba0d2e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:58.833562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925e7ea-0191-492f-92a8-04f9a2ba0d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:58.833562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925e7ea-0191-492f-92a8-04f9a2ba0d2e None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:58.834276 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925e7ea-0191-492f-92a8-04f9a2ba0d2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:58.834638 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925e7ea-0191-492f-92a8-04f9a2ba0d2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:58.836032 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925e7ea-0191-492f-92a8-04f9a2ba0d2e None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:58.849552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 329/657] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:58.850435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925e7ea-0191-492f-92a8-04f9a2ba0d2e None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:58.873314 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b367170-0f38-495c-8895-dd0d018e51cd None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:58.877040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:58.892920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:58.924229 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0dd581-1921-4ef0-a7a3-7460cad9cc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:58.925597 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dd581-1921-4ef0-a7a3-7460cad9cc26 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:58.926077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dd581-1921-4ef0-a7a3-7460cad9cc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:58.926471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dd581-1921-4ef0-a7a3-7460cad9cc26 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:58.937789 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0dd581-1921-4ef0-a7a3-7460cad9cc26 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:58.939535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0dd581-1921-4ef0-a7a3-7460cad9cc26 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:58.960563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-cb0dd581-1921-4ef0-a7a3-7460cad9cc26 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 21:01:58.960563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:58.960563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:58.960563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:58.960563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:58.960563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:58.960563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:58.960563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:58.960563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:58.960563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:58.960563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:58.960563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:58.960563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:01:58.960563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:01:58.960563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:01:58.960563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:01:58.961628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:58.961628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:58.961628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:01:58.961628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:58.961628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:01:58.961628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:58.961628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:58.961628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:58.961628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:58.961628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:58.961628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:58.961628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:58.961628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:58.961628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:58.961628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:58.961628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:58.961628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:58.961628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:58.962562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:58.962562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:58.962562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:01:58.962562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:01:58.962562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:01:58.962562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:01:58.962562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:01:58.962562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:01:58.962562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 21:01:58.962562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:58.964686 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 329/658] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:01:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:58.966346 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0dd581-1921-4ef0-a7a3-7460cad9cc26 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:58.976064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925e7ea-0191-492f-92a8-04f9a2ba0d2e None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:59.024234 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af946f0-4bac-4d9f-a825-4281b8594c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:59.025082 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af946f0-4bac-4d9f-a825-4281b8594c4f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:59.025366 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af946f0-4bac-4d9f-a825-4281b8594c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:59.025642 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af946f0-4bac-4d9f-a825-4281b8594c4f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:59.036321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af946f0-4bac-4d9f-a825-4281b8594c4f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:59.038394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af946f0-4bac-4d9f-a825-4281b8594c4f None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:59.057878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-1af946f0-4bac-4d9f-a825-4281b8594c4f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 21:01:59.057878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:59.057878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:59.057878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:59.057878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:59.057878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:59.057878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:59.057878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:59.057878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:59.057878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:59.057878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:59.057878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:59.057878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:01:59.057878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:01:59.057878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:01:59.057878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:01:59.059096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:59.059096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:59.059096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:01:59.059096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:59.059096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:01:59.059096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:01:59.059096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:59.059096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:59.059096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:59.059096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:59.059096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:59.059096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:01:59.059096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:59.059096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:59.059096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:59.059096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:59.059096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:59.059096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:59.060085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:59.060085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:59.060085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:01:59.060085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:01:59.060085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:01:59.060085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:01:59.060085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:01:59.060085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:01:59.060085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 21:01:59.060085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:01:59.060085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 330/659] 10.222.0.66 () {56 vars in 1093 bytes} [Thu May 26 21:01:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:59.060756 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af946f0-4bac-4d9f-a825-4281b8594c4f None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:59.096073 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0dd581-1921-4ef0-a7a3-7460cad9cc26 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:59.142278 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd89ba5-28ad-40b4-8900-ecfa3b1c18c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:59.143356 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd89ba5-28ad-40b4-8900-ecfa3b1c18c2 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:59.144039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd89ba5-28ad-40b4-8900-ecfa3b1c18c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:59.144320 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd89ba5-28ad-40b4-8900-ecfa3b1c18c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:59.155542 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd89ba5-28ad-40b4-8900-ecfa3b1c18c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:59.157049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd89ba5-28ad-40b4-8900-ecfa3b1c18c2 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:59.159489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:59.172068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-3dd89ba5-28ad-40b4-8900-ecfa3b1c18c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:59.172068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:01:59.172068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:01:59.172068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:01:59.172068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:01:59.172068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:01:59.172068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:01:59.172068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:01:59.172068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:01:59.172068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:01:59.172068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:01:59.172068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:01:59.172068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:01:59.172068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:01:59.172068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:01:59.176681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:01:59.176681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:01:59.176681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:01:59.176681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:01:59.176681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:01:59.176681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:01:59.176681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:01:59.176681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:01:59.176681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:01:59.176681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:01:59.176681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:01:59.176681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:01:59.176681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:01:59.176681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:01:59.176681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:01:59.176681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:01:59.176681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:01:59.177625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:01:59.177625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:01:59.177625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:01:59.177625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:01:59.177625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:01:59.177625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:01:59.177625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:01:59.177625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:01:59.177625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 330/660] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:01:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:01:59.178111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd89ba5-28ad-40b4-8900-ecfa3b1c18c2 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:59.198100 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af946f0-4bac-4d9f-a825-4281b8594c4f None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:59.217625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:59.247004 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc3f7c-6cd6-45eb-9f4f-13177773f390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:59.247827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc3f7c-6cd6-45eb-9f4f-13177773f390 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:59.248125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc3f7c-6cd6-45eb-9f4f-13177773f390 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:59.248391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc3f7c-6cd6-45eb-9f4f-13177773f390 None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:59.249455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc3f7c-6cd6-45eb-9f4f-13177773f390 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:59.249767 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc3f7c-6cd6-45eb-9f4f-13177773f390 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:59.251865 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc3f7c-6cd6-45eb-9f4f-13177773f390 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:59.283530 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 331/661] 10.222.0.66 () {56 vars in 1139 bytes} [Thu May 26 21:01:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:59.284624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc3f7c-6cd6-45eb-9f4f-13177773f390 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:59.305858 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd89ba5-28ad-40b4-8900-ecfa3b1c18c2 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:59.349863 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daf7bd-3416-4001-829a-f167293bd7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:59.350575 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daf7bd-3416-4001-829a-f167293bd7df None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:59.350979 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daf7bd-3416-4001-829a-f167293bd7df None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:59.351336 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daf7bd-3416-4001-829a-f167293bd7df None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:59.352168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94daf7bd-3416-4001-829a-f167293bd7df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:59.352565 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94daf7bd-3416-4001-829a-f167293bd7df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:59.354343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94daf7bd-3416-4001-829a-f167293bd7df None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:59.375419 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 331/662] 10.222.0.66 () {56 vars in 1133 bytes} [Thu May 26 21:01:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:59.376497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daf7bd-3416-4001-829a-f167293bd7df None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:59.411169 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc3f7c-6cd6-45eb-9f4f-13177773f390 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:59.444910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:59.451798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f89a59-e3c4-43da-a467-c14b6945c704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:59.452824 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f89a59-e3c4-43da-a467-c14b6945c704 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:59.453370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f89a59-e3c4-43da-a467-c14b6945c704 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:59.453879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f89a59-e3c4-43da-a467-c14b6945c704 None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:59.454935 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f89a59-e3c4-43da-a467-c14b6945c704 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:59.455420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f89a59-e3c4-43da-a467-c14b6945c704 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:59.462473 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f89a59-e3c4-43da-a467-c14b6945c704 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:59.475485 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 332/663] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:01:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:59.476881 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f89a59-e3c4-43da-a467-c14b6945c704 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:59.481048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:59.490140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daf7bd-3416-4001-829a-f167293bd7df None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:59.527293 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42314662-eeb6-46cd-94ad-2f02c599ef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:59.527950 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42314662-eeb6-46cd-94ad-2f02c599ef13 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:59.528280 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42314662-eeb6-46cd-94ad-2f02c599ef13 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:59.528555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42314662-eeb6-46cd-94ad-2f02c599ef13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:59.589518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f89a59-e3c4-43da-a467-c14b6945c704 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:59.604456 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42314662-eeb6-46cd-94ad-2f02c599ef13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:59.605878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42314662-eeb6-46cd-94ad-2f02c599ef13 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:59.627330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbd6e6-5c42-4fc2-8cc7-42a3c4585c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:59.628242 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbd6e6-5c42-4fc2-8cc7-42a3c4585c4e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:59.628774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbd6e6-5c42-4fc2-8cc7-42a3c4585c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:59.629055 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbd6e6-5c42-4fc2-8cc7-42a3c4585c4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:59.692520 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:59.703487 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbd6e6-5c42-4fc2-8cc7-42a3c4585c4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:59.704966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbd6e6-5c42-4fc2-8cc7-42a3c4585c4e None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:59.705870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:59.720463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 332/664] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:59.720463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42314662-eeb6-46cd-94ad-2f02c599ef13 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:59.823278 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42314662-eeb6-46cd-94ad-2f02c599ef13 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:59.826431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 333/665] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:01:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:01:59.827833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83825b0-16ca-480d-b6a6-ad83ac37c32e None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:59.828124 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83825b0-16ca-480d-b6a6-ad83ac37c32e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:59.828402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83825b0-16ca-480d-b6a6-ad83ac37c32e None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:59.830123 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 334/666] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:59.830840 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83825b0-16ca-480d-b6a6-ad83ac37c32e None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:59.869345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fe3c0-cdf9-47d5-b6c1-ce70e2918284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:59.869917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fe3c0-cdf9-47d5-b6c1-ce70e2918284 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:59.870198 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fe3c0-cdf9-47d5-b6c1-ce70e2918284 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:59.870477 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fe3c0-cdf9-47d5-b6c1-ce70e2918284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:59.871314 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fe3c0-cdf9-47d5-b6c1-ce70e2918284 None admin] RBAC: Adding query filter params (role.id=6391321aa2bd4ed5980bebfc65f307a9, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=4561bdb2d75e4025a5d73ea713c690b3) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:01:59.871627 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fe3c0-cdf9-47d5-b6c1-ce70e2918284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:59.873682 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fe3c0-cdf9-47d5-b6c1-ce70e2918284 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:59.880171 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 333/667] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:01:59 2022] GET /identity/v3/role_assignments?user.id=4561bdb2d75e4025a5d73ea713c690b3&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=6391321aa2bd4ed5980bebfc65f307a9 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:01:59.881003 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fe3c0-cdf9-47d5-b6c1-ce70e2918284 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:59.949762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:59.962145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83825b0-16ca-480d-b6a6-ad83ac37c32e None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:59.963935 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:00.003323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56181a74-24e0-427a-930b-125eb77a2b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:00.004148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56181a74-24e0-427a-930b-125eb77a2b81 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:00.004432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56181a74-24e0-427a-930b-125eb77a2b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:00.004759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56181a74-24e0-427a-930b-125eb77a2b81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:00.017302 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56181a74-24e0-427a-930b-125eb77a2b81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:00.019141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56181a74-24e0-427a-930b-125eb77a2b81 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:00.022265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fe3c0-cdf9-47d5-b6c1-ce70e2918284 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:00.039584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-56181a74-24e0-427a-930b-125eb77a2b81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:00.039584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:00.039584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:00.039584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:00.039584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:00.039584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:00.039584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:00.039584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:00.039584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:00.039584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:00.039584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:00.039584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:00.039584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:00.039584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:00.039584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:00.040536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:00.040536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:00.040536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:00.040536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:00.040536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:00.040536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:00.040536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:00.040536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:00.040536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:00.040536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:00.040536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:00.040536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:00.040536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:00.040536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:00.040536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:00.040536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:00.040536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:00.041443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:00.041443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:00.041443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:00.041443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:00.046251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 335/668] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:00.047745 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cc0b1-8ab9-4be5-ad33-b813ae645336 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:00.048035 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cc0b1-8ab9-4be5-ad33-b813ae645336 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:00.048316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cc0b1-8ab9-4be5-ad33-b813ae645336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:00.067310 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e389bd9-56d6-47cb-9ec7-ea3f132bf7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:00.068245 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-276cc0b1-8ab9-4be5-ad33-b813ae645336 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:00.068834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e389bd9-56d6-47cb-9ec7-ea3f132bf7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:00.069321 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e389bd9-56d6-47cb-9ec7-ea3f132bf7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:00.069496 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-276cc0b1-8ab9-4be5-ad33-b813ae645336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:00.069952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e389bd9-56d6-47cb-9ec7-ea3f132bf7e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:00.082201 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e389bd9-56d6-47cb-9ec7-ea3f132bf7e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:00.084685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e389bd9-56d6-47cb-9ec7-ea3f132bf7e5 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:00.103483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-7e389bd9-56d6-47cb-9ec7-ea3f132bf7e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:00.103483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:00.103483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:00.103483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:00.103483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:00.103483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:00.103483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:00.103483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:00.103483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:00.103483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:00.103483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:00.103483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:00.103483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:00.103483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:00.103483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:00.104406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:00.104406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:00.104406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:00.104406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:00.104406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:00.104406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:00.104406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:00.104406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:00.104406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:00.104406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:00.104406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:00.104406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:00.104406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:00.104406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:00.104406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:00.104406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:00.104406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:00.107081 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:00.107081 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:00.107081 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:00.107081 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:00.108093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 334/669] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:00.108771 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e389bd9-56d6-47cb-9ec7-ea3f132bf7e5 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:00.163566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 336/670] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:02:00.164372 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cc0b1-8ab9-4be5-ad33-b813ae645336 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:00.246782 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:00.253508 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e389bd9-56d6-47cb-9ec7-ea3f132bf7e5 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:00.263423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:00.289664 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cc0b1-8ab9-4be5-ad33-b813ae645336 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:00.290562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b16de-3e50-42f8-9b54-bff2815340f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:00.294793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b16de-3e50-42f8-9b54-bff2815340f4 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:00.294793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b16de-3e50-42f8-9b54-bff2815340f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:00.294793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b16de-3e50-42f8-9b54-bff2815340f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:00.294793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b16de-3e50-42f8-9b54-bff2815340f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:00.294793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b16de-3e50-42f8-9b54-bff2815340f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:00.296098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b16de-3e50-42f8-9b54-bff2815340f4 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:00.309270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 335/671] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:00.311129 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b16de-3e50-42f8-9b54-bff2815340f4 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:00.331603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb752c14-2fc8-40a1-9252-16a05c3b4a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:00.332594 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb752c14-2fc8-40a1-9252-16a05c3b4a64 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:00.332906 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb752c14-2fc8-40a1-9252-16a05c3b4a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:00.333184 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb752c14-2fc8-40a1-9252-16a05c3b4a64 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:00.333928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb752c14-2fc8-40a1-9252-16a05c3b4a64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:00.334232 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb752c14-2fc8-40a1-9252-16a05c3b4a64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:00.335601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb752c14-2fc8-40a1-9252-16a05c3b4a64 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:00.357055 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 337/672] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:00.358042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb752c14-2fc8-40a1-9252-16a05c3b4a64 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:00.433380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b16de-3e50-42f8-9b54-bff2815340f4 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:00.478886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cf972-e36e-45d8-a3df-d2b7be6c8007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:00.479686 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cf972-e36e-45d8-a3df-d2b7be6c8007 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:00.479965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cf972-e36e-45d8-a3df-d2b7be6c8007 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:00.480235 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cf972-e36e-45d8-a3df-d2b7be6c8007 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:00.480532 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb752c14-2fc8-40a1-9252-16a05c3b4a64 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:00.496641 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cf972-e36e-45d8-a3df-d2b7be6c8007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:00.506813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-0c8cf972-e36e-45d8-a3df-d2b7be6c8007 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:02:00.506813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:00.506813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:00.506813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:00.506813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:00.506813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:00.506813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:00.506813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:00.506813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:00.506813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:00.506813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:00.506813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:00.506813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:00.506813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:00.506813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:00.506813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:00.507891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:00.507891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:00.507891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:00.507891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:00.507891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:00.507891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:00.507891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:00.507891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:00.507891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:00.507891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:00.507891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:00.507891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:00.507891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:00.507891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:00.507891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:00.507891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:00.508775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:00.508775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:00.508775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:00.508775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:00.508775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:00.508775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:00.508775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:00.508775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:00.508775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:00.508775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:00.508775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:02:00.508775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:00.508775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 336/673] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:02:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:00.509471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cf972-e36e-45d8-a3df-d2b7be6c8007 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:00.526862 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b7784-10af-42e9-a476-089074d78bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:00.527670 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b7784-10af-42e9-a476-089074d78bbb None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:00.527961 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b7784-10af-42e9-a476-089074d78bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:00.528896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b7784-10af-42e9-a476-089074d78bbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:00.535948 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b7784-10af-42e9-a476-089074d78bbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:00.537444 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b7784-10af-42e9-a476-089074d78bbb None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:00.553393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-b81b7784-10af-42e9-a476-089074d78bbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:00.553393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:00.553393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:00.553393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:00.553393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:00.553393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:00.553393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:00.553393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:00.553393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:00.553393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:00.553393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:00.553393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:00.553393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:00.553393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:00.553393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:00.555021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:00.555021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:00.555021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:00.555021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:00.555021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:00.555021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:00.555021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:00.555021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:00.555021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:00.555021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:00.555021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:00.555021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:00.555021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:00.555021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:00.555021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:00.555021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:00.555021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:00.556772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:00.556772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:00.556772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:00.556772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:00.556772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:00.556772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:00.556772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:00.556772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:00.557886 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:00.565277 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 338/674] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:00.565277 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b7784-10af-42e9-a476-089074d78bbb None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:00.593060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:00.640843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cf972-e36e-45d8-a3df-d2b7be6c8007 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:00.672968 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b7784-10af-42e9-a476-089074d78bbb None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:00.684026 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f2175-5787-4b76-a8d0-b8880ad98185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:00.684938 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f2175-5787-4b76-a8d0-b8880ad98185 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:00.685726 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f2175-5787-4b76-a8d0-b8880ad98185 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:00.686006 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f2175-5787-4b76-a8d0-b8880ad98185 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:00.695738 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f2175-5787-4b76-a8d0-b8880ad98185 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:00.697306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f2175-5787-4b76-a8d0-b8880ad98185 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:00.712920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee62d22-76b5-4d93-8260-10e67ac314bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:00.713742 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee62d22-76b5-4d93-8260-10e67ac314bb None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:00.714118 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee62d22-76b5-4d93-8260-10e67ac314bb None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:00.714489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee62d22-76b5-4d93-8260-10e67ac314bb None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:00.715495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee62d22-76b5-4d93-8260-10e67ac314bb None admin] RBAC: Adding query filter params (name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:00.716565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee62d22-76b5-4d93-8260-10e67ac314bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:00.716735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-fc3f2175-5787-4b76-a8d0-b8880ad98185 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:00.716735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:00.716735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:00.716735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:00.716735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:00.716735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:00.716735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:00.716735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:00.716735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:00.716735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:00.716735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:00.716735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:00.716735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:00.716735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:00.716735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:00.717734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:00.717734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:00.717734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:00.717734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:00.717734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:00.717734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:00.717734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:00.717734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:00.717734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:00.717734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:00.717734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:00.717734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:00.717734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:00.717734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:00.717734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:00.717734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:00.717734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:00.718825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:00.718825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:00.718825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:00.718825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:00.718825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:00.718825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:00.718825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:00.718825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:00.720704 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee62d22-76b5-4d93-8260-10e67ac314bb None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:00.722697 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 337/675] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:00.723981 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f2175-5787-4b76-a8d0-b8880ad98185 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:00.731533 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 339/676] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:02:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:00.732475 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee62d22-76b5-4d93-8260-10e67ac314bb None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:00.837044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:00.838933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:00.854722 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f2175-5787-4b76-a8d0-b8880ad98185 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:00.855741 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee62d22-76b5-4d93-8260-10e67ac314bb None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:00.890638 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28d305-c21b-4937-a03a-333d020b43d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:00.891314 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28d305-c21b-4937-a03a-333d020b43d7 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:00.891603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28d305-c21b-4937-a03a-333d020b43d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:00.891887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28d305-c21b-4937-a03a-333d020b43d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:00.892709 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28d305-c21b-4937-a03a-333d020b43d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:00.893024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28d305-c21b-4937-a03a-333d020b43d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:00.894582 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28d305-c21b-4937-a03a-333d020b43d7 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:00.899899 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceeb7f1-5638-4272-bf5e-5cd71f24402d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:00.900562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceeb7f1-5638-4272-bf5e-5cd71f24402d None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:00.900870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceeb7f1-5638-4272-bf5e-5cd71f24402d None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:00.901145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceeb7f1-5638-4272-bf5e-5cd71f24402d None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:00.901924 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceeb7f1-5638-4272-bf5e-5cd71f24402d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:00.902532 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceeb7f1-5638-4272-bf5e-5cd71f24402d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:00.904282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceeb7f1-5638-4272-bf5e-5cd71f24402d None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:00.912633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 340/677] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:02:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:00.912633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28d305-c21b-4937-a03a-333d020b43d7 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:00.919518 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 338/678] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:02:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:00.924029 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4e299-e02d-4eb1-af54-878896eca5a0 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:00.924029 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4e299-e02d-4eb1-af54-878896eca5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:00.924029 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4e299-e02d-4eb1-af54-878896eca5a0 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:00.924029 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 339/679] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:00.924029 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4e299-e02d-4eb1-af54-878896eca5a0 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:01.028592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28d305-c21b-4937-a03a-333d020b43d7 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:01.033699 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4e299-e02d-4eb1-af54-878896eca5a0 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:01.044118 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:01.066350 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e518b-21e0-416f-884c-a6fa8c7fbbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:01.067163 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e518b-21e0-416f-884c-a6fa8c7fbbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:01.067617 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e518b-21e0-416f-884c-a6fa8c7fbbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:01.068156 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e518b-21e0-416f-884c-a6fa8c7fbbf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:01.070661 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008900e-bdea-4891-921e-4e60805730b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:01.071550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008900e-bdea-4891-921e-4e60805730b6 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:01.072023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008900e-bdea-4891-921e-4e60805730b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:01.072479 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008900e-bdea-4891-921e-4e60805730b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:01.073587 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008900e-bdea-4891-921e-4e60805730b6 None admin] RBAC: Adding query filter params (role.id=6391321aa2bd4ed5980bebfc65f307a9, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=df008eed25464be387741ee7a1e5ce80) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:01.074101 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008900e-bdea-4891-921e-4e60805730b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:01.076323 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008900e-bdea-4891-921e-4e60805730b6 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:01.079678 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e518b-21e0-416f-884c-a6fa8c7fbbf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:01.081151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e518b-21e0-416f-884c-a6fa8c7fbbf3 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:01.083423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 340/680] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:02:00 2022] GET /identity/v3/role_assignments?user.id=df008eed25464be387741ee7a1e5ce80&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=6391321aa2bd4ed5980bebfc65f307a9 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:01.084517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008900e-bdea-4891-921e-4e60805730b6 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:01.105626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-958e518b-21e0-416f-884c-a6fa8c7fbbf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:01.105626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:01.105626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:01.105626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:01.105626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:01.105626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:01.105626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:01.105626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:01.105626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:01.105626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:01.105626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:01.105626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:01.105626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:01.105626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:01.105626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:01.106625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:01.106625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:01.106625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:01.106625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:01.106625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:01.106625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:01.106625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:01.106625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:01.106625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:01.106625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:01.106625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:01.106625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:01.106625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:01.106625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:01.106625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:01.106625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:01.106625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:01.107513 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:01.107513 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:01.107513 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:01.107513 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:01.110056 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:01.110536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 341/681] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:01.113130 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3145f1-f17f-4804-a0c1-47b83e08be6d None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:01.113655 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3145f1-f17f-4804-a0c1-47b83e08be6d None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:01.114119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3145f1-f17f-4804-a0c1-47b83e08be6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:01.133443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-4a3145f1-f17f-4804-a0c1-47b83e08be6d None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:01.134986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4a3145f1-f17f-4804-a0c1-47b83e08be6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:01.220633 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008900e-bdea-4891-921e-4e60805730b6 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:01.240748 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 342/682] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:02:01.242062 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3145f1-f17f-4804-a0c1-47b83e08be6d None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:01.278815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61413a80-814b-459d-abe9-a6ef5e34fee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:01.279867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61413a80-814b-459d-abe9-a6ef5e34fee0 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:01.280436 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61413a80-814b-459d-abe9-a6ef5e34fee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:01.280976 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61413a80-814b-459d-abe9-a6ef5e34fee0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:01.282031 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61413a80-814b-459d-abe9-a6ef5e34fee0 None admin] RBAC: Adding query filter params (role.id=6391321aa2bd4ed5980bebfc65f307a9, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=98ec4e37c2714729afec6ad805ed775a) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:01.282556 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61413a80-814b-459d-abe9-a6ef5e34fee0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:01.284285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61413a80-814b-459d-abe9-a6ef5e34fee0 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:01.292247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 341/683] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:02:01 2022] GET /identity/v3/role_assignments?user.id=98ec4e37c2714729afec6ad805ed775a&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=6391321aa2bd4ed5980bebfc65f307a9 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:01.293518 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61413a80-814b-459d-abe9-a6ef5e34fee0 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:01.395405 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:01.403669 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:01.413247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3145f1-f17f-4804-a0c1-47b83e08be6d None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:01.424422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61413a80-814b-459d-abe9-a6ef5e34fee0 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:01.467934 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5286d4-63d1-44b7-9634-1f336fdf1ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:01.468682 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5286d4-63d1-44b7-9634-1f336fdf1ddb None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:01.468977 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5286d4-63d1-44b7-9634-1f336fdf1ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:01.469259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5286d4-63d1-44b7-9634-1f336fdf1ddb None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:01.470023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5286d4-63d1-44b7-9634-1f336fdf1ddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:01.470338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5286d4-63d1-44b7-9634-1f336fdf1ddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:01.471753 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5286d4-63d1-44b7-9634-1f336fdf1ddb None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:01.472998 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc45b81-056e-4398-afb2-d96e59a04f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:01.475027 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc45b81-056e-4398-afb2-d96e59a04f92 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:01.475567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc45b81-056e-4398-afb2-d96e59a04f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:01.476052 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc45b81-056e-4398-afb2-d96e59a04f92 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:01.476977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc45b81-056e-4398-afb2-d96e59a04f92 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:01.478599 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc45b81-056e-4398-afb2-d96e59a04f92 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:01.487239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 343/684] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:01.495852 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5286d4-63d1-44b7-9634-1f336fdf1ddb None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:01.497843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-4dc45b81-056e-4398-afb2-d96e59a04f92 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 21:02:01.497843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:01.497843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:01.497843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:01.497843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:01.497843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:01.497843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:01.497843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:01.497843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 21:02:01.497843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:01.497843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:01.497843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:01.497843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:01.497843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:01.497843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:01.497843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:01.498781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:01.498781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:01.498781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:01.498781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:01.498781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:01.498781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:01.498781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:01.498781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:01.498781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:01.498781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:01.498781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:01.498781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:01.498781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:01.498781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:01.498781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:01.498781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:01.499844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:01.499844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:01.499844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:01.499844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:01.499844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:01.499844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:01.499844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:01.499844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:01.499844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:01.499844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:01.499844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:01.499844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:01.499844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:01.499844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 21:02:01.499844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:01.499844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 342/685] 10.222.0.66 () {56 vars in 1129 bytes} [Thu May 26 21:02:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:01.508393 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc45b81-056e-4398-afb2-d96e59a04f92 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:01.657594 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5286d4-63d1-44b7-9634-1f336fdf1ddb None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:01.667154 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc45b81-056e-4398-afb2-d96e59a04f92 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:01.720351 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2fc7e-83cd-4541-b6f4-d6c1e8575c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:01.721265 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2fc7e-83cd-4541-b6f4-d6c1e8575c1d None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:01.721553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2fc7e-83cd-4541-b6f4-d6c1e8575c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:01.721834 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2fc7e-83cd-4541-b6f4-d6c1e8575c1d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:01.726389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44163a-0e52-4b73-9221-67d26a1ae8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:01.727064 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44163a-0e52-4b73-9221-67d26a1ae8ae None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:01.727346 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44163a-0e52-4b73-9221-67d26a1ae8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:01.727624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44163a-0e52-4b73-9221-67d26a1ae8ae None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:01.729033 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44163a-0e52-4b73-9221-67d26a1ae8ae None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:01.729346 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44163a-0e52-4b73-9221-67d26a1ae8ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:01.730750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44163a-0e52-4b73-9221-67d26a1ae8ae None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:01.738099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2fc7e-83cd-4541-b6f4-d6c1e8575c1d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:01.739536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2fc7e-83cd-4541-b6f4-d6c1e8575c1d None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:01.745114 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 343/686] 10.222.0.66 () {56 vars in 1124 bytes} [Thu May 26 21:02:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:01.758031 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44163a-0e52-4b73-9221-67d26a1ae8ae None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:01.761465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-e4e2fc7e-83cd-4541-b6f4-d6c1e8575c1d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 21:02:01.761465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:01.761465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:01.761465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:01.761465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:01.761465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:01.761465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:01.761465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:01.761465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:01.761465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:01.761465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:01.761465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:01.761465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:02:01.761465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:02:01.761465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:02:01.761465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:02:01.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:01.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:01.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:02:01.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:01.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:02:01.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:01.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:01.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:01.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:01.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:01.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:01.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:01.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:01.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:01.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:01.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:01.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:01.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:01.763879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:01.763879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:01.763879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:02:01.763879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:02:01.763879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:02:01.763879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:02:01.763879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:02:01.763879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:02:01.763879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 21:02:01.763879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:01.763879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 344/687] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:02:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:01.768676 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2fc7e-83cd-4541-b6f4-d6c1e8575c1d None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:01.775362 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:01.814216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:01.889439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44163a-0e52-4b73-9221-67d26a1ae8ae None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:01.932031 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e116f1-dc0a-4fef-b208-4f1fc8786ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:01.932743 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e116f1-dc0a-4fef-b208-4f1fc8786ddb None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:01.933030 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e116f1-dc0a-4fef-b208-4f1fc8786ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:01.933307 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e116f1-dc0a-4fef-b208-4f1fc8786ddb None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:01.934329 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e116f1-dc0a-4fef-b208-4f1fc8786ddb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:01.934642 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e116f1-dc0a-4fef-b208-4f1fc8786ddb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:01.936042 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e116f1-dc0a-4fef-b208-4f1fc8786ddb None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:01.951685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 344/688] 10.222.0.66 () {56 vars in 1124 bytes} [Thu May 26 21:02:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:01.971307 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2fc7e-83cd-4541-b6f4-d6c1e8575c1d None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:02.022389 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b843f-b6df-4680-bac5-1790da2998f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:02.023483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b843f-b6df-4680-bac5-1790da2998f3 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:02.023975 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b843f-b6df-4680-bac5-1790da2998f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:02.024482 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b843f-b6df-4680-bac5-1790da2998f3 None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:02.025618 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b843f-b6df-4680-bac5-1790da2998f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:02.026152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b843f-b6df-4680-bac5-1790da2998f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:02.027869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b843f-b6df-4680-bac5-1790da2998f3 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:02.048994 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 345/689] 10.222.0.66 () {56 vars in 1135 bytes} [Thu May 26 21:02:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:02.056630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e116f1-dc0a-4fef-b208-4f1fc8786ddb None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:02.173326 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:02.208667 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e116f1-dc0a-4fef-b208-4f1fc8786ddb None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:02.267330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e0c28-4485-47ff-969b-9e693864aded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:02.267997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e0c28-4485-47ff-969b-9e693864aded None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:02.268280 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e0c28-4485-47ff-969b-9e693864aded None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:02.268557 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e0c28-4485-47ff-969b-9e693864aded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:02.342417 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e0c28-4485-47ff-969b-9e693864aded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:02.344002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e0c28-4485-47ff-969b-9e693864aded None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:02.434190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:02.469211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 345/690] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:02:02.475129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b843f-b6df-4680-bac5-1790da2998f3 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:02.598543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:02.630303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b843f-b6df-4680-bac5-1790da2998f3 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:02.685749 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36891441-ff43-4f90-b9ea-d4665118351c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:02.686507 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36891441-ff43-4f90-b9ea-d4665118351c None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:02.686788 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36891441-ff43-4f90-b9ea-d4665118351c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:02.687062 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36891441-ff43-4f90-b9ea-d4665118351c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:02.699944 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36891441-ff43-4f90-b9ea-d4665118351c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:02.702025 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36891441-ff43-4f90-b9ea-d4665118351c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:02.709120 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47d20d-1814-423d-a1e0-81485e63d7a8 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:02.709437 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47d20d-1814-423d-a1e0-81485e63d7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:02.709682 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47d20d-1814-423d-a1e0-81485e63d7a8 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:02.711316 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 346/691] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:02.716771 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb5df6-0380-4ef4-95a8-0e32fe725cc5 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:02.717047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb5df6-0380-4ef4-95a8-0e32fe725cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:02.717326 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb5df6-0380-4ef4-95a8-0e32fe725cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:02.733144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-36891441-ff43-4f90-b9ea-d4665118351c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:02.733144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:02.733144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:02.733144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:02.733144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:02.733144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:02.733144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:02.733144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:02.733144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:02.733144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:02.733144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:02.733144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:02.733144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:02.733144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:02.733144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:02.734119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:02.734119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:02.734119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:02.734119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:02.734119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:02.734119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:02.734119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:02.734119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:02.734119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:02.734119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:02.734119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:02.734119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:02.734119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:02.734119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:02.734119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:02.734119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:02.734119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:02.735016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:02.735016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:02.735016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:02.735016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:02.735016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 346/692] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:02.736108 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-1ffb5df6-0380-4ef4-95a8-0e32fe725cc5 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:02.740414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1ffb5df6-0380-4ef4-95a8-0e32fe725cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:02.743065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36891441-ff43-4f90-b9ea-d4665118351c None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:02.868178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 347/693] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:02:02.882704 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36891441-ff43-4f90-b9ea-d4665118351c None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:02.908726 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:02.912883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb5df6-0380-4ef4-95a8-0e32fe725cc5 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:02.921403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbf87d-0b76-4cfc-8183-57150b7505c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:02.922076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbf87d-0b76-4cfc-8183-57150b7505c4 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:02.922522 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbf87d-0b76-4cfc-8183-57150b7505c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:02.922704 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbf87d-0b76-4cfc-8183-57150b7505c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:02.923408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbf87d-0b76-4cfc-8183-57150b7505c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:02.923716 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbf87d-0b76-4cfc-8183-57150b7505c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:02.925127 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbf87d-0b76-4cfc-8183-57150b7505c4 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:02.938143 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 347/694] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:02.945438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbf87d-0b76-4cfc-8183-57150b7505c4 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:03.087766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbf87d-0b76-4cfc-8183-57150b7505c4 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:03.156630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f0083-9ced-490f-bf51-a9179af53781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:03.156630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f0083-9ced-490f-bf51-a9179af53781 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:03.156630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f0083-9ced-490f-bf51-a9179af53781 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:03.156630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f0083-9ced-490f-bf51-a9179af53781 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:03.168046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f0083-9ced-490f-bf51-a9179af53781 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:03.182025 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f0083-9ced-490f-bf51-a9179af53781 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:03.210362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-5a1f0083-9ced-490f-bf51-a9179af53781 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:03.210362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:03.210362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:03.210362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:03.210362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:03.210362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:03.210362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:03.210362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:03.210362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:03.210362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:03.210362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:03.210362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:03.210362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:03.210362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:03.210362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:03.211295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:03.211295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:03.211295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:03.211295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:03.211295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:03.211295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:03.211295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:03.211295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:03.211295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:03.211295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:03.211295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:03.211295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:03.211295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:03.211295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:03.211295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:03.211295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:03.211295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:03.212833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:03.212833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:03.212833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:03.212833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:03.212833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:03.212833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:03.212833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:03.212833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:03.212833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 348/695] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:03.221473 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f0083-9ced-490f-bf51-a9179af53781 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:03.240607 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:03.250579 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb5df6-0380-4ef4-95a8-0e32fe725cc5 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:03.356714 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:03.393354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1f72c-a1da-4b95-9af5-d207ef2d5fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:03.394177 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1f72c-a1da-4b95-9af5-d207ef2d5fdc None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:03.395421 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1f72c-a1da-4b95-9af5-d207ef2d5fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:03.395421 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1f72c-a1da-4b95-9af5-d207ef2d5fdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:03.444442 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1f72c-a1da-4b95-9af5-d207ef2d5fdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:03.446012 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1f72c-a1da-4b95-9af5-d207ef2d5fdc None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:03.507373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-9ba1f72c-a1da-4b95-9af5-d207ef2d5fdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:03.507373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:03.507373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:03.507373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:03.507373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:03.507373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:03.507373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:03.507373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:03.507373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:03.507373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:03.507373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:03.507373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:03.507373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:03.507373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:03.507373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:03.508384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:03.508384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:03.508384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:03.508384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:03.508384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:03.508384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:03.508384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:03.508384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:03.508384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:03.508384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:03.508384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:03.508384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:03.508384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:03.508384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:03.508384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:03.508384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:03.508384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:03.509970 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:03.509970 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:03.509970 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:03.509970 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:03.509970 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 348/696] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 597 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:03.516522 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1f72c-a1da-4b95-9af5-d207ef2d5fdc None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:03.555860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f0083-9ced-490f-bf51-a9179af53781 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:03.673436 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39811293-97b0-4bec-80fc-ec3aea9562f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:03.674233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39811293-97b0-4bec-80fc-ec3aea9562f7 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:03.674404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39811293-97b0-4bec-80fc-ec3aea9562f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:03.674672 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39811293-97b0-4bec-80fc-ec3aea9562f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:03.675476 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39811293-97b0-4bec-80fc-ec3aea9562f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:03.675785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39811293-97b0-4bec-80fc-ec3aea9562f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:03.679245 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39811293-97b0-4bec-80fc-ec3aea9562f7 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:03.704270 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 349/697] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:02:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:03.710792 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39811293-97b0-4bec-80fc-ec3aea9562f7 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:03.751925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1f72c-a1da-4b95-9af5-d207ef2d5fdc None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:03.825513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c3ca6-e475-4d04-a78c-d1ce46a7da27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:03.826116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c3ca6-e475-4d04-a78c-d1ce46a7da27 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:03.826401 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c3ca6-e475-4d04-a78c-d1ce46a7da27 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:03.826678 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c3ca6-e475-4d04-a78c-d1ce46a7da27 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:03.827415 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c3ca6-e475-4d04-a78c-d1ce46a7da27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:03.827725 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c3ca6-e475-4d04-a78c-d1ce46a7da27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:03.829152 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c3ca6-e475-4d04-a78c-d1ce46a7da27 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:03.862960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 349/698] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:03.873678 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c3ca6-e475-4d04-a78c-d1ce46a7da27 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:03.896033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39811293-97b0-4bec-80fc-ec3aea9562f7 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:03.905701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:03.916962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:03.952103 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ebe50-e199-49ef-a297-b8dff0865f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:03.952986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ebe50-e199-49ef-a297-b8dff0865f97 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:03.953271 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ebe50-e199-49ef-a297-b8dff0865f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:03.954649 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ebe50-e199-49ef-a297-b8dff0865f97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:03.955505 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ebe50-e199-49ef-a297-b8dff0865f97 None admin] RBAC: Adding query filter params (role.id=6391321aa2bd4ed5980bebfc65f307a9, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=6304e47844214d2db0acfae11e4714ee) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:03.955818 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ebe50-e199-49ef-a297-b8dff0865f97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:03.959001 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ebe50-e199-49ef-a297-b8dff0865f97 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:03.967593 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 350/699] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:02:03 2022] GET /identity/v3/role_assignments?user.id=6304e47844214d2db0acfae11e4714ee&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=6391321aa2bd4ed5980bebfc65f307a9 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:04.009903 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a06e41-007a-4c0e-be9c-2635674294ba None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:04.010265 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a06e41-007a-4c0e-be9c-2635674294ba None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:04.010474 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a06e41-007a-4c0e-be9c-2635674294ba None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:04.012248 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 351/700] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:02:04.017426 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7adf2-caf4-481a-bcef-c3d55144b2df None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:04.018069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7adf2-caf4-481a-bcef-c3d55144b2df None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:04.018411 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7adf2-caf4-481a-bcef-c3d55144b2df None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:04.020079 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 352/701] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:02:04.021162 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce455fc-4cc8-42ff-9f32-ddd5ce696619 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:04.021457 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce455fc-4cc8-42ff-9f32-ddd5ce696619 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:04.021732 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce455fc-4cc8-42ff-9f32-ddd5ce696619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:04.026267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c3ca6-e475-4d04-a78c-d1ce46a7da27 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:04.050425 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-2ce455fc-4cc8-42ff-9f32-ddd5ce696619 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:04.052907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-2ce455fc-4cc8-42ff-9f32-ddd5ce696619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:04.068033 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391da08-675a-484e-bd9b-6075bbbc995b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:04.068756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391da08-675a-484e-bd9b-6075bbbc995b None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:04.069095 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391da08-675a-484e-bd9b-6075bbbc995b None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:04.069379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391da08-675a-484e-bd9b-6075bbbc995b None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:04.070111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391da08-675a-484e-bd9b-6075bbbc995b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:04.071600 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391da08-675a-484e-bd9b-6075bbbc995b None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:04.136894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 353/702] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:02:04.138669 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f6e40-2e40-4496-a17a-0cc39dccb026 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:04.139251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f6e40-2e40-4496-a17a-0cc39dccb026 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:04.139750 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f6e40-2e40-4496-a17a-0cc39dccb026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:04.157267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 350/703] 10.222.0.66 () {60 vars in 1132 bytes} [Thu May 26 21:02:03 2022] POST /identity/v3/users => generated 254 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:02:04.165137 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-ca0f6e40-2e40-4496-a17a-0cc39dccb026 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:04.166762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ca0f6e40-2e40-4496-a17a-0cc39dccb026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:04.184159 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391da08-675a-484e-bd9b-6075bbbc995b None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:04.264536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 354/704] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:02:04.288100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:04.302725 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f6e40-2e40-4496-a17a-0cc39dccb026 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:04.338211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391da08-675a-484e-bd9b-6075bbbc995b None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:04.353125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:04.390382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3206f9-d2b1-4bc0-8578-fa3002411f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:04.391648 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3206f9-d2b1-4bc0-8578-fa3002411f01 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:04.391945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3206f9-d2b1-4bc0-8578-fa3002411f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:04.392225 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3206f9-d2b1-4bc0-8578-fa3002411f01 None admin] PATH_INFO: `/v3/services/network` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:04.393295 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3206f9-d2b1-4bc0-8578-fa3002411f01 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:04.395140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3206f9-d2b1-4bc0-8578-fa3002411f01 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:04.410258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-2d3206f9-d2b1-4bc0-8578-fa3002411f01 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 21:02:04.410258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:04.410258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:04.410258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:04.410258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:04.410258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:04.410258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:04.410258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:04.410258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 21:02:04.410258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:04.410258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:04.410258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:04.410258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:04.410258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:04.410258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:04.410258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:04.410258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:04.411309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:04.411309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:04.411309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:04.411309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:04.411309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:04.411309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:04.411309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:04.411309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:04.411309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:04.411309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:04.411309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:04.411309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:04.411309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:04.411309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:04.411309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:04.411309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:04.412862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:04.412862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:04.412862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:04.412862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:04.412862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:04.412862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:04.412862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:04.412862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:04.412862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:04.412862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:04.412862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:04.412862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:04.412862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 21:02:04.412862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:04.412862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 351/705] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:04 2022] GET /identity/v3/services/network => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:04.417404 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3206f9-d2b1-4bc0-8578-fa3002411f01 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:04.460154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f6e40-2e40-4496-a17a-0cc39dccb026 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:04.498518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37ebd1-dcef-4d30-9a5d-845f7d704193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:04.499751 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37ebd1-dcef-4d30-9a5d-845f7d704193 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:04.500221 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37ebd1-dcef-4d30-9a5d-845f7d704193 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:04.500702 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37ebd1-dcef-4d30-9a5d-845f7d704193 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:04.513356 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37ebd1-dcef-4d30-9a5d-845f7d704193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:04.522074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-fa37ebd1-dcef-4d30-9a5d-845f7d704193 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:02:04.522074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:04.522074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:04.522074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:04.522074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:04.522074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:04.522074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:04.522074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:04.522074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:04.522074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:04.522074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:04.522074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:04.522074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:04.522074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:04.522074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:04.522074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:04.523052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:04.523052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:04.523052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:04.523052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:04.523052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:04.523052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:04.523052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:04.523052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:04.523052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:04.523052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:04.523052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:04.523052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:04.523052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:04.523052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:04.523052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:04.523052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:04.523895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:04.523895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:04.523895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:04.523895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:04.523895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:04.523895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:04.523895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:04.523895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:04.523895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:04.523895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:04.523895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:02:04.523895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:04.526290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 355/706] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:02:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:04.532538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37ebd1-dcef-4d30-9a5d-845f7d704193 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:04.535824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3206f9-d2b1-4bc0-8578-fa3002411f01 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:04.569859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:04.579439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ff6dd-4a18-4f67-b71a-8bd277188ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:04.580131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ff6dd-4a18-4f67-b71a-8bd277188ffb None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:04.580530 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ff6dd-4a18-4f67-b71a-8bd277188ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:04.581391 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ff6dd-4a18-4f67-b71a-8bd277188ffb None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:04.581809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ff6dd-4a18-4f67-b71a-8bd277188ffb None admin] RBAC: Adding query filter params (name=network) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:04.582226 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ff6dd-4a18-4f67-b71a-8bd277188ffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:04.584953 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ff6dd-4a18-4f67-b71a-8bd277188ffb None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:04.591444 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 352/707] 10.222.0.66 () {56 vars in 1112 bytes} [Thu May 26 21:02:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:04.597263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ff6dd-4a18-4f67-b71a-8bd277188ffb None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:04.656374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:04.667181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37ebd1-dcef-4d30-9a5d-845f7d704193 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:04.705948 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e565abd-1b42-4c5d-85cd-81051dd7aa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:04.707315 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e565abd-1b42-4c5d-85cd-81051dd7aa01 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:04.707747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e565abd-1b42-4c5d-85cd-81051dd7aa01 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:04.708169 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e565abd-1b42-4c5d-85cd-81051dd7aa01 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:04.708312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ff6dd-4a18-4f67-b71a-8bd277188ffb None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:04.709251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e565abd-1b42-4c5d-85cd-81051dd7aa01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:04.709706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e565abd-1b42-4c5d-85cd-81051dd7aa01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:04.711449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e565abd-1b42-4c5d-85cd-81051dd7aa01 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:04.721184 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 356/708] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:02:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:04.733856 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e565abd-1b42-4c5d-85cd-81051dd7aa01 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:04.760254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b5ebf-2450-4d3b-b150-45a34937d5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:04.761102 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b5ebf-2450-4d3b-b150-45a34937d5dc None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:04.761488 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b5ebf-2450-4d3b-b150-45a34937d5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:04.761869 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b5ebf-2450-4d3b-b150-45a34937d5dc None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:04.763384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b5ebf-2450-4d3b-b150-45a34937d5dc None admin] RBAC: Adding query filter params (type=network) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:04.763999 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b5ebf-2450-4d3b-b150-45a34937d5dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:04.765506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b5ebf-2450-4d3b-b150-45a34937d5dc None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:04.779630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 353/709] 10.222.0.66 () {56 vars in 1112 bytes} [Thu May 26 21:02:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:04.846357 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e565abd-1b42-4c5d-85cd-81051dd7aa01 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:04.884923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b88bad-cbde-4a1b-8aca-0a35d76fbcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:04.886105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b88bad-cbde-4a1b-8aca-0a35d76fbcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:04.886577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b88bad-cbde-4a1b-8aca-0a35d76fbcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:04.887885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b88bad-cbde-4a1b-8aca-0a35d76fbcd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:04.889665 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518ff6e-9683-4a2b-ada2-0aabef26e9eb None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:04.890068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518ff6e-9683-4a2b-ada2-0aabef26e9eb None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:04.890494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518ff6e-9683-4a2b-ada2-0aabef26e9eb None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:04.892482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 354/710] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:04.898663 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baffef2-b723-4b1f-adf1-3d810f7dc368 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:04.899054 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baffef2-b723-4b1f-adf1-3d810f7dc368 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:04.899436 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baffef2-b723-4b1f-adf1-3d810f7dc368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:04.903501 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b88bad-cbde-4a1b-8aca-0a35d76fbcd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:04.905381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b88bad-cbde-4a1b-8aca-0a35d76fbcd7 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:04.924847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-63b88bad-cbde-4a1b-8aca-0a35d76fbcd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:04.924847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:04.924847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:04.924847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:04.924847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:04.924847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:04.924847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:04.924847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:04.924847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:04.924847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:04.924847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:04.924847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:04.924847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:04.924847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:04.924847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:04.925927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:04.925927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:04.925927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:04.925927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:04.925927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:04.925927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:04.925927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:04.925927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:04.925927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:04.925927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:04.925927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:04.925927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:04.925927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:04.925927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:04.925927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:04.925927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:04.925927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:04.926823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:04.926823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:04.926823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:04.926823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:04.929357 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 357/711] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:04.935830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b88bad-cbde-4a1b-8aca-0a35d76fbcd7 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:04.947918 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:04.949815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-7baffef2-b723-4b1f-adf1-3d810f7dc368 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:04.951574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-7baffef2-b723-4b1f-adf1-3d810f7dc368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:05.087442 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 355/712] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 21:02:05.088138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:05.105280 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b88bad-cbde-4a1b-8aca-0a35d76fbcd7 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:05.122673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baffef2-b723-4b1f-adf1-3d810f7dc368 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:05.170602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2d279-85a1-49a1-998c-d2aaa0a0fe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:05.171642 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2d279-85a1-49a1-998c-d2aaa0a0fe38 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:05.172291 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2d279-85a1-49a1-998c-d2aaa0a0fe38 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:05.173873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2d279-85a1-49a1-998c-d2aaa0a0fe38 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:05.174808 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2d279-85a1-49a1-998c-d2aaa0a0fe38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:05.176053 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2d279-85a1-49a1-998c-d2aaa0a0fe38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:05.178458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2d279-85a1-49a1-998c-d2aaa0a0fe38 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:05.203914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 358/713] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:05.209523 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2d279-85a1-49a1-998c-d2aaa0a0fe38 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:05.318887 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baffef2-b723-4b1f-adf1-3d810f7dc368 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:05.326846 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:05.358025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd701a-b8e6-42e7-ad36-943d8000adb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:05.358747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd701a-b8e6-42e7-ad36-943d8000adb6 None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:05.359045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd701a-b8e6-42e7-ad36-943d8000adb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:05.359320 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd701a-b8e6-42e7-ad36-943d8000adb6 None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:05.360059 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd701a-b8e6-42e7-ad36-943d8000adb6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:05.361474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd701a-b8e6-42e7-ad36-943d8000adb6 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:05.385634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2d279-85a1-49a1-998c-d2aaa0a0fe38 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:05.423196 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c82060-9225-49bb-8fd5-55074f8e9d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:05.424360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c82060-9225-49bb-8fd5-55074f8e9d4d None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:05.424884 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c82060-9225-49bb-8fd5-55074f8e9d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:05.425391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c82060-9225-49bb-8fd5-55074f8e9d4d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:05.433839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c82060-9225-49bb-8fd5-55074f8e9d4d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:05.436129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c82060-9225-49bb-8fd5-55074f8e9d4d None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:05.452858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-e9c82060-9225-49bb-8fd5-55074f8e9d4d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 21:02:05.452858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:05.452858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:05.452858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:05.452858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:05.452858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:05.452858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:05.452858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:05.452858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:05.452858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:05.452858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:05.452858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:05.452858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:02:05.452858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:02:05.452858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:02:05.452858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:02:05.453830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:05.453830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:05.453830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:02:05.453830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:05.453830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:02:05.453830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:05.453830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:05.453830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:05.453830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:05.453830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:05.453830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:05.453830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:05.453830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:05.453830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:05.453830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:05.453830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:05.453830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:05.453830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:05.454743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:05.454743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:05.454743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:02:05.454743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:02:05.454743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:02:05.454743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:02:05.454743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:02:05.454743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:02:05.454743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 21:02:05.454743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:05.457007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 359/714] 10.222.0.66 () {56 vars in 1093 bytes} [Thu May 26 21:02:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:05.466381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c82060-9225-49bb-8fd5-55074f8e9d4d None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:05.475932 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 356/715] 10.222.0.66 () {60 vars in 1141 bytes} [Thu May 26 21:02:05 2022] POST /identity/v3/services => generated 251 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:02:05.622239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c82060-9225-49bb-8fd5-55074f8e9d4d None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:05.652608 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:05.682075 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664e68a-6a20-4589-bad0-b2d63ed1cea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:05.682765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664e68a-6a20-4589-bad0-b2d63ed1cea6 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:05.683254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664e68a-6a20-4589-bad0-b2d63ed1cea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:05.683538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664e68a-6a20-4589-bad0-b2d63ed1cea6 None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:05.684838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664e68a-6a20-4589-bad0-b2d63ed1cea6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:05.685100 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664e68a-6a20-4589-bad0-b2d63ed1cea6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:05.686561 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664e68a-6a20-4589-bad0-b2d63ed1cea6 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:05.706928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 360/716] 10.222.0.66 () {56 vars in 1133 bytes} [Thu May 26 21:02:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:05.712096 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd701a-b8e6-42e7-ad36-943d8000adb6 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:05.796999 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:05.853432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd701a-b8e6-42e7-ad36-943d8000adb6 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:05.888641 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b8d0a-8aa9-4e8c-b5bb-91a70f7641b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:05.889416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b8d0a-8aa9-4e8c-b5bb-91a70f7641b9 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:05.889706 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b8d0a-8aa9-4e8c-b5bb-91a70f7641b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:05.889988 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b8d0a-8aa9-4e8c-b5bb-91a70f7641b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:05.959603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b8d0a-8aa9-4e8c-b5bb-91a70f7641b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:05.961022 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b8d0a-8aa9-4e8c-b5bb-91a70f7641b9 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:06.009495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:06.063351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 357/717] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:02:05 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 21:02:06.069343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664e68a-6a20-4589-bad0-b2d63ed1cea6 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:06.190136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664e68a-6a20-4589-bad0-b2d63ed1cea6 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:06.235163 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9b494-2037-4eba-82a1-4de62d71f284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:06.235894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9b494-2037-4eba-82a1-4de62d71f284 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:06.236183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9b494-2037-4eba-82a1-4de62d71f284 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:06.236462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9b494-2037-4eba-82a1-4de62d71f284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:06.248007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9b494-2037-4eba-82a1-4de62d71f284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:06.249501 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9b494-2037-4eba-82a1-4de62d71f284 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:06.268769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-c5a9b494-2037-4eba-82a1-4de62d71f284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:06.268769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:06.268769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:06.268769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:06.268769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:06.268769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:06.268769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:06.268769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:06.268769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:06.268769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:06.268769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:06.268769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:06.268769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:06.268769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:06.268769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:06.277409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:06.277409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:06.277409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:06.277409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:06.277409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:06.277409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:06.277409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:06.277409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:06.277409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:06.277409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:06.277409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:06.277409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:06.277409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:06.277409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:06.277409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:06.277409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:06.277409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:06.278336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:06.278336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:06.278336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:06.278336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:06.278336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 361/718] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:06.278640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b8d0a-8aa9-4e8c-b5bb-91a70f7641b9 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:06.381373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b8d0a-8aa9-4e8c-b5bb-91a70f7641b9 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:06.416705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f754b1-5003-46d6-924c-9b597d9b51d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:06.417379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f754b1-5003-46d6-924c-9b597d9b51d8 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:06.417707 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f754b1-5003-46d6-924c-9b597d9b51d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:06.417992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f754b1-5003-46d6-924c-9b597d9b51d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:06.418768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f754b1-5003-46d6-924c-9b597d9b51d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:06.419078 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f754b1-5003-46d6-924c-9b597d9b51d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:06.420469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f754b1-5003-46d6-924c-9b597d9b51d8 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:06.436148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 358/719] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:06.439032 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9b494-2037-4eba-82a1-4de62d71f284 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:06.489091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:06.556144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9b494-2037-4eba-82a1-4de62d71f284 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:06.601367 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da90653-de69-4019-8e3a-8f83c860917e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:06.602178 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da90653-de69-4019-8e3a-8f83c860917e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:06.602467 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da90653-de69-4019-8e3a-8f83c860917e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:06.602751 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da90653-de69-4019-8e3a-8f83c860917e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:06.617722 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da90653-de69-4019-8e3a-8f83c860917e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:06.619183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da90653-de69-4019-8e3a-8f83c860917e None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:06.641098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-4da90653-de69-4019-8e3a-8f83c860917e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:06.641098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:06.641098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:06.641098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:06.641098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:06.641098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:06.641098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:06.641098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:06.641098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:06.641098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:06.641098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:06.641098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:06.641098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:06.641098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:06.641098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:06.642096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:06.642096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:06.642096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:06.642096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:06.642096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:06.642096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:06.642096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:06.642096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:06.642096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:06.642096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:06.642096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:06.642096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:06.642096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:06.642096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:06.642096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:06.642096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:06.642096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:06.643007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:06.643007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:06.643007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:06.643007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:06.643007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:06.643007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:06.643007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:06.643007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:06.643007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 362/720] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:06.648211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f754b1-5003-46d6-924c-9b597d9b51d8 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:06.666709 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:06.803396 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f754b1-5003-46d6-924c-9b597d9b51d8 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:06.851692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f2933-f398-4a0e-8d17-06f178423f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:06.852360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f2933-f398-4a0e-8d17-06f178423f90 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:06.852668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f2933-f398-4a0e-8d17-06f178423f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:06.852947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f2933-f398-4a0e-8d17-06f178423f90 None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:06.853739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f2933-f398-4a0e-8d17-06f178423f90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:06.854045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f2933-f398-4a0e-8d17-06f178423f90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:06.855472 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f2933-f398-4a0e-8d17-06f178423f90 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:06.869208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 359/721] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:02:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:06.875423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da90653-de69-4019-8e3a-8f83c860917e None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:06.956871 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7197e-fa02-406e-b797-25f90dd96319 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:06.957572 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7197e-fa02-406e-b797-25f90dd96319 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:06.958073 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7197e-fa02-406e-b797-25f90dd96319 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:06.960213 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 360/722] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:02:06.966495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62119b-1f60-4599-9b86-b793aec65a87 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:06.967071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62119b-1f60-4599-9b86-b793aec65a87 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:06.967559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62119b-1f60-4599-9b86-b793aec65a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:06.997646 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-eb62119b-1f60-4599-9b86-b793aec65a87 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:06.998843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-eb62119b-1f60-4599-9b86-b793aec65a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:07.055363 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:07.064621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:07.070393 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 361/723] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:06 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:02:07.072758 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da90653-de69-4019-8e3a-8f83c860917e None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:07.109117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62119b-1f60-4599-9b86-b793aec65a87 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:07.123418 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c8c33-14f3-4634-b4ea-099559e53564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:07.124099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c8c33-14f3-4634-b4ea-099559e53564 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:07.124381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c8c33-14f3-4634-b4ea-099559e53564 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:07.126003 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c8c33-14f3-4634-b4ea-099559e53564 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:07.128519 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c8c33-14f3-4634-b4ea-099559e53564 None admin] RBAC: Adding query filter params (role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=df008eed25464be387741ee7a1e5ce80) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:07.128863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c8c33-14f3-4634-b4ea-099559e53564 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:07.130317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c8c33-14f3-4634-b4ea-099559e53564 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:07.145607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 363/724] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:02:06 2022] GET /identity/v3/role_assignments?user.id=df008eed25464be387741ee7a1e5ce80&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:07.146971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eaeed-c108-4089-a44c-576c6366144f None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:07.147256 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eaeed-c108-4089-a44c-576c6366144f None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:07.147534 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eaeed-c108-4089-a44c-576c6366144f None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:07.148987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 364/725] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:07.166412 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daecac-f00f-48d8-bb6c-cf41a5786b21 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:07.166756 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daecac-f00f-48d8-bb6c-cf41a5786b21 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:07.166965 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daecac-f00f-48d8-bb6c-cf41a5786b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:07.199291 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-02daecac-f00f-48d8-bb6c-cf41a5786b21 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:07.200571 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-02daecac-f00f-48d8-bb6c-cf41a5786b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:07.329661 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62119b-1f60-4599-9b86-b793aec65a87 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:07.362756 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 365/726] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:07 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:02:07.388078 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daecac-f00f-48d8-bb6c-cf41a5786b21 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:07.391269 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3810fd7-98db-41d3-bed2-4e84099d473b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:07.392687 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3810fd7-98db-41d3-bed2-4e84099d473b None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:07.392687 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3810fd7-98db-41d3-bed2-4e84099d473b None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:07.392881 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3810fd7-98db-41d3-bed2-4e84099d473b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:07.410055 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3810fd7-98db-41d3-bed2-4e84099d473b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:07.425567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-a3810fd7-98db-41d3-bed2-4e84099d473b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:02:07.425567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:07.425567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:07.425567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:07.425567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:07.425567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:07.425567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:07.425567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:07.425567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:07.425567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:07.425567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:07.425567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:07.425567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:07.425567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:07.425567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:07.425567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:07.426531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:07.426531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:07.426531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:07.426531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:07.426531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:07.426531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:07.426531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:07.426531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:07.426531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:07.426531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:07.426531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:07.426531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:07.426531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:07.426531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:07.426531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:07.426531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:07.427360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:07.427360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:07.427360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:07.427360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:07.427360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:07.427360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:07.427360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:07.427360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:07.427360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:07.427360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:07.427360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:02:07.427360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:07.427360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 362/727] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:02:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:07.437821 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3810fd7-98db-41d3-bed2-4e84099d473b None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:07.508825 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:07.513409 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:07.528716 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daecac-f00f-48d8-bb6c-cf41a5786b21 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:07.558917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3810fd7-98db-41d3-bed2-4e84099d473b None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:07.566313 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676997d-4280-4d41-b0ba-27fc6b9db435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:07.567212 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676997d-4280-4d41-b0ba-27fc6b9db435 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:07.567605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676997d-4280-4d41-b0ba-27fc6b9db435 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:07.568010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676997d-4280-4d41-b0ba-27fc6b9db435 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:07.579619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676997d-4280-4d41-b0ba-27fc6b9db435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:07.587605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-9676997d-4280-4d41-b0ba-27fc6b9db435 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:02:07.587605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:07.587605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:07.587605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:07.587605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:07.587605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:07.587605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:07.587605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:07.587605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:07.587605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:07.587605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:07.587605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:07.587605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:07.587605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:07.587605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:07.587605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:07.588630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:07.588630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:07.588630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:07.588630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:07.588630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:07.588630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:07.588630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:07.588630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:07.588630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:07.588630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:07.588630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:07.588630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:07.588630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:07.588630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:07.588630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:07.588630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:07.589470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:07.589470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:07.589470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:07.589470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:07.589470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:07.589470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:07.589470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:07.589470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:07.589470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:07.589470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:07.589470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:02:07.589470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:07.589470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 366/728] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:02:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:07.591408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0419761-1a57-41b7-8b5c-90310efd08f0 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:07.591678 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0419761-1a57-41b7-8b5c-90310efd08f0 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:07.592068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0419761-1a57-41b7-8b5c-90310efd08f0 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:07.593742 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 367/729] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:07.597432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0419761-1a57-41b7-8b5c-90310efd08f0 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:07.604263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f15e01-78c6-4902-91f2-422fb22ca06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:07.605311 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f15e01-78c6-4902-91f2-422fb22ca06f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:07.605810 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f15e01-78c6-4902-91f2-422fb22ca06f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:07.606831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f15e01-78c6-4902-91f2-422fb22ca06f None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:07.607812 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f15e01-78c6-4902-91f2-422fb22ca06f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:07.608341 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f15e01-78c6-4902-91f2-422fb22ca06f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:07.610003 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f15e01-78c6-4902-91f2-422fb22ca06f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:07.622415 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 363/730] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:02:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:07.624197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211332c0-2e77-4583-a7d7-9f1fda2b829e None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:07.624758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211332c0-2e77-4583-a7d7-9f1fda2b829e None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:07.625246 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211332c0-2e77-4583-a7d7-9f1fda2b829e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:07.645216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-211332c0-2e77-4583-a7d7-9f1fda2b829e None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:07.646425 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-211332c0-2e77-4583-a7d7-9f1fda2b829e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:07.728888 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 364/731] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:07 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 21:02:07.729934 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211332c0-2e77-4583-a7d7-9f1fda2b829e None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:07.741516 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0419761-1a57-41b7-8b5c-90310efd08f0 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:07.786633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb99577-be04-4287-9168-a576204d9c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:07.787732 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb99577-be04-4287-9168-a576204d9c07 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:07.788276 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb99577-be04-4287-9168-a576204d9c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:07.788984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb99577-be04-4287-9168-a576204d9c07 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:07.790367 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb99577-be04-4287-9168-a576204d9c07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:07.791187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb99577-be04-4287-9168-a576204d9c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:07.793032 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb99577-be04-4287-9168-a576204d9c07 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:07.793168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:07.805783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 368/732] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:02:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:07.807267 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb99577-be04-4287-9168-a576204d9c07 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:07.858636 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211332c0-2e77-4583-a7d7-9f1fda2b829e None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:07.898072 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4ee2e-e75d-403c-9abd-9a14ede4b232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:07.898887 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4ee2e-e75d-403c-9abd-9a14ede4b232 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:07.899171 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4ee2e-e75d-403c-9abd-9a14ede4b232 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:07.899444 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4ee2e-e75d-403c-9abd-9a14ede4b232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:07.913383 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4ee2e-e75d-403c-9abd-9a14ede4b232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:07.916004 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4ee2e-e75d-403c-9abd-9a14ede4b232 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:07.936504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-e3e4ee2e-e75d-403c-9abd-9a14ede4b232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:07.936504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:07.936504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:07.936504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:07.936504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:07.936504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:07.936504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:07.936504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:07.936504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:07.936504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:07.936504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:07.936504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:07.936504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:07.936504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:07.936504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:07.937496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:07.937496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:07.937496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:07.937496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:07.937496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:07.937496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:07.937496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:07.937496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:07.937496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:07.937496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:07.937496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:07.937496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:07.937496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:07.937496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:07.937496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:07.937496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:07.937496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:07.938370 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:07.938370 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:07.938370 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:07.938370 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:07.938370 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 365/733] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:07.939118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4ee2e-e75d-403c-9abd-9a14ede4b232 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:07.974873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:08.061039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4ee2e-e75d-403c-9abd-9a14ede4b232 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:08.062802 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:08.099163 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb99577-be04-4287-9168-a576204d9c07 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:08.099543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d444fa6-fbbc-47b9-9618-7d306a195d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:08.100354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d444fa6-fbbc-47b9-9618-7d306a195d45 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:08.100680 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d444fa6-fbbc-47b9-9618-7d306a195d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:08.100963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d444fa6-fbbc-47b9-9618-7d306a195d45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:08.113016 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d444fa6-fbbc-47b9-9618-7d306a195d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:08.114298 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d444fa6-fbbc-47b9-9618-7d306a195d45 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:08.133500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-6d444fa6-fbbc-47b9-9618-7d306a195d45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:08.133500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:08.133500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:08.133500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:08.133500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:08.133500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:08.133500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:08.133500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:08.133500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:08.133500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:08.133500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:08.133500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:08.133500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:08.133500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:08.133500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:08.134499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:08.134499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:08.134499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:08.134499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:08.134499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:08.134499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:08.134499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:08.134499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:08.134499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:08.134499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:08.134499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:08.134499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:08.134499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:08.134499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:08.134499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:08.134499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:08.134499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:08.135395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:08.135395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:08.135395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:08.135395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:08.135395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 366/734] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:08.136123 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d444fa6-fbbc-47b9-9618-7d306a195d45 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:08.148506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f18ec-c9cc-4c26-883c-0be409dd3b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:08.148506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f18ec-c9cc-4c26-883c-0be409dd3b3b None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:08.148506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f18ec-c9cc-4c26-883c-0be409dd3b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:08.148506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f18ec-c9cc-4c26-883c-0be409dd3b3b None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:08.148946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f18ec-c9cc-4c26-883c-0be409dd3b3b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:08.148946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f18ec-c9cc-4c26-883c-0be409dd3b3b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:08.233886 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 369/735] 10.222.0.66 () {60 vars in 1141 bytes} [Thu May 26 21:02:07 2022] POST /identity/v3/services => generated 240 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:02:08.235229 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f18ec-c9cc-4c26-883c-0be409dd3b3b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:08.263796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d444fa6-fbbc-47b9-9618-7d306a195d45 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:08.353033 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12383199-028f-4725-b414-f24e943e7cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:08.353775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12383199-028f-4725-b414-f24e943e7cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:08.354036 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12383199-028f-4725-b414-f24e943e7cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:08.354257 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12383199-028f-4725-b414-f24e943e7cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:08.354998 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12383199-028f-4725-b414-f24e943e7cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:08.355300 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12383199-028f-4725-b414-f24e943e7cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:08.356860 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12383199-028f-4725-b414-f24e943e7cf7 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:08.383072 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:08.384608 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 367/736] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:08.391804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12383199-028f-4725-b414-f24e943e7cf7 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:08.417009 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:08.459974 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f18ec-c9cc-4c26-883c-0be409dd3b3b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:08.503252 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f02a1-659d-456c-96a4-f9786f713832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:08.503935 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f02a1-659d-456c-96a4-f9786f713832 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:08.504262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f02a1-659d-456c-96a4-f9786f713832 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:08.504537 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f02a1-659d-456c-96a4-f9786f713832 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:08.505298 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f02a1-659d-456c-96a4-f9786f713832 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:08.505602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f02a1-659d-456c-96a4-f9786f713832 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:08.506966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f02a1-659d-456c-96a4-f9786f713832 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:08.522734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 370/737] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:08.523900 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26ceae-e2bb-44aa-b951-4bedbdd53cd2 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:08.524201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26ceae-e2bb-44aa-b951-4bedbdd53cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:08.524456 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26ceae-e2bb-44aa-b951-4bedbdd53cd2 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:08.529608 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 371/738] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:08.529608 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26ceae-e2bb-44aa-b951-4bedbdd53cd2 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:08.543254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12383199-028f-4725-b414-f24e943e7cf7 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:08.597123 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703f030-341f-4ff3-8184-1d9407461cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:08.598661 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703f030-341f-4ff3-8184-1d9407461cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:08.599234 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703f030-341f-4ff3-8184-1d9407461cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:08.599689 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703f030-341f-4ff3-8184-1d9407461cc2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:08.610541 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703f030-341f-4ff3-8184-1d9407461cc2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:08.611989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703f030-341f-4ff3-8184-1d9407461cc2 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:08.627217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-1703f030-341f-4ff3-8184-1d9407461cc2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 21:02:08.627217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:08.627217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:08.627217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:08.627217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:08.627217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:08.627217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:08.627217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:08.627217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:08.627217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:08.627217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:08.627217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:08.627217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:02:08.627217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:02:08.627217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:02:08.627217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:02:08.628232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:08.628232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:08.628232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:02:08.628232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:08.628232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:02:08.628232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:08.628232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:08.628232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:08.628232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:08.628232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:08.628232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:08.628232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:08.628232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:08.628232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:08.628232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:08.628232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:08.628232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:08.628232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:08.629215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:08.629215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:08.629215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:02:08.629215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:02:08.629215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:02:08.629215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:02:08.629215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:02:08.629215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:02:08.629215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 21:02:08.629215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:08.629215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 368/739] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:02:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:08.630308 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962669b4-2db2-4787-934f-389be82f1ce6 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:08.630409 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962669b4-2db2-4787-934f-389be82f1ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:08.630658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962669b4-2db2-4787-934f-389be82f1ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:08.648231 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-962669b4-2db2-4787-934f-389be82f1ce6 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:08.649407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-962669b4-2db2-4787-934f-389be82f1ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:08.667458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26ceae-e2bb-44aa-b951-4bedbdd53cd2 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:08.709008 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:08.722026 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:08.723450 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea64810-5601-4140-a9a7-4656637f2606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:08.724709 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea64810-5601-4140-a9a7-4656637f2606 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:08.725236 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea64810-5601-4140-a9a7-4656637f2606 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:08.725791 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea64810-5601-4140-a9a7-4656637f2606 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:08.732736 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 369/740] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:08.736055 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962669b4-2db2-4787-934f-389be82f1ce6 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:08.736176 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea64810-5601-4140-a9a7-4656637f2606 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:08.736827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea64810-5601-4140-a9a7-4656637f2606 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:08.769671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-7ea64810-5601-4140-a9a7-4656637f2606 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 21:02:08.769671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:08.769671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:08.769671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:08.769671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:08.769671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:08.769671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:08.769671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:08.769671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:08.769671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:08.769671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:08.769671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:08.769671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:02:08.769671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:02:08.769671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:02:08.769671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:02:08.775536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:08.775536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:08.775536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:02:08.775536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:08.775536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:02:08.775536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:08.775536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:08.775536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:08.775536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:08.775536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:08.775536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:08.775536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:08.775536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:08.775536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:08.775536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:08.775536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:08.775536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:08.775536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:08.776462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:08.776462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:08.776462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:02:08.776462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:02:08.776462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:02:08.776462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:02:08.776462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:02:08.776462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:02:08.776462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 21:02:08.776462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:08.776462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 372/741] 10.222.0.66 () {56 vars in 1117 bytes} [Thu May 26 21:02:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:08.776462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea64810-5601-4140-a9a7-4656637f2606 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:08.870041 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962669b4-2db2-4787-934f-389be82f1ce6 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:08.882703 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea64810-5601-4140-a9a7-4656637f2606 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:08.919142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa9a8e-1ce5-4220-b408-35643340e6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:08.919914 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa9a8e-1ce5-4220-b408-35643340e6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:08.920119 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa9a8e-1ce5-4220-b408-35643340e6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:08.920350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa9a8e-1ce5-4220-b408-35643340e6e1 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:08.921318 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa9a8e-1ce5-4220-b408-35643340e6e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:08.921620 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa9a8e-1ce5-4220-b408-35643340e6e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:08.923188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa9a8e-1ce5-4220-b408-35643340e6e1 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:08.927138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f6a72-312c-49a0-8921-654009b8acc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:08.928266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f6a72-312c-49a0-8921-654009b8acc2 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:08.928786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f6a72-312c-49a0-8921-654009b8acc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:08.929268 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f6a72-312c-49a0-8921-654009b8acc2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:08.930163 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f6a72-312c-49a0-8921-654009b8acc2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:08.932032 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f6a72-312c-49a0-8921-654009b8acc2 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:08.950319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 370/742] 10.222.0.66 () {56 vars in 1135 bytes} [Thu May 26 21:02:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:08.951091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-0b0f6a72-312c-49a0-8921-654009b8acc2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 21:02:08.951091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:08.951091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:08.951091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:08.951091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:08.951091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:08.951091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:08.951091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:08.951091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 21:02:08.951091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:08.951091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:08.951091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:08.951091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:08.951091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:08.951091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:08.951091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:08.952037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:08.952037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:08.952037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:08.952037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:08.952037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:08.952037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:08.952037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:08.952037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:08.952037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:08.952037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:08.952037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:08.952037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:08.952037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:08.952037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:08.952037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:08.952037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:08.952894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:08.952894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:08.952894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:08.952894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:08.952894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:08.952894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:08.952894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:08.952894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:08.952894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:08.952894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:08.952894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:08.952894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:08.952894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:08.952894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 21:02:08.952894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:08.953690 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa9a8e-1ce5-4220-b408-35643340e6e1 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:08.957131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 373/743] 10.222.0.66 () {56 vars in 1129 bytes} [Thu May 26 21:02:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:08.960887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f6a72-312c-49a0-8921-654009b8acc2 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:09.035431 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:09.040375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:09.093209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f6a72-312c-49a0-8921-654009b8acc2 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:09.099845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa9a8e-1ce5-4220-b408-35643340e6e1 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:09.142379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f77c4-d455-47b6-b74a-5790f8032d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:09.143191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f77c4-d455-47b6-b74a-5790f8032d84 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:09.143571 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f77c4-d455-47b6-b74a-5790f8032d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:09.143915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00683fb0-31a6-418d-bb3a-6c276e3d1d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:09.144078 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f77c4-d455-47b6-b74a-5790f8032d84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:09.145021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00683fb0-31a6-418d-bb3a-6c276e3d1d5b None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:09.145450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00683fb0-31a6-418d-bb3a-6c276e3d1d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:09.145879 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00683fb0-31a6-418d-bb3a-6c276e3d1d5b None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:09.146911 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00683fb0-31a6-418d-bb3a-6c276e3d1d5b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:09.147726 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00683fb0-31a6-418d-bb3a-6c276e3d1d5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:09.150437 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00683fb0-31a6-418d-bb3a-6c276e3d1d5b None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:09.179802 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 371/744] 10.222.0.66 () {56 vars in 1149 bytes} [Thu May 26 21:02:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:09.181704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00683fb0-31a6-418d-bb3a-6c276e3d1d5b None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:09.233448 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f77c4-d455-47b6-b74a-5790f8032d84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:09.234897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f77c4-d455-47b6-b74a-5790f8032d84 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:09.331515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:09.358985 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00683fb0-31a6-418d-bb3a-6c276e3d1d5b None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:09.382463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:09.402106 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de018aed-eda2-4030-a917-b9aff6a8784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:09.403588 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de018aed-eda2-4030-a917-b9aff6a8784d None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:09.403704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de018aed-eda2-4030-a917-b9aff6a8784d None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:09.403956 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de018aed-eda2-4030-a917-b9aff6a8784d None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:09.404757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de018aed-eda2-4030-a917-b9aff6a8784d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:09.405011 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de018aed-eda2-4030-a917-b9aff6a8784d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:09.406405 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de018aed-eda2-4030-a917-b9aff6a8784d None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:09.413245 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 374/745] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:02:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:02:09.415962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 372/746] 10.222.0.66 () {56 vars in 1124 bytes} [Thu May 26 21:02:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:09.417997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f77c4-d455-47b6-b74a-5790f8032d84 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:09.419357 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de018aed-eda2-4030-a917-b9aff6a8784d None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:09.548560 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de018aed-eda2-4030-a917-b9aff6a8784d None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:09.552795 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f77c4-d455-47b6-b74a-5790f8032d84 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:09.588492 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30823e3a-7eab-44ae-a94f-3a5e6cdd0417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:09.589320 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30823e3a-7eab-44ae-a94f-3a5e6cdd0417 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:09.589604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30823e3a-7eab-44ae-a94f-3a5e6cdd0417 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:09.590044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30823e3a-7eab-44ae-a94f-3a5e6cdd0417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:09.596133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca21bd-2ab6-453c-ae44-774099c5319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:09.596831 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca21bd-2ab6-453c-ae44-774099c5319b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:09.597110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca21bd-2ab6-453c-ae44-774099c5319b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:09.597382 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca21bd-2ab6-453c-ae44-774099c5319b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:09.602496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30823e3a-7eab-44ae-a94f-3a5e6cdd0417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:09.603971 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30823e3a-7eab-44ae-a94f-3a5e6cdd0417 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:09.619612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:09.633720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-30823e3a-7eab-44ae-a94f-3a5e6cdd0417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:09.633720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:09.633720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:09.633720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:09.633720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:09.633720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:09.633720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:09.633720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:09.633720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:09.633720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:09.633720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:09.633720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:09.633720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:09.633720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:09.633720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:09.642632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:09.642632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:09.642632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:09.642632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:09.642632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:09.642632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:09.642632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:09.642632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:09.642632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:09.642632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:09.642632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:09.642632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:09.642632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:09.642632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:09.642632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:09.642632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:09.642632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:09.643676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:09.643676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:09.643676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:09.643676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:09.643676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 373/747] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:09.643676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30823e3a-7eab-44ae-a94f-3a5e6cdd0417 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:09.675424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:09.681702 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca21bd-2ab6-453c-ae44-774099c5319b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:09.682592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca21bd-2ab6-453c-ae44-774099c5319b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:09.756695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30823e3a-7eab-44ae-a94f-3a5e6cdd0417 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:09.792260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e2412-1f1d-4c8f-8676-ecdd5c8f830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:09.792960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e2412-1f1d-4c8f-8676-ecdd5c8f830d None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:09.793759 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e2412-1f1d-4c8f-8676-ecdd5c8f830d None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:09.794053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e2412-1f1d-4c8f-8676-ecdd5c8f830d None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:09.794765 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e2412-1f1d-4c8f-8676-ecdd5c8f830d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:09.795068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e2412-1f1d-4c8f-8676-ecdd5c8f830d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:09.796461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e2412-1f1d-4c8f-8676-ecdd5c8f830d None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:09.808733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 374/748] 10.222.0.66 () {56 vars in 1124 bytes} [Thu May 26 21:02:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:09.808733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19493cb4-841e-47fd-94a4-2e2d34f8273e None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:09.808733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19493cb4-841e-47fd-94a4-2e2d34f8273e None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:09.808733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19493cb4-841e-47fd-94a4-2e2d34f8273e None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:09.808733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 375/749] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:09.809228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 375/750] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:02:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:02:09.809304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19493cb4-841e-47fd-94a4-2e2d34f8273e None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:09.809385 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca21bd-2ab6-453c-ae44-774099c5319b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:09.877759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:09.921024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:09.926220 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19493cb4-841e-47fd-94a4-2e2d34f8273e None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:09.941085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca21bd-2ab6-453c-ae44-774099c5319b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:09.971606 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35f2d4-f655-4e51-8acf-1ab279305765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:09.972606 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35f2d4-f655-4e51-8acf-1ab279305765 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:09.972736 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35f2d4-f655-4e51-8acf-1ab279305765 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:09.972972 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35f2d4-f655-4e51-8acf-1ab279305765 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:09.973844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35f2d4-f655-4e51-8acf-1ab279305765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:09.974797 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35f2d4-f655-4e51-8acf-1ab279305765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:09.975930 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35f2d4-f655-4e51-8acf-1ab279305765 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:09.994084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 376/751] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:09.994084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200599c-8aad-48c0-94aa-ecca7810cbdc None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:09.994084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200599c-8aad-48c0-94aa-ecca7810cbdc None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:09.994084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200599c-8aad-48c0-94aa-ecca7810cbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:09.994732 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa0f74-84e6-4fc3-b8e4-65105ce00857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:09.995540 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa0f74-84e6-4fc3-b8e4-65105ce00857 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:09.995823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa0f74-84e6-4fc3-b8e4-65105ce00857 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:09.996099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa0f74-84e6-4fc3-b8e4-65105ce00857 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:10.009578 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa0f74-84e6-4fc3-b8e4-65105ce00857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:10.011009 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa0f74-84e6-4fc3-b8e4-65105ce00857 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:10.016097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-8200599c-8aad-48c0-94aa-ecca7810cbdc None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:10.017548 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-8200599c-8aad-48c0-94aa-ecca7810cbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:10.029826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-96fa0f74-84e6-4fc3-b8e4-65105ce00857 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:10.029826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:10.029826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:10.029826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:10.029826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:10.029826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:10.029826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:10.029826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:10.029826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:10.029826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:10.029826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:10.029826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:10.029826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:10.029826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:10.029826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:10.030777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:10.030777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:10.030777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:10.030777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:10.030777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:10.030777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:10.030777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:10.030777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:10.030777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:10.030777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:10.030777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:10.030777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:10.030777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:10.030777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:10.030777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:10.030777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:10.030777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:10.036836 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:10.036836 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:10.036836 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:10.036836 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:10.036836 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 376/752] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:10.036836 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa0f74-84e6-4fc3-b8e4-65105ce00857 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:10.120557 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 377/753] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:10.121619 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200599c-8aad-48c0-94aa-ecca7810cbdc None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:10.184005 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa0f74-84e6-4fc3-b8e4-65105ce00857 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:10.185818 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:10.223747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:10.228564 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9fb49-0bde-4bc2-b1e6-29aa2836259e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:10.229483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9fb49-0bde-4bc2-b1e6-29aa2836259e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:10.229918 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9fb49-0bde-4bc2-b1e6-29aa2836259e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:10.230372 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9fb49-0bde-4bc2-b1e6-29aa2836259e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:10.231938 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9fb49-0bde-4bc2-b1e6-29aa2836259e None admin] RBAC: Adding query filter params (interface=public, service_id=6b3b5fa4d9364c44af057f5d38235588, region_id=RegionOne) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:10.232424 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9fb49-0bde-4bc2-b1e6-29aa2836259e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:10.233833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9fb49-0bde-4bc2-b1e6-29aa2836259e None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:10.242032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200599c-8aad-48c0-94aa-ecca7810cbdc None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:10.242605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 377/754] 10.222.0.66 () {56 vars in 1251 bytes} [Thu May 26 21:02:10 2022] GET /identity/v3/endpoints?service_id=6b3b5fa4d9364c44af057f5d38235588&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:10.243526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9fb49-0bde-4bc2-b1e6-29aa2836259e None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:10.334515 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cfb1d-df15-4424-8abb-bfdeb5c4f113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:10.335691 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cfb1d-df15-4424-8abb-bfdeb5c4f113 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:10.336187 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cfb1d-df15-4424-8abb-bfdeb5c4f113 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:10.336689 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cfb1d-df15-4424-8abb-bfdeb5c4f113 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:10.345669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cfb1d-df15-4424-8abb-bfdeb5c4f113 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:10.347416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cfb1d-df15-4424-8abb-bfdeb5c4f113 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:10.364616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-343cfb1d-df15-4424-8abb-bfdeb5c4f113 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:10.364616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:10.364616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:10.364616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:10.364616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:10.364616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:10.364616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:10.364616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:10.364616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:10.364616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:10.364616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:10.364616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:10.364616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:10.364616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:10.364616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:10.365567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:10.365567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:10.365567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:10.365567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:10.365567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:10.365567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:10.365567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:10.365567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:10.365567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:10.365567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:10.365567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:10.365567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:10.365567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:10.365567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:10.365567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:10.365567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:10.365567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:10.366449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:10.366449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:10.366449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:10.366449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:10.366449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:10.366449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:10.366449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:10.366449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:10.368475 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 378/755] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:10.369444 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cfb1d-df15-4424-8abb-bfdeb5c4f113 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:10.419907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9fb49-0bde-4bc2-b1e6-29aa2836259e None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:10.463646 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f659c-36a0-4e40-8a9a-393b5f1590e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:10.465011 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f659c-36a0-4e40-8a9a-393b5f1590e7 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:10.466085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f659c-36a0-4e40-8a9a-393b5f1590e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:10.466367 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f659c-36a0-4e40-8a9a-393b5f1590e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:10.467156 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f659c-36a0-4e40-8a9a-393b5f1590e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:10.467469 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f659c-36a0-4e40-8a9a-393b5f1590e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:10.468941 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f659c-36a0-4e40-8a9a-393b5f1590e7 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:10.486066 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 378/756] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:10.486066 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f659c-36a0-4e40-8a9a-393b5f1590e7 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:10.492989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cfb1d-df15-4424-8abb-bfdeb5c4f113 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:10.518953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:10.541494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e17df-b2ed-4cac-9d6b-d7c18ad75d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:10.542392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e17df-b2ed-4cac-9d6b-d7c18ad75d42 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:10.542673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e17df-b2ed-4cac-9d6b-d7c18ad75d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:10.542939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e17df-b2ed-4cac-9d6b-d7c18ad75d42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:10.557811 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e17df-b2ed-4cac-9d6b-d7c18ad75d42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:10.565859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-386e17df-b2ed-4cac-9d6b-d7c18ad75d42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:02:10.565859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:10.565859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:10.565859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:10.565859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:10.565859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:10.565859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:10.565859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:10.565859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:10.565859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:10.565859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:10.565859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:10.565859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:10.565859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:10.565859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:10.565859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:10.566845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:10.566845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:10.566845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:10.566845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:10.566845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:10.566845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:10.566845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:10.566845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:10.566845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:10.566845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:10.566845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:10.566845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:10.566845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:10.566845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:10.566845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:10.566845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:10.567702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:10.567702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:10.567702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:10.567702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:10.567702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:10.567702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:10.567702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:10.567702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:10.567702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:10.567702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:10.567702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:02:10.567702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:10.567702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 379/757] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:02:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:10.568403 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e17df-b2ed-4cac-9d6b-d7c18ad75d42 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:10.584898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:10.621753 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f659c-36a0-4e40-8a9a-393b5f1590e7 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:10.662041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61fb1b-69ed-492f-b39b-44955e7e7a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:10.663002 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61fb1b-69ed-492f-b39b-44955e7e7a87 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:10.663427 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61fb1b-69ed-492f-b39b-44955e7e7a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:10.663711 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61fb1b-69ed-492f-b39b-44955e7e7a87 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:10.664404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61fb1b-69ed-492f-b39b-44955e7e7a87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:10.665807 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61fb1b-69ed-492f-b39b-44955e7e7a87 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:10.673450 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 379/758] 10.222.0.66 () {56 vars in 1087 bytes} [Thu May 26 21:02:10 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:10.674320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61fb1b-69ed-492f-b39b-44955e7e7a87 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:10.683190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e17df-b2ed-4cac-9d6b-d7c18ad75d42 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:10.728136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376defb9-1877-4a43-a49b-4ca4c1d2dc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:10.728837 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376defb9-1877-4a43-a49b-4ca4c1d2dc76 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:10.729185 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376defb9-1877-4a43-a49b-4ca4c1d2dc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:10.729385 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376defb9-1877-4a43-a49b-4ca4c1d2dc76 None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:10.730201 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376defb9-1877-4a43-a49b-4ca4c1d2dc76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:10.730506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376defb9-1877-4a43-a49b-4ca4c1d2dc76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:10.732066 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376defb9-1877-4a43-a49b-4ca4c1d2dc76 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:10.754327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 380/759] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:02:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:10.754327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376defb9-1877-4a43-a49b-4ca4c1d2dc76 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:10.814953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:10.826811 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61fb1b-69ed-492f-b39b-44955e7e7a87 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:10.838856 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:10.874465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74a1a7-5091-43af-9223-6799507fa282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:10.876205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74a1a7-5091-43af-9223-6799507fa282 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:10.876205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74a1a7-5091-43af-9223-6799507fa282 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:10.876437 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74a1a7-5091-43af-9223-6799507fa282 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:10.884335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376defb9-1877-4a43-a49b-4ca4c1d2dc76 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:10.886180 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74a1a7-5091-43af-9223-6799507fa282 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:10.888215 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74a1a7-5091-43af-9223-6799507fa282 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:10.905068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-9a74a1a7-5091-43af-9223-6799507fa282 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:10.905068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:10.905068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:10.905068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:10.905068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:10.905068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:10.905068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:10.905068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:10.905068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:10.905068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:10.905068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:10.905068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:10.905068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:10.905068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:10.905068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:10.906024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:10.906024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:10.906024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:10.906024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:10.906024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:10.906024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:10.906024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:10.906024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:10.906024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:10.906024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:10.906024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:10.906024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:10.906024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:10.906024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:10.906024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:10.906024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:10.906024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:10.906905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:10.906905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:10.906905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:10.906905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:10.906905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:10.906905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:10.906905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:10.906905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:10.906905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 380/760] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:10.908314 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9253ea-9e2f-49bc-a0e3-4233a8091e30 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:10.908314 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9253ea-9e2f-49bc-a0e3-4233a8091e30 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:10.908492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9253ea-9e2f-49bc-a0e3-4233a8091e30 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:10.909931 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 381/761] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:10.910503 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9253ea-9e2f-49bc-a0e3-4233a8091e30 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:10.932179 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204c9de-79f4-46dd-967a-3da25b30bb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:10.932918 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204c9de-79f4-46dd-967a-3da25b30bb6d None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:10.933237 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204c9de-79f4-46dd-967a-3da25b30bb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:10.933674 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204c9de-79f4-46dd-967a-3da25b30bb6d None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:10.934901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204c9de-79f4-46dd-967a-3da25b30bb6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:10.935209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204c9de-79f4-46dd-967a-3da25b30bb6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:10.936653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204c9de-79f4-46dd-967a-3da25b30bb6d None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:10.945325 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 381/762] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:02:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:10.946596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afa0e1-4a2d-4745-803f-47e23dce8795 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:10.946884 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afa0e1-4a2d-4745-803f-47e23dce8795 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:10.947162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afa0e1-4a2d-4745-803f-47e23dce8795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:10.967700 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-22afa0e1-4a2d-4745-803f-47e23dce8795 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:10.968920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-22afa0e1-4a2d-4745-803f-47e23dce8795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:11.047935 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9253ea-9e2f-49bc-a0e3-4233a8091e30 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:11.052826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 382/763] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:11.052826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afa0e1-4a2d-4745-803f-47e23dce8795 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:11.094035 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d2e75-aac4-404f-8a29-6e23dd81694c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:11.094620 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2e75-aac4-404f-8a29-6e23dd81694c None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:11.094906 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2e75-aac4-404f-8a29-6e23dd81694c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:11.095181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2e75-aac4-404f-8a29-6e23dd81694c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:11.096097 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d2e75-aac4-404f-8a29-6e23dd81694c None admin] RBAC: Adding query filter params (role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=6304e47844214d2db0acfae11e4714ee) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:11.096699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d2e75-aac4-404f-8a29-6e23dd81694c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:11.097963 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d2e75-aac4-404f-8a29-6e23dd81694c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:11.104354 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 382/764] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:02:10 2022] GET /identity/v3/role_assignments?user.id=6304e47844214d2db0acfae11e4714ee&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:11.110804 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d2e75-aac4-404f-8a29-6e23dd81694c None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:11.135963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:11.138317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:11.199081 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afa0e1-4a2d-4745-803f-47e23dce8795 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:11.240116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e60664-eac9-44ff-b2c0-5b719a7600be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:11.240927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e60664-eac9-44ff-b2c0-5b719a7600be None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:11.241318 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e60664-eac9-44ff-b2c0-5b719a7600be None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:11.241913 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e60664-eac9-44ff-b2c0-5b719a7600be None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:11.242874 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e60664-eac9-44ff-b2c0-5b719a7600be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:11.243197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e60664-eac9-44ff-b2c0-5b719a7600be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:11.244730 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e60664-eac9-44ff-b2c0-5b719a7600be None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:11.257869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d2e75-aac4-404f-8a29-6e23dd81694c None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:11.259933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 383/765] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:02:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:11.261066 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e60664-eac9-44ff-b2c0-5b719a7600be None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:11.299923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55b73f-ed78-4ccf-950a-5ab0385eeffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:11.300811 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55b73f-ed78-4ccf-950a-5ab0385eeffe None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:11.301099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55b73f-ed78-4ccf-950a-5ab0385eeffe None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:11.301371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55b73f-ed78-4ccf-950a-5ab0385eeffe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:11.318838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55b73f-ed78-4ccf-950a-5ab0385eeffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:11.320428 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55b73f-ed78-4ccf-950a-5ab0385eeffe None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:11.339969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-0a55b73f-ed78-4ccf-950a-5ab0385eeffe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:11.339969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:11.339969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:11.339969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:11.339969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:11.339969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:11.339969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:11.339969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:11.339969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:11.339969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:11.339969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:11.339969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:11.339969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:11.339969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:11.339969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:11.341182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:11.341182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:11.341182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:11.341182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:11.341182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:11.341182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:11.341182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:11.341182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:11.341182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:11.341182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:11.341182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:11.341182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:11.341182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:11.341182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:11.341182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:11.341182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:11.341182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:11.342060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:11.342060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:11.342060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:11.342060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:11.348887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 383/766] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:11.348887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55b73f-ed78-4ccf-950a-5ab0385eeffe None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:11.392606 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e60664-eac9-44ff-b2c0-5b719a7600be None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:11.416798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:11.435687 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c64d3-8ba8-499c-bac3-17f622c811f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:11.439643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c64d3-8ba8-499c-bac3-17f622c811f5 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:11.439643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c64d3-8ba8-499c-bac3-17f622c811f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:11.439643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c64d3-8ba8-499c-bac3-17f622c811f5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:11.439643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c64d3-8ba8-499c-bac3-17f622c811f5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:11.439643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c64d3-8ba8-499c-bac3-17f622c811f5 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:11.439997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:11.451774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-405c64d3-8ba8-499c-bac3-17f622c811f5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 21:02:11.451774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:11.451774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:11.451774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:11.451774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:11.451774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:11.451774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:11.451774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:11.451774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 21:02:11.451774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:11.451774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:11.451774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:11.451774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:11.451774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:11.451774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:11.451774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:11.451774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:11.452823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:11.452823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:11.452823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:11.452823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:11.452823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:11.452823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:11.452823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:11.452823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:11.452823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:11.452823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:11.452823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:11.452823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:11.452823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:11.452823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:11.452823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:11.452823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:11.453657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:11.453657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:11.453657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:11.453657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:11.453657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:11.453657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:11.453657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:11.453657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:11.453657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:11.453657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:11.453657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:11.453657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:11.453657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 21:02:11.453657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:11.453657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 384/767] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:11 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:11.454558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c64d3-8ba8-499c-bac3-17f622c811f5 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:11.490773 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55b73f-ed78-4ccf-950a-5ab0385eeffe None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:11.532463 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3d7c7-b833-4ace-b9da-9d01594e9514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:11.533162 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3d7c7-b833-4ace-b9da-9d01594e9514 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:11.533478 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3d7c7-b833-4ace-b9da-9d01594e9514 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:11.533746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3d7c7-b833-4ace-b9da-9d01594e9514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:11.534582 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3d7c7-b833-4ace-b9da-9d01594e9514 None admin] RBAC: Adding query filter params (role.id=6391321aa2bd4ed5980bebfc65f307a9, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=5890e1e70ffd4e33a812691e9c43b6d2) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:11.534885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3d7c7-b833-4ace-b9da-9d01594e9514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:11.536373 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3d7c7-b833-4ace-b9da-9d01594e9514 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:11.548767 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 384/768] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:02:11 2022] GET /identity/v3/role_assignments?user.id=5890e1e70ffd4e33a812691e9c43b6d2&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=6391321aa2bd4ed5980bebfc65f307a9 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:11.549804 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3d7c7-b833-4ace-b9da-9d01594e9514 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:11.589097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c64d3-8ba8-499c-bac3-17f622c811f5 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:11.638055 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc123b6-f247-4462-85e7-19336b7bf6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:11.638055 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc123b6-f247-4462-85e7-19336b7bf6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:11.638355 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc123b6-f247-4462-85e7-19336b7bf6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:11.638506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc123b6-f247-4462-85e7-19336b7bf6c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:11.639235 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc123b6-f247-4462-85e7-19336b7bf6c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:11.639542 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc123b6-f247-4462-85e7-19336b7bf6c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:11.645109 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc123b6-f247-4462-85e7-19336b7bf6c4 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:11.666590 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 385/769] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:11.675290 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc123b6-f247-4462-85e7-19336b7bf6c4 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:11.733412 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3d7c7-b833-4ace-b9da-9d01594e9514 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:11.760197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:11.771220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:11.777316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb457cd-e078-4894-bb9a-0312d4ad8da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:11.779225 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb457cd-e078-4894-bb9a-0312d4ad8da7 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:11.779671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb457cd-e078-4894-bb9a-0312d4ad8da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:11.780119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb457cd-e078-4894-bb9a-0312d4ad8da7 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:11.781062 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb457cd-e078-4894-bb9a-0312d4ad8da7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:11.781534 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb457cd-e078-4894-bb9a-0312d4ad8da7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:11.783104 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb457cd-e078-4894-bb9a-0312d4ad8da7 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:11.789659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 385/770] 10.222.0.66 () {56 vars in 1112 bytes} [Thu May 26 21:02:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:11.795851 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb457cd-e078-4894-bb9a-0312d4ad8da7 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:11.923106 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb457cd-e078-4894-bb9a-0312d4ad8da7 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:11.940323 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc123b6-f247-4462-85e7-19336b7bf6c4 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:11.995056 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56a503-e780-4628-8b36-21c1b8694487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:11.996700 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56a503-e780-4628-8b36-21c1b8694487 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:11.997164 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56a503-e780-4628-8b36-21c1b8694487 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:11.997655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56a503-e780-4628-8b36-21c1b8694487 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:12.006746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56a503-e780-4628-8b36-21c1b8694487 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:12.008455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56a503-e780-4628-8b36-21c1b8694487 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:12.011581 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca410f5-a31b-40b7-869b-3516f901b3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:12.012443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca410f5-a31b-40b7-869b-3516f901b3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:12.016816 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca410f5-a31b-40b7-869b-3516f901b3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:12.017142 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca410f5-a31b-40b7-869b-3516f901b3a1 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:12.017907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca410f5-a31b-40b7-869b-3516f901b3a1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:12.018218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca410f5-a31b-40b7-869b-3516f901b3a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:12.019623 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca410f5-a31b-40b7-869b-3516f901b3a1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:12.031354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-4f56a503-e780-4628-8b36-21c1b8694487 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 21:02:12.031354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:12.031354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:12.031354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:12.031354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:12.031354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:12.031354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:12.031354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:12.031354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:12.031354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:12.031354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:12.031354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:12.031354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:02:12.031354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:02:12.031354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:02:12.031354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:02:12.032562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:12.032562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:12.032562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:02:12.032562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:12.032562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:02:12.032562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:12.032562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:12.032562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:12.032562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:12.032562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:12.032562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:12.032562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:12.032562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:12.032562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:12.032562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:12.032562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:12.032562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:12.032562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:12.033762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:12.033762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:12.033762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:02:12.033762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:02:12.033762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:02:12.033762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:02:12.033762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:02:12.033762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:02:12.033762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 21:02:12.033762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:12.034901 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 386/771] 10.222.0.66 () {56 vars in 1112 bytes} [Thu May 26 21:02:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:12.036295 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 386/772] 10.222.0.66 () {56 vars in 1093 bytes} [Thu May 26 21:02:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:12.044619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca410f5-a31b-40b7-869b-3516f901b3a1 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:12.045756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56a503-e780-4628-8b36-21c1b8694487 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:12.161378 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:12.225007 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56a503-e780-4628-8b36-21c1b8694487 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:12.229820 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:12.252696 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca410f5-a31b-40b7-869b-3516f901b3a1 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:12.311337 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e466ddc-13ca-427f-afa4-7a79e6f69ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:12.312926 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e466ddc-13ca-427f-afa4-7a79e6f69ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:12.314325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aff08-fe04-4d70-8fd1-51a8998d9d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:12.315328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e466ddc-13ca-427f-afa4-7a79e6f69ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:12.316200 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aff08-fe04-4d70-8fd1-51a8998d9d4e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:12.316757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e466ddc-13ca-427f-afa4-7a79e6f69ca1 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:12.317831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e466ddc-13ca-427f-afa4-7a79e6f69ca1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:12.318321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aff08-fe04-4d70-8fd1-51a8998d9d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:12.318798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aff08-fe04-4d70-8fd1-51a8998d9d4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:12.319798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833aff08-fe04-4d70-8fd1-51a8998d9d4e None admin] RBAC: Adding query filter params (interface=public, service_id=6231e51cb4b94b88becf9c4b67219287, region_id=RegionOne) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:12.320341 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e466ddc-13ca-427f-afa4-7a79e6f69ca1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:12.321031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833aff08-fe04-4d70-8fd1-51a8998d9d4e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:12.322353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e466ddc-13ca-427f-afa4-7a79e6f69ca1 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:12.322466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833aff08-fe04-4d70-8fd1-51a8998d9d4e None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:12.333764 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 387/773] 10.222.0.66 () {56 vars in 1251 bytes} [Thu May 26 21:02:12 2022] GET /identity/v3/endpoints?service_id=6231e51cb4b94b88becf9c4b67219287&interface=public®ion_id=RegionOne => generated 194 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:12.341621 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aff08-fe04-4d70-8fd1-51a8998d9d4e None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:12.365969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 387/774] 10.222.0.66 () {56 vars in 1133 bytes} [Thu May 26 21:02:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:12.366940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e466ddc-13ca-427f-afa4-7a79e6f69ca1 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:12.541205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aff08-fe04-4d70-8fd1-51a8998d9d4e None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:12.561913 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e466ddc-13ca-427f-afa4-7a79e6f69ca1 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:12.604968 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:12.618018 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d553db-93d8-408a-95f7-e730d1a97a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:12.618700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d553db-93d8-408a-95f7-e730d1a97a7b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:12.618981 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d553db-93d8-408a-95f7-e730d1a97a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:12.626315 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d553db-93d8-408a-95f7-e730d1a97a7b None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:12.626315 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d553db-93d8-408a-95f7-e730d1a97a7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:12.626315 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d553db-93d8-408a-95f7-e730d1a97a7b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:12.635415 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c47e9-4e6b-42bd-82ab-50a5381568a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:12.636295 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c47e9-4e6b-42bd-82ab-50a5381568a8 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:12.636591 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c47e9-4e6b-42bd-82ab-50a5381568a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:12.636923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c47e9-4e6b-42bd-82ab-50a5381568a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:12.637841 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 388/775] 10.222.0.66 () {56 vars in 1087 bytes} [Thu May 26 21:02:12 2022] GET /identity/v3/services => generated 772 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:12.658080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c47e9-4e6b-42bd-82ab-50a5381568a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:12.659614 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c47e9-4e6b-42bd-82ab-50a5381568a8 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:12.684813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-e80c47e9-4e6b-42bd-82ab-50a5381568a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:12.684813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:12.684813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:12.684813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:12.684813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:12.684813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:12.684813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:12.684813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:12.684813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:12.684813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:12.684813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:12.684813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:12.684813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:12.684813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:12.684813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:12.685761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:12.685761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:12.685761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:12.685761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:12.685761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:12.685761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:12.685761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:12.685761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:12.685761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:12.685761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:12.685761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:12.685761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:12.685761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:12.685761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:12.685761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:12.685761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:12.685761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:12.686643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:12.686643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:12.686643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:12.686643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:12.686643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 388/776] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:12.692897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d553db-93d8-408a-95f7-e730d1a97a7b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:12.875937 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d553db-93d8-408a-95f7-e730d1a97a7b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:12.928494 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c10480-eb5c-417b-8a10-1b08f9e0436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:12.929215 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c10480-eb5c-417b-8a10-1b08f9e0436e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:12.929504 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c10480-eb5c-417b-8a10-1b08f9e0436e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:12.929780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c10480-eb5c-417b-8a10-1b08f9e0436e None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:12.930533 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c10480-eb5c-417b-8a10-1b08f9e0436e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:12.930842 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c10480-eb5c-417b-8a10-1b08f9e0436e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:12.932229 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c10480-eb5c-417b-8a10-1b08f9e0436e None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:12.946350 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 389/777] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:12.951972 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c47e9-4e6b-42bd-82ab-50a5381568a8 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:12.977375 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:13.046729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71badcc-dfcb-402b-8c1f-ae8c99238ef2 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:13.047037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71badcc-dfcb-402b-8c1f-ae8c99238ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:13.047289 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71badcc-dfcb-402b-8c1f-ae8c99238ef2 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:13.049120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 390/778] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:02:13.054670 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c21996-b0e3-4164-a1da-c91a2b849228 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:13.054981 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c21996-b0e3-4164-a1da-c91a2b849228 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:13.055226 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c21996-b0e3-4164-a1da-c91a2b849228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:13.079749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c47e9-4e6b-42bd-82ab-50a5381568a8 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:13.084441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-a4c21996-b0e3-4164-a1da-c91a2b849228 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:13.085717 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-a4c21996-b0e3-4164-a1da-c91a2b849228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:13.121485 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67671865-fb18-44d7-9b05-51acdc2c38ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:13.122291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67671865-fb18-44d7-9b05-51acdc2c38ec None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:13.122574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67671865-fb18-44d7-9b05-51acdc2c38ec None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:13.122851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67671865-fb18-44d7-9b05-51acdc2c38ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:13.132178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67671865-fb18-44d7-9b05-51acdc2c38ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:13.133706 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67671865-fb18-44d7-9b05-51acdc2c38ec None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:13.147383 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:13.149097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-67671865-fb18-44d7-9b05-51acdc2c38ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:13.149097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:13.149097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:13.149097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:13.149097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:13.149097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:13.149097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:13.149097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:13.149097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:13.149097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:13.149097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:13.149097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:13.149097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:13.149097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:13.149097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:13.149955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:13.149955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:13.149955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:13.149955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:13.149955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:13.149955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:13.149955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:13.149955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:13.149955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:13.149955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:13.149955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:13.149955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:13.149955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:13.149955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:13.149955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:13.149955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:13.149955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:13.151045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:13.151045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:13.151045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:13.151045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:13.151045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:13.151045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:13.151045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:13.151045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:13.151045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 389/779] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:13.158110 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67671865-fb18-44d7-9b05-51acdc2c38ec None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:13.203888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 391/780] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:13.252964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c21996-b0e3-4164-a1da-c91a2b849228 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:13.277047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:13.335724 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67671865-fb18-44d7-9b05-51acdc2c38ec None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:13.409131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdc02b-0733-4733-a2b2-c78adaf06fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:13.410155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdc02b-0733-4733-a2b2-c78adaf06fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:13.410647 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdc02b-0733-4733-a2b2-c78adaf06fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:13.411149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdc02b-0733-4733-a2b2-c78adaf06fe1 None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:13.412177 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdc02b-0733-4733-a2b2-c78adaf06fe1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:13.412719 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdc02b-0733-4733-a2b2-c78adaf06fe1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:13.414392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdc02b-0733-4733-a2b2-c78adaf06fe1 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:13.436556 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 390/781] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:02:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:13.443394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdc02b-0733-4733-a2b2-c78adaf06fe1 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:13.460842 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c21996-b0e3-4164-a1da-c91a2b849228 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:13.541525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd1e1e-b157-4722-a8e7-70a2e5f2b97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:13.542745 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd1e1e-b157-4722-a8e7-70a2e5f2b97d None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:13.543297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd1e1e-b157-4722-a8e7-70a2e5f2b97d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:13.543795 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd1e1e-b157-4722-a8e7-70a2e5f2b97d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:13.544694 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd1e1e-b157-4722-a8e7-70a2e5f2b97d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:13.547710 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd1e1e-b157-4722-a8e7-70a2e5f2b97d None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:13.578304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-f0bd1e1e-b157-4722-a8e7-70a2e5f2b97d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 21:02:13.578304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:13.578304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:13.578304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:13.578304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:13.578304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:13.578304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:13.578304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:13.578304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 21:02:13.578304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:13.578304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:13.578304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:13.578304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:13.578304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:13.578304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:13.578304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:13.579329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:13.579329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:13.579329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:13.579329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:13.579329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:13.579329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:13.579329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:13.579329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:13.579329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:13.579329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:13.579329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:13.579329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:13.579329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:13.579329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:13.579329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:13.579329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:13.580170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:13.580170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:13.580170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:13.580170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:13.580170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:13.580170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:13.580170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:13.580170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:13.580170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:13.580170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:13.580170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:13.580170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:13.580170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:13.580170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 21:02:13.580170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:13.593031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 392/782] 10.222.0.66 () {56 vars in 1129 bytes} [Thu May 26 21:02:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:13.594177 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd1e1e-b157-4722-a8e7-70a2e5f2b97d None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:13.645870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdc02b-0733-4733-a2b2-c78adaf06fe1 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:13.677619 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:13.685636 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0083030-9dfc-46af-bdfd-2dd00480b92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:13.686853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0083030-9dfc-46af-bdfd-2dd00480b92b None admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:13.688458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0083030-9dfc-46af-bdfd-2dd00480b92b None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:13.689010 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0083030-9dfc-46af-bdfd-2dd00480b92b None admin] PATH_INFO: `/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/df008eed25464be387741ee7a1e5ce80/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:13.694129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:13.694590 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0083030-9dfc-46af-bdfd-2dd00480b92b None admin] RBAC: Authorizing `identity:create_grant(project_id=a3db24bf0708446e9b05197fafeb00e4, user_id=df008eed25464be387741ee7a1e5ce80, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:13.696140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0083030-9dfc-46af-bdfd-2dd00480b92b None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:13.765903 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd1e1e-b157-4722-a8e7-70a2e5f2b97d None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:13.792717 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 391/783] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:02:13 2022] PUT /identity/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/df008eed25464be387741ee7a1e5ce80/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:02:13.796735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618547c-73c8-4bb9-aedd-c75a74517d6e None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:13.796735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618547c-73c8-4bb9-aedd-c75a74517d6e None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:13.796735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618547c-73c8-4bb9-aedd-c75a74517d6e None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:13.796735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 392/784] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:13.808549 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259835af-1843-4ad2-a086-26e3e79a511d None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:13.809805 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259835af-1843-4ad2-a086-26e3e79a511d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:13.810307 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259835af-1843-4ad2-a086-26e3e79a511d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:13.834453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-259835af-1843-4ad2-a086-26e3e79a511d None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:13.836220 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-259835af-1843-4ad2-a086-26e3e79a511d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:13.845423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb2294-0c6f-4584-acff-4da5e2a9ab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:13.846122 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb2294-0c6f-4584-acff-4da5e2a9ab28 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:13.846403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb2294-0c6f-4584-acff-4da5e2a9ab28 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:13.846680 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb2294-0c6f-4584-acff-4da5e2a9ab28 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:13.848172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb2294-0c6f-4584-acff-4da5e2a9ab28 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:13.848483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb2294-0c6f-4584-acff-4da5e2a9ab28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:13.850356 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb2294-0c6f-4584-acff-4da5e2a9ab28 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:13.865882 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 393/785] 10.222.0.66 () {56 vars in 1124 bytes} [Thu May 26 21:02:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:13.868318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb2294-0c6f-4584-acff-4da5e2a9ab28 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:13.979532 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 393/786] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:14.027192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb2294-0c6f-4584-acff-4da5e2a9ab28 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:14.037218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:14.051666 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259835af-1843-4ad2-a086-26e3e79a511d None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:14.078758 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4f42f-a221-408b-980d-c0a5ee47548c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:14.079799 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f42f-a221-408b-980d-c0a5ee47548c None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:14.080295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f42f-a221-408b-980d-c0a5ee47548c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:14.080857 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f42f-a221-408b-980d-c0a5ee47548c None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:14.081792 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4f42f-a221-408b-980d-c0a5ee47548c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:14.082324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4f42f-a221-408b-980d-c0a5ee47548c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:14.083968 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4f42f-a221-408b-980d-c0a5ee47548c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:14.090491 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 394/787] 10.222.0.66 () {56 vars in 1124 bytes} [Thu May 26 21:02:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:14.096528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4f42f-a221-408b-980d-c0a5ee47548c None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:14.170077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259835af-1843-4ad2-a086-26e3e79a511d None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:14.195280 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:14.210006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4f42f-a221-408b-980d-c0a5ee47548c None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:14.214056 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f88eea-3ad8-4731-935a-5a837fc7d183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:14.214906 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f88eea-3ad8-4731-935a-5a837fc7d183 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:14.215190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f88eea-3ad8-4731-935a-5a837fc7d183 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:14.215466 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f88eea-3ad8-4731-935a-5a837fc7d183 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:14.241283 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f88eea-3ad8-4731-935a-5a837fc7d183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:14.250218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-89f88eea-3ad8-4731-935a-5a837fc7d183 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:02:14.250218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:14.250218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:14.250218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:14.250218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:14.250218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:14.250218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:14.250218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:14.250218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:14.250218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:14.250218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:14.250218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:14.250218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:14.250218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:14.250218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:14.250218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:14.251216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:14.251216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:14.251216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:14.251216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:14.251216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:14.251216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:14.251216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:14.251216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:14.251216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:14.251216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:14.251216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:14.251216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:14.251216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:14.251216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:14.251216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:14.251216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:14.252038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:14.252038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:14.252038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:14.252038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:14.252038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:14.252038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:14.252038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:14.252038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:14.252038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:14.252038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:14.252038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:02:14.252038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:14.252038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 394/788] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:02:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:14.253937 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb627d5d-aa72-45ea-a37e-28e8b52ee033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:14.254821 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb627d5d-aa72-45ea-a37e-28e8b52ee033 None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:14.255271 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb627d5d-aa72-45ea-a37e-28e8b52ee033 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:14.255714 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb627d5d-aa72-45ea-a37e-28e8b52ee033 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:14.256752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb627d5d-aa72-45ea-a37e-28e8b52ee033 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:14.257661 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f88eea-3ad8-4731-935a-5a837fc7d183 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:14.258838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb627d5d-aa72-45ea-a37e-28e8b52ee033 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:14.372122 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f88eea-3ad8-4731-935a-5a837fc7d183 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:14.381258 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 395/789] 10.222.0.66 () {60 vars in 1144 bytes} [Thu May 26 21:02:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:02:14.382623 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346ca4c-6d15-443c-a7a8-8ae271a96765 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:14.382913 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346ca4c-6d15-443c-a7a8-8ae271a96765 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:14.383195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346ca4c-6d15-443c-a7a8-8ae271a96765 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:14.393149 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 396/790] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:14 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:14.404409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625309-431c-4af0-96d8-9fbc397a7a0d None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:14.404809 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625309-431c-4af0-96d8-9fbc397a7a0d None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:14.405017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625309-431c-4af0-96d8-9fbc397a7a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:14.437368 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5a33c-351e-4736-8e4e-3931aaa3e2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:14.438483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5a33c-351e-4736-8e4e-3931aaa3e2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:14.438994 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5a33c-351e-4736-8e4e-3931aaa3e2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:14.439505 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5a33c-351e-4736-8e4e-3931aaa3e2a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:14.440572 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5a33c-351e-4736-8e4e-3931aaa3e2a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:14.441172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5a33c-351e-4736-8e4e-3931aaa3e2a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:14.442880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5a33c-351e-4736-8e4e-3931aaa3e2a6 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:14.450123 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-04625309-431c-4af0-96d8-9fbc397a7a0d None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:14.451135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-04625309-431c-4af0-96d8-9fbc397a7a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:14.454779 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 395/791] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:02:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:14.461677 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5a33c-351e-4736-8e4e-3931aaa3e2a6 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:14.496800 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:14.549538 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:14.615076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 397/792] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:14.641596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5a33c-351e-4736-8e4e-3931aaa3e2a6 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:14.645206 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04625309-431c-4af0-96d8-9fbc397a7a0d None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:14.687254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c95276-2730-4ff5-a51f-6d1ff89d2023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:14.688343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c95276-2730-4ff5-a51f-6d1ff89d2023 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:14.688913 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c95276-2730-4ff5-a51f-6d1ff89d2023 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:14.689341 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c95276-2730-4ff5-a51f-6d1ff89d2023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:14.702038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c95276-2730-4ff5-a51f-6d1ff89d2023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:14.703880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c95276-2730-4ff5-a51f-6d1ff89d2023 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:14.723731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-75c95276-2730-4ff5-a51f-6d1ff89d2023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:14.723731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:14.723731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:14.723731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:14.723731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:14.723731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:14.723731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:14.723731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:14.723731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:14.723731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:14.723731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:14.723731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:14.723731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:14.723731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:14.723731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:14.724945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:14.724945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:14.724945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:14.724945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:14.724945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:14.724945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:14.724945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:14.724945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:14.724945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:14.724945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:14.724945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:14.724945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:14.724945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:14.724945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:14.724945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:14.724945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:14.724945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:14.726045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:14.726045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:14.726045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:14.726045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:14.727815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 396/793] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:14.737416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c95276-2730-4ff5-a51f-6d1ff89d2023 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:14.767835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04625309-431c-4af0-96d8-9fbc397a7a0d None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:14.808094 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b0022-0fb7-43be-88c3-ca5b2ef5a891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:14.810237 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b0022-0fb7-43be-88c3-ca5b2ef5a891 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:14.810727 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b0022-0fb7-43be-88c3-ca5b2ef5a891 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:14.811154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b0022-0fb7-43be-88c3-ca5b2ef5a891 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:14.825275 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b0022-0fb7-43be-88c3-ca5b2ef5a891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:14.834558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-726b0022-0fb7-43be-88c3-ca5b2ef5a891 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:02:14.834558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:14.834558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:14.834558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:14.834558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:14.834558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:14.834558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:14.834558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:14.834558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:14.834558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:14.834558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:14.834558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:14.834558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:14.834558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:14.834558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:14.834558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:14.835715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:14.835715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:14.835715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:14.835715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:14.835715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:14.835715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:14.835715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:14.835715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:14.835715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:14.835715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:14.835715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:14.835715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:14.835715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:14.835715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:14.835715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:14.835715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:14.836566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:14.836566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:14.836566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:14.836566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:14.836566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:14.836566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:14.836566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:14.836566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:14.836566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:14.836566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:14.836566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:02:14.836566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:14.837246 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 398/794] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:02:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:14.843021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b0022-0fb7-43be-88c3-ca5b2ef5a891 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:14.849097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:14.859547 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c95276-2730-4ff5-a51f-6d1ff89d2023 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:14.861935 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:14.899344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffaf14-7741-4437-89bd-a66503d91b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:14.900381 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffaf14-7741-4437-89bd-a66503d91b1a None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:14.900896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffaf14-7741-4437-89bd-a66503d91b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:14.901355 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffaf14-7741-4437-89bd-a66503d91b1a None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:14.902286 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffaf14-7741-4437-89bd-a66503d91b1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:14.902839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffaf14-7741-4437-89bd-a66503d91b1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:14.904488 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffaf14-7741-4437-89bd-a66503d91b1a None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:14.917319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 397/795] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:14.923654 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffaf14-7741-4437-89bd-a66503d91b1a None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:14.955997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b0022-0fb7-43be-88c3-ca5b2ef5a891 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:15.002827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff1581-595a-4f4e-b2d5-ac0bc7494189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:15.003637 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff1581-595a-4f4e-b2d5-ac0bc7494189 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:15.003922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff1581-595a-4f4e-b2d5-ac0bc7494189 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:15.005512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff1581-595a-4f4e-b2d5-ac0bc7494189 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:15.006036 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff1581-595a-4f4e-b2d5-ac0bc7494189 None admin] RBAC: Adding query filter params (name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:15.006398 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff1581-595a-4f4e-b2d5-ac0bc7494189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:15.008827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff1581-595a-4f4e-b2d5-ac0bc7494189 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:15.032532 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 399/796] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:02:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:15.036648 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff1581-595a-4f4e-b2d5-ac0bc7494189 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:15.074451 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffaf14-7741-4437-89bd-a66503d91b1a None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:15.160254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a64e5-a457-4d41-a94e-e37f5d666dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:15.161652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a64e5-a457-4d41-a94e-e37f5d666dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:15.163486 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a64e5-a457-4d41-a94e-e37f5d666dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:15.164003 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a64e5-a457-4d41-a94e-e37f5d666dc6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:15.180132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:15.181117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a64e5-a457-4d41-a94e-e37f5d666dc6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:15.182431 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a64e5-a457-4d41-a94e-e37f5d666dc6 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:15.211180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-ed8a64e5-a457-4d41-a94e-e37f5d666dc6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 21:02:15.211180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:15.211180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:15.211180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:15.211180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:15.211180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:15.211180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:15.211180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:15.211180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:15.211180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:15.211180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:15.211180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:15.211180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:02:15.211180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:02:15.211180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:02:15.211180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:02:15.212244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:15.212244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:15.212244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:02:15.212244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:15.212244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:02:15.212244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:15.212244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:15.212244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:15.212244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:15.212244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:15.212244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:15.212244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:15.212244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:15.212244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:15.212244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:15.212244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:15.212244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:15.212244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:15.213294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:15.213294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:15.213294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:02:15.213294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:02:15.213294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:02:15.213294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:02:15.213294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:02:15.213294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:02:15.213294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 21:02:15.213294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:15.214375 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 398/797] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:02:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:15.226261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a64e5-a457-4d41-a94e-e37f5d666dc6 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:15.245014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff1581-595a-4f4e-b2d5-ac0bc7494189 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:15.257441 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:15.292273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf7369-f102-4f1f-8057-a8cbfb01dd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:15.294047 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf7369-f102-4f1f-8057-a8cbfb01dd7e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:15.294343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf7369-f102-4f1f-8057-a8cbfb01dd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:15.294709 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf7369-f102-4f1f-8057-a8cbfb01dd7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:15.309963 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf7369-f102-4f1f-8057-a8cbfb01dd7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:15.312468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf7369-f102-4f1f-8057-a8cbfb01dd7e None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:15.354495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-33cf7369-f102-4f1f-8057-a8cbfb01dd7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:15.354495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:15.354495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:15.354495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:15.354495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:15.354495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:15.354495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:15.354495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:15.354495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:15.354495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:15.354495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:15.354495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:15.354495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:15.354495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:15.354495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:15.355550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:15.355550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:15.355550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:15.355550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:15.355550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:15.355550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:15.355550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:15.355550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:15.355550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:15.355550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:15.355550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:15.355550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:15.355550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:15.355550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:15.355550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:15.355550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:15.355550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:15.357374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:15.357374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:15.357374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:15.357374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:15.357374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 400/798] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:15.364539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf7369-f102-4f1f-8057-a8cbfb01dd7e None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:15.453604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a64e5-a457-4d41-a94e-e37f5d666dc6 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:15.493775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceae5b3-2101-42ec-9b4e-116a5431d107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:15.494451 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceae5b3-2101-42ec-9b4e-116a5431d107 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:15.494731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceae5b3-2101-42ec-9b4e-116a5431d107 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:15.495010 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceae5b3-2101-42ec-9b4e-116a5431d107 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:15.496223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceae5b3-2101-42ec-9b4e-116a5431d107 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:15.496937 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceae5b3-2101-42ec-9b4e-116a5431d107 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:15.498513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceae5b3-2101-42ec-9b4e-116a5431d107 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:15.518354 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf7369-f102-4f1f-8057-a8cbfb01dd7e None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:15.528696 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 399/799] 10.222.0.66 () {56 vars in 1135 bytes} [Thu May 26 21:02:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:15.530445 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bee096-6b32-470e-a1ea-5a3c5cc863de None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:15.530741 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bee096-6b32-470e-a1ea-5a3c5cc863de None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:15.531014 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bee096-6b32-470e-a1ea-5a3c5cc863de None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:15.532547 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 400/800] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:15.535386 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bee096-6b32-470e-a1ea-5a3c5cc863de None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:15.565057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:15.580360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ae8a8-0e5e-43be-8194-6a090e448783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:15.581381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ae8a8-0e5e-43be-8194-6a090e448783 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:15.585152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ae8a8-0e5e-43be-8194-6a090e448783 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:15.585152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ae8a8-0e5e-43be-8194-6a090e448783 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:15.585152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ae8a8-0e5e-43be-8194-6a090e448783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:15.585152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ae8a8-0e5e-43be-8194-6a090e448783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:15.585152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ae8a8-0e5e-43be-8194-6a090e448783 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:15.599840 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 401/801] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:15.601630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780e0de-73f4-480e-b4a6-7f9152054f92 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:15.602239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780e0de-73f4-480e-b4a6-7f9152054f92 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:15.602725 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780e0de-73f4-480e-b4a6-7f9152054f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:15.622393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-7780e0de-73f4-480e-b4a6-7f9152054f92 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:15.623542 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:15.625232 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-7780e0de-73f4-480e-b4a6-7f9152054f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:15.664575 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bee096-6b32-470e-a1ea-5a3c5cc863de None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:15.714569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1c3f4-7374-4091-9484-ddd5c1f8d97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:15.714569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1c3f4-7374-4091-9484-ddd5c1f8d97d None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:15.714569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1c3f4-7374-4091-9484-ddd5c1f8d97d None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:15.714569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1c3f4-7374-4091-9484-ddd5c1f8d97d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:15.715876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 402/802] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:15.717227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780e0de-73f4-480e-b4a6-7f9152054f92 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:15.725130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1c3f4-7374-4091-9484-ddd5c1f8d97d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:15.727927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1c3f4-7374-4091-9484-ddd5c1f8d97d None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:15.749749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-45d1c3f4-7374-4091-9484-ddd5c1f8d97d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:15.749749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:15.749749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:15.749749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:15.749749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:15.749749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:15.749749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:15.749749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:15.749749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:15.749749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:15.749749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:15.749749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:15.749749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:15.749749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:15.749749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:15.750732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:15.750732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:15.750732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:15.750732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:15.750732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:15.750732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:15.750732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:15.750732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:15.750732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:15.750732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:15.750732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:15.750732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:15.750732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:15.750732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:15.750732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:15.750732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:15.750732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:15.752070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:15.752070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:15.752070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:15.752070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:15.752070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 401/803] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:15.757242 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1c3f4-7374-4091-9484-ddd5c1f8d97d None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:15.853153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780e0de-73f4-480e-b4a6-7f9152054f92 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:15.872778 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:15.897798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f6cce-363d-41ad-939e-7f74ea703b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:15.899236 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f6cce-363d-41ad-939e-7f74ea703b35 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:15.899726 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f6cce-363d-41ad-939e-7f74ea703b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:15.900291 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f6cce-363d-41ad-939e-7f74ea703b35 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:15.903163 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1c3f4-7374-4091-9484-ddd5c1f8d97d None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:15.909637 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f6cce-363d-41ad-939e-7f74ea703b35 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:15.911768 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f6cce-363d-41ad-939e-7f74ea703b35 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:15.930378 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:15.931959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-3d1f6cce-363d-41ad-939e-7f74ea703b35 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 21:02:15.931959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:15.931959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:15.931959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:15.931959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:15.931959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:15.931959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:15.931959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:15.931959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:15.931959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:15.931959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:15.931959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:15.931959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:02:15.931959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:02:15.931959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:02:15.931959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:02:15.932909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:15.932909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:15.932909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:02:15.932909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:15.932909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:02:15.932909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:15.932909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:15.932909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:15.932909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:15.932909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:15.932909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:15.932909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:15.932909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:15.932909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:15.932909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:15.932909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:15.932909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:15.932909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:15.934668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:15.934668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:15.934668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:02:15.934668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:02:15.934668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:02:15.934668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:02:15.934668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:02:15.934668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:02:15.934668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 21:02:15.934668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:15.937607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 403/804] 10.222.0.66 () {56 vars in 1117 bytes} [Thu May 26 21:02:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:15.939499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f6cce-363d-41ad-939e-7f74ea703b35 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:15.945831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2a85b-2b84-46b1-a90d-be8aa2cdb2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:15.946684 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2a85b-2b84-46b1-a90d-be8aa2cdb2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:15.946966 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2a85b-2b84-46b1-a90d-be8aa2cdb2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:15.947247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2a85b-2b84-46b1-a90d-be8aa2cdb2c5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:15.947921 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2a85b-2b84-46b1-a90d-be8aa2cdb2c5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:15.949979 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2a85b-2b84-46b1-a90d-be8aa2cdb2c5 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:15.969584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-57e2a85b-2b84-46b1-a90d-be8aa2cdb2c5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 21:02:15.969584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:15.969584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:15.969584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:15.969584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:15.969584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:15.969584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:15.969584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:15.969584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 21:02:15.969584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:15.969584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:15.969584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:15.969584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:15.969584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:15.969584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:15.969584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:15.969584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:15.970671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:15.970671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:15.970671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:15.970671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:15.970671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:15.970671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:15.970671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:15.970671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:15.970671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:15.970671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:15.970671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:15.970671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:15.970671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:15.970671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:15.970671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:15.970671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:15.976762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:15.976762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:15.976762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:15.976762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:15.976762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:15.976762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:15.976762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:15.976762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:15.976762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:15.976762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:15.976762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:15.976762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:15.976762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 21:02:15.976762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:15.976762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 402/805] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:15 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:15.977580 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2a85b-2b84-46b1-a90d-be8aa2cdb2c5 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:16.077656 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f6cce-363d-41ad-939e-7f74ea703b35 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:16.115093 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6b3a7-ff61-4861-b006-7d7516b4a84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:16.115736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6b3a7-ff61-4861-b006-7d7516b4a84a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:16.115979 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2a85b-2b84-46b1-a90d-be8aa2cdb2c5 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:16.116419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6b3a7-ff61-4861-b006-7d7516b4a84a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:16.116419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6b3a7-ff61-4861-b006-7d7516b4a84a None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:16.117036 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6b3a7-ff61-4861-b006-7d7516b4a84a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:16.117343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6b3a7-ff61-4861-b006-7d7516b4a84a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:16.118713 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6b3a7-ff61-4861-b006-7d7516b4a84a None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:16.140863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 404/806] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:16.141828 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6b3a7-ff61-4861-b006-7d7516b4a84a None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:16.164782 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421169b-3547-412e-b4fb-d283ec6b5c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:16.165497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421169b-3547-412e-b4fb-d283ec6b5c86 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:16.165788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421169b-3547-412e-b4fb-d283ec6b5c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:16.166077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421169b-3547-412e-b4fb-d283ec6b5c86 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:16.167840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421169b-3547-412e-b4fb-d283ec6b5c86 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:16.168246 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421169b-3547-412e-b4fb-d283ec6b5c86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:16.170476 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421169b-3547-412e-b4fb-d283ec6b5c86 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:16.191997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:16.198990 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 403/807] 10.222.0.66 () {56 vars in 1149 bytes} [Thu May 26 21:02:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:16.204714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421169b-3547-412e-b4fb-d283ec6b5c86 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:16.270611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:16.276824 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6b3a7-ff61-4861-b006-7d7516b4a84a None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:16.314183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8fed2-8094-41d5-8c8f-a8e89a12b6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:16.314860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8fed2-8094-41d5-8c8f-a8e89a12b6ec None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:16.315143 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8fed2-8094-41d5-8c8f-a8e89a12b6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:16.315418 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8fed2-8094-41d5-8c8f-a8e89a12b6ec None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:16.316136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8fed2-8094-41d5-8c8f-a8e89a12b6ec None admin] RBAC: Adding query filter params (name=network) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:16.316443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8fed2-8094-41d5-8c8f-a8e89a12b6ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:16.317854 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8fed2-8094-41d5-8c8f-a8e89a12b6ec None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:16.323043 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 405/808] 10.222.0.66 () {56 vars in 1112 bytes} [Thu May 26 21:02:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:16.323705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8fed2-8094-41d5-8c8f-a8e89a12b6ec None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:16.334820 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421169b-3547-412e-b4fb-d283ec6b5c86 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:16.377720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e3cfe-da56-4642-9ad9-09bb2bdf7219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:16.378977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e3cfe-da56-4642-9ad9-09bb2bdf7219 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:16.379521 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e3cfe-da56-4642-9ad9-09bb2bdf7219 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:16.380026 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e3cfe-da56-4642-9ad9-09bb2bdf7219 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:16.392383 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e3cfe-da56-4642-9ad9-09bb2bdf7219 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:16.394416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e3cfe-da56-4642-9ad9-09bb2bdf7219 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:16.410304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-f48e3cfe-da56-4642-9ad9-09bb2bdf7219 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:16.410304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:16.410304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:16.410304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:16.410304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:16.410304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:16.410304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:16.410304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:16.410304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:16.410304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:16.410304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:16.410304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:16.410304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:16.410304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:16.410304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:16.412141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:16.412141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:16.412141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:16.412141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:16.412141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:16.412141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:16.412141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:16.412141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:16.412141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:16.412141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:16.412141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:16.412141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:16.412141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:16.412141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:16.412141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:16.412141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:16.412141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:16.413517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:16.413517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:16.413517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:16.413517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:16.413517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:16.413517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:16.413517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:16.413517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:16.416358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 404/809] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:16.417079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e3cfe-da56-4642-9ad9-09bb2bdf7219 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:16.438240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8fed2-8094-41d5-8c8f-a8e89a12b6ec None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:16.439977 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:16.481863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f370041-11f9-4af2-88ec-59a0b89d2131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:16.482657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f370041-11f9-4af2-88ec-59a0b89d2131 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:16.482947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f370041-11f9-4af2-88ec-59a0b89d2131 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:16.483194 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f370041-11f9-4af2-88ec-59a0b89d2131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:16.495383 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f370041-11f9-4af2-88ec-59a0b89d2131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:16.497505 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f370041-11f9-4af2-88ec-59a0b89d2131 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:16.516569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-1f370041-11f9-4af2-88ec-59a0b89d2131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:16.516569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:16.516569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:16.516569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:16.516569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:16.516569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:16.516569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:16.516569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:16.516569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:16.516569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:16.516569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:16.516569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:16.516569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:16.516569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:16.516569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:16.518186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:16.518186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:16.518186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:16.518186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:16.518186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:16.518186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:16.518186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:16.518186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:16.518186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:16.518186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:16.518186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:16.518186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:16.518186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:16.518186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:16.518186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:16.518186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:16.518186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:16.520010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:16.520010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:16.520010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:16.520010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:16.520010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 406/810] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:16.520010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903db5b4-eb5e-4751-97e1-d2287f018939 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:16.520010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903db5b4-eb5e-4751-97e1-d2287f018939 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:16.520010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903db5b4-eb5e-4751-97e1-d2287f018939 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:16.525382 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 407/811] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:16.525382 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903db5b4-eb5e-4751-97e1-d2287f018939 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:16.553925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e3cfe-da56-4642-9ad9-09bb2bdf7219 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:16.557124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:16.602153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ff360-b160-48ea-89bc-1c00f106cd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:16.603091 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ff360-b160-48ea-89bc-1c00f106cd79 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:16.603697 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ff360-b160-48ea-89bc-1c00f106cd79 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:16.604130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ff360-b160-48ea-89bc-1c00f106cd79 None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:16.606049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ff360-b160-48ea-89bc-1c00f106cd79 None admin] RBAC: Adding query filter params (type=network) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:16.606768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ff360-b160-48ea-89bc-1c00f106cd79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:16.609313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ff360-b160-48ea-89bc-1c00f106cd79 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:16.616840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 405/812] 10.222.0.66 () {56 vars in 1112 bytes} [Thu May 26 21:02:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:16.617824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ff360-b160-48ea-89bc-1c00f106cd79 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:16.647611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903db5b4-eb5e-4751-97e1-d2287f018939 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:16.694825 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c3ef3-fe02-47c6-ae6c-3f57450bd121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:16.695501 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c3ef3-fe02-47c6-ae6c-3f57450bd121 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:16.695785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c3ef3-fe02-47c6-ae6c-3f57450bd121 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:16.696058 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c3ef3-fe02-47c6-ae6c-3f57450bd121 None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:16.696893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c3ef3-fe02-47c6-ae6c-3f57450bd121 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:16.697211 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c3ef3-fe02-47c6-ae6c-3f57450bd121 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:16.698650 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c3ef3-fe02-47c6-ae6c-3f57450bd121 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:16.713143 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 408/813] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:02:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:16.714301 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89ed4b-567c-4fec-889f-66c3cabe1952 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:16.714609 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89ed4b-567c-4fec-889f-66c3cabe1952 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:16.715418 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89ed4b-567c-4fec-889f-66c3cabe1952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:16.738956 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-bb89ed4b-567c-4fec-889f-66c3cabe1952 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:16.740038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ff360-b160-48ea-89bc-1c00f106cd79 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:16.740151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-bb89ed4b-567c-4fec-889f-66c3cabe1952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:16.752821 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:16.775933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdc469-12f5-4124-895f-b07d6be71a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:16.776622 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdc469-12f5-4124-895f-b07d6be71a2a None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:16.776912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdc469-12f5-4124-895f-b07d6be71a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:16.777187 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdc469-12f5-4124-895f-b07d6be71a2a None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:16.778418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bdc469-12f5-4124-895f-b07d6be71a2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:16.778725 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bdc469-12f5-4124-895f-b07d6be71a2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:16.780107 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bdc469-12f5-4124-895f-b07d6be71a2a None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:16.796620 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 406/814] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:16.796620 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdc469-12f5-4124-895f-b07d6be71a2a None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:16.824203 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 409/815] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:16.825192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89ed4b-567c-4fec-889f-66c3cabe1952 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:16.838743 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:16.920289 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdc469-12f5-4124-895f-b07d6be71a2a None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:16.942353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89ed4b-567c-4fec-889f-66c3cabe1952 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:16.956824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b4bd7-8b4c-4ff4-9657-dd39b1e860b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:16.957493 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b4bd7-8b4c-4ff4-9657-dd39b1e860b8 None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:16.957773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b4bd7-8b4c-4ff4-9657-dd39b1e860b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:16.958047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b4bd7-8b4c-4ff4-9657-dd39b1e860b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:16.958793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b4bd7-8b4c-4ff4-9657-dd39b1e860b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:16.960160 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b4bd7-8b4c-4ff4-9657-dd39b1e860b8 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:16.978680 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f1123-a918-4ecc-9c92-2166111ea16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:16.979569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f1123-a918-4ecc-9c92-2166111ea16f None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:16.979852 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f1123-a918-4ecc-9c92-2166111ea16f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:16.980124 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f1123-a918-4ecc-9c92-2166111ea16f None admin] PATH_INFO: `/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/6304e47844214d2db0acfae11e4714ee/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:16.982674 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f1123-a918-4ecc-9c92-2166111ea16f None admin] RBAC: Authorizing `identity:create_grant(project_id=a3db24bf0708446e9b05197fafeb00e4, user_id=6304e47844214d2db0acfae11e4714ee, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:16.984110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f1123-a918-4ecc-9c92-2166111ea16f None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:17.032545 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 407/816] 10.222.0.66 () {60 vars in 1144 bytes} [Thu May 26 21:02:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:02:17.033898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b4bd7-8b4c-4ff4-9657-dd39b1e860b8 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:17.088763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 410/817] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:02:16 2022] PUT /identity/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/6304e47844214d2db0acfae11e4714ee/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:02:17.098034 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f1123-a918-4ecc-9c92-2166111ea16f None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:17.110272 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:17.142729 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:17.171215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b4bd7-8b4c-4ff4-9657-dd39b1e860b8 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:17.217919 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23a879-234c-43b7-9be2-5350b596233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:17.218946 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23a879-234c-43b7-9be2-5350b596233d None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:17.219918 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23a879-234c-43b7-9be2-5350b596233d None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:17.221100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23a879-234c-43b7-9be2-5350b596233d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:17.230029 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23a879-234c-43b7-9be2-5350b596233d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:17.231808 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23a879-234c-43b7-9be2-5350b596233d None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:17.248079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-9c23a879-234c-43b7-9be2-5350b596233d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:17.248079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:17.248079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:17.248079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:17.248079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:17.248079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:17.248079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:17.248079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:17.248079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:17.248079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:17.248079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:17.248079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:17.248079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:17.248079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:17.248079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:17.249282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:17.249282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:17.249282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:17.249282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:17.249282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:17.249282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:17.249282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:17.249282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:17.249282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:17.249282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:17.249282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:17.249282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:17.249282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:17.249282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:17.249282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:17.249282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:17.249282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:17.250418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:17.250418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:17.250418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:17.250418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:17.250418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:17.250418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:17.250418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:17.250418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:17.253242 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 408/818] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:17.254960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7434b-e239-4932-b7cc-804ed6f887e5 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:17.255370 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7434b-e239-4932-b7cc-804ed6f887e5 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:17.255752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7434b-e239-4932-b7cc-804ed6f887e5 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:17.260792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 409/819] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:17.262320 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7434b-e239-4932-b7cc-804ed6f887e5 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:17.273866 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f1123-a918-4ecc-9c92-2166111ea16f None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:17.318486 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7b75-09ec-4fea-9932-41578aa51132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:17.319306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7b75-09ec-4fea-9932-41578aa51132 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:17.319586 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7b75-09ec-4fea-9932-41578aa51132 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:17.319860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7b75-09ec-4fea-9932-41578aa51132 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:17.334157 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b7b75-09ec-4fea-9932-41578aa51132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:17.342743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-2d5b7b75-09ec-4fea-9932-41578aa51132 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:02:17.342743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:17.342743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:17.342743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:17.342743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:17.342743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:17.342743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:17.342743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:17.342743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:17.342743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:17.342743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:17.342743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:17.342743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:17.342743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:17.342743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:17.342743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:17.343736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:17.343736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:17.343736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:17.343736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:17.343736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:17.343736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:17.343736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:17.343736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:17.343736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:17.343736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:17.343736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:17.343736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:17.343736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:17.343736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:17.343736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:17.343736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:17.345098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:17.345098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:17.345098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:17.345098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:17.345098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:17.345098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:17.345098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:17.345098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:17.345098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:17.345098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:17.345098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:02:17.345098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:17.345098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 411/820] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:02:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:17.346047 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc9a8e-b6e7-4d71-9e0a-b570c683e35b None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:17.346047 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc9a8e-b6e7-4d71-9e0a-b570c683e35b None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:17.346047 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc9a8e-b6e7-4d71-9e0a-b570c683e35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:17.367653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-6abc9a8e-b6e7-4d71-9e0a-b570c683e35b None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:17.368972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6abc9a8e-b6e7-4d71-9e0a-b570c683e35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:17.410588 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7434b-e239-4932-b7cc-804ed6f887e5 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:17.440926 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:17.460611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 412/821] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:17.460611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc9a8e-b6e7-4d71-9e0a-b570c683e35b None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:17.464277 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4c52e-76b4-4b07-b05d-f9c922c68f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:17.465417 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4c52e-76b4-4b07-b05d-f9c922c68f8f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:17.465716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4c52e-76b4-4b07-b05d-f9c922c68f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:17.466049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4c52e-76b4-4b07-b05d-f9c922c68f8f None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:17.467124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4c52e-76b4-4b07-b05d-f9c922c68f8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:17.467450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4c52e-76b4-4b07-b05d-f9c922c68f8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:17.470015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4c52e-76b4-4b07-b05d-f9c922c68f8f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:17.480906 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:17.484886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 410/822] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:02:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:17.485816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4c52e-76b4-4b07-b05d-f9c922c68f8f None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:17.584753 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc9a8e-b6e7-4d71-9e0a-b570c683e35b None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:17.609334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4c52e-76b4-4b07-b05d-f9c922c68f8f None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:17.624033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c94694-8068-4f57-9c1d-de66a9c5ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:17.624750 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c94694-8068-4f57-9c1d-de66a9c5ff3b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:17.625027 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c94694-8068-4f57-9c1d-de66a9c5ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:17.625305 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c94694-8068-4f57-9c1d-de66a9c5ff3b None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:17.626061 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c94694-8068-4f57-9c1d-de66a9c5ff3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:17.626367 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c94694-8068-4f57-9c1d-de66a9c5ff3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:17.627747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c94694-8068-4f57-9c1d-de66a9c5ff3b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:17.637242 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 413/823] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:02:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:17.641907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c94694-8068-4f57-9c1d-de66a9c5ff3b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:17.653966 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fe69a-5033-4442-88e6-4d84e58d16b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:17.654782 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fe69a-5033-4442-88e6-4d84e58d16b1 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:17.655065 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fe69a-5033-4442-88e6-4d84e58d16b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:17.655345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fe69a-5033-4442-88e6-4d84e58d16b1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:17.656627 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fe69a-5033-4442-88e6-4d84e58d16b1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:17.657453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fe69a-5033-4442-88e6-4d84e58d16b1 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:17.670529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-819fe69a-5033-4442-88e6-4d84e58d16b1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 21:02:17.670529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:17.670529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:17.670529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:17.670529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:17.670529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:17.670529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:17.670529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:17.670529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 21:02:17.670529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:17.670529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:17.670529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:17.670529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:17.670529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:17.670529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:17.670529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:17.670529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:17.671594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:17.671594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:17.671594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:17.671594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:17.671594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:17.671594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:17.671594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:17.671594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:17.671594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:17.671594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:17.671594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:17.671594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:17.671594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:17.671594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:17.671594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:17.671594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:17.672424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:17.672424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:17.672424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:17.672424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:17.672424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:17.672424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:17.672424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:17.672424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:17.672424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:17.672424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:17.672424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:17.672424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:17.672424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 21:02:17.672424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:17.672424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 411/824] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:02:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:17.673874 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fe69a-5033-4442-88e6-4d84e58d16b1 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:17.711879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:17.751478 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:17.772009 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c94694-8068-4f57-9c1d-de66a9c5ff3b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:17.799850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fe69a-5033-4442-88e6-4d84e58d16b1 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:17.807499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900fd38-bb69-4119-b72b-36848302fd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:17.809211 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900fd38-bb69-4119-b72b-36848302fd2c None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:17.809489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900fd38-bb69-4119-b72b-36848302fd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:17.809774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900fd38-bb69-4119-b72b-36848302fd2c None admin] PATH_INFO: `/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/5890e1e70ffd4e33a812691e9c43b6d2/roles/6391321aa2bd4ed5980bebfc65f307a9` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:17.825144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900fd38-bb69-4119-b72b-36848302fd2c None admin] RBAC: Authorizing `identity:create_grant(project_id=a3db24bf0708446e9b05197fafeb00e4, user_id=5890e1e70ffd4e33a812691e9c43b6d2, role_id=6391321aa2bd4ed5980bebfc65f307a9)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:17.826592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900fd38-bb69-4119-b72b-36848302fd2c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:17.835636 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d1e43-ed61-4a60-b377-e682ca6081ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:17.836431 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d1e43-ed61-4a60-b377-e682ca6081ba None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:17.836751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d1e43-ed61-4a60-b377-e682ca6081ba None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:17.837034 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d1e43-ed61-4a60-b377-e682ca6081ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:17.847753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d1e43-ed61-4a60-b377-e682ca6081ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:17.849282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d1e43-ed61-4a60-b377-e682ca6081ba None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:17.868458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-201d1e43-ed61-4a60-b377-e682ca6081ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:17.868458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:17.868458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:17.868458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:17.868458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:17.868458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:17.868458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:17.868458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:17.868458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:17.868458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:17.868458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:17.868458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:17.868458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:17.868458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:17.868458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:17.869559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:17.869559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:17.869559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:17.869559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:17.869559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:17.869559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:17.869559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:17.869559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:17.869559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:17.869559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:17.869559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:17.869559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:17.869559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:17.869559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:17.869559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:17.869559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:17.869559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:17.870647 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:17.870647 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:17.870647 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:17.870647 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:17.870647 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 412/825] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:17.870647 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d1e43-ed61-4a60-b377-e682ca6081ba None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:17.898718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 414/826] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:02:17 2022] PUT /identity/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/5890e1e70ffd4e33a812691e9c43b6d2/roles/6391321aa2bd4ed5980bebfc65f307a9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:02:17.898718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900fd38-bb69-4119-b72b-36848302fd2c None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:18.030643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d1e43-ed61-4a60-b377-e682ca6081ba None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:18.052173 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900fd38-bb69-4119-b72b-36848302fd2c None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:18.053849 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:18.060775 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:18.070882 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0e3d4-010c-482d-a4a6-f3d227c6f8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:18.071835 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0e3d4-010c-482d-a4a6-f3d227c6f8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:18.072204 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0e3d4-010c-482d-a4a6-f3d227c6f8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:18.072558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0e3d4-010c-482d-a4a6-f3d227c6f8e0 None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:18.073736 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0e3d4-010c-482d-a4a6-f3d227c6f8e0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:18.074666 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0e3d4-010c-482d-a4a6-f3d227c6f8e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:18.076252 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0e3d4-010c-482d-a4a6-f3d227c6f8e0 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:18.084770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 413/827] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:02:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:18.089345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0e3d4-010c-482d-a4a6-f3d227c6f8e0 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:18.099656 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af2297-475e-42db-aaec-819f3af3d29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:18.100654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af2297-475e-42db-aaec-819f3af3d29c None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:18.101089 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af2297-475e-42db-aaec-819f3af3d29c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:18.101542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af2297-475e-42db-aaec-819f3af3d29c None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:18.102439 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af2297-475e-42db-aaec-819f3af3d29c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:18.102906 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af2297-475e-42db-aaec-819f3af3d29c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:18.104612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af2297-475e-42db-aaec-819f3af3d29c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:18.123678 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 415/828] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:18.127220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af2297-475e-42db-aaec-819f3af3d29c None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:18.229353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0e3d4-010c-482d-a4a6-f3d227c6f8e0 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:18.269360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af2297-475e-42db-aaec-819f3af3d29c None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:18.282184 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0716f-6173-454e-bc72-9dc233360f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:18.282983 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0716f-6173-454e-bc72-9dc233360f54 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:18.283376 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0716f-6173-454e-bc72-9dc233360f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:18.283765 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0716f-6173-454e-bc72-9dc233360f54 None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:18.285135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0716f-6173-454e-bc72-9dc233360f54 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:18.285458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0716f-6173-454e-bc72-9dc233360f54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:18.287018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0716f-6173-454e-bc72-9dc233360f54 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:18.294080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 414/829] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:02:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:18.315147 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f2235-42c4-495f-8032-7e3a8d452142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:18.316448 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f2235-42c4-495f-8032-7e3a8d452142 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:18.316965 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f2235-42c4-495f-8032-7e3a8d452142 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:18.317447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f2235-42c4-495f-8032-7e3a8d452142 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:18.327912 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f2235-42c4-495f-8032-7e3a8d452142 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:18.329765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f2235-42c4-495f-8032-7e3a8d452142 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:18.346135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-e24f2235-42c4-495f-8032-7e3a8d452142 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 21:02:18.346135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:18.346135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:18.346135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:18.346135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:18.346135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:18.346135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:18.346135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:18.346135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:18.346135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:18.346135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:18.346135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:18.346135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:02:18.346135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:02:18.346135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:02:18.346135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:02:18.347394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:18.347394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:18.347394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:02:18.347394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:18.347394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:02:18.347394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:18.347394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:18.347394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:18.347394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:18.347394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:18.347394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:18.347394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:18.347394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:18.347394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:18.347394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:18.347394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:18.347394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:18.347394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:18.348538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:18.348538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:18.348538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:02:18.348538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:02:18.348538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:02:18.348538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:02:18.348538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:02:18.348538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:02:18.348538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 21:02:18.348538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:18.355651 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 416/830] 10.222.0.66 () {56 vars in 1093 bytes} [Thu May 26 21:02:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:18.357785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0716f-6173-454e-bc72-9dc233360f54 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:18.422368 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:18.479028 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0716f-6173-454e-bc72-9dc233360f54 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:18.523816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901d5a1-c2bd-4b33-8094-4277ac441c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:18.524541 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901d5a1-c2bd-4b33-8094-4277ac441c21 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:18.524890 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901d5a1-c2bd-4b33-8094-4277ac441c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:18.525172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901d5a1-c2bd-4b33-8094-4277ac441c21 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:18.526040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901d5a1-c2bd-4b33-8094-4277ac441c21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:18.526355 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901d5a1-c2bd-4b33-8094-4277ac441c21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:18.527867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901d5a1-c2bd-4b33-8094-4277ac441c21 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:18.548783 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 415/831] 10.222.0.66 () {56 vars in 1133 bytes} [Thu May 26 21:02:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:18.554678 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f2235-42c4-495f-8032-7e3a8d452142 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:18.592880 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:18.670105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f2235-42c4-495f-8032-7e3a8d452142 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:18.706145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b65c07-2849-47f2-851c-0ed7b6871c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:18.706812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b65c07-2849-47f2-851c-0ed7b6871c16 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:18.707151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b65c07-2849-47f2-851c-0ed7b6871c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:18.707432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b65c07-2849-47f2-851c-0ed7b6871c16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:18.776887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b65c07-2849-47f2-851c-0ed7b6871c16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:18.778377 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b65c07-2849-47f2-851c-0ed7b6871c16 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:18.805664 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:18.888375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 417/832] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:02:18 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:02:18.891465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901d5a1-c2bd-4b33-8094-4277ac441c21 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:18.997721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901d5a1-c2bd-4b33-8094-4277ac441c21 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:18.999524 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:19.034790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa9087-d3b6-468d-a7f7-c0936092c4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:19.036831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa9087-d3b6-468d-a7f7-c0936092c4cc None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:19.037302 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa9087-d3b6-468d-a7f7-c0936092c4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:19.037766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa9087-d3b6-468d-a7f7-c0936092c4cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:19.053272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa9087-d3b6-468d-a7f7-c0936092c4cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:19.055037 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa9087-d3b6-468d-a7f7-c0936092c4cc None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:19.074513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-f4aa9087-d3b6-468d-a7f7-c0936092c4cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:19.074513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:19.074513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:19.074513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:19.074513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:19.074513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:19.074513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:19.074513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:19.074513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:19.074513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:19.074513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:19.074513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:19.074513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:19.074513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:19.074513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:19.075469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:19.075469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:19.075469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:19.075469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:19.075469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:19.075469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:19.075469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:19.075469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:19.075469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:19.075469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:19.075469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:19.075469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:19.075469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:19.075469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:19.075469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:19.075469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:19.075469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:19.076347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:19.076347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:19.076347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:19.076347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:19.082570 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 416/833] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:19.084171 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b65c07-2849-47f2-851c-0ed7b6871c16 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:19.190568 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b65c07-2849-47f2-851c-0ed7b6871c16 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:19.225187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:19.229461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95673c-5884-42d5-b6be-cb1f25d918d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:19.230071 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95673c-5884-42d5-b6be-cb1f25d918d0 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:19.231254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95673c-5884-42d5-b6be-cb1f25d918d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:19.231599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95673c-5884-42d5-b6be-cb1f25d918d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:19.232429 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95673c-5884-42d5-b6be-cb1f25d918d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:19.232837 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95673c-5884-42d5-b6be-cb1f25d918d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:19.234384 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95673c-5884-42d5-b6be-cb1f25d918d0 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:19.253081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 418/834] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:19.254805 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa9087-d3b6-468d-a7f7-c0936092c4cc None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:19.367439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa9087-d3b6-468d-a7f7-c0936092c4cc None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:19.405009 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6e979-5f5e-4c97-a334-f81e523c60e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:19.405810 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6e979-5f5e-4c97-a334-f81e523c60e3 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:19.406096 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6e979-5f5e-4c97-a334-f81e523c60e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:19.406372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6e979-5f5e-4c97-a334-f81e523c60e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:19.413892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6e979-5f5e-4c97-a334-f81e523c60e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:19.415353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6e979-5f5e-4c97-a334-f81e523c60e3 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:19.430142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-caf6e979-5f5e-4c97-a334-f81e523c60e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:19.430142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:19.430142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:19.430142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:19.430142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:19.430142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:19.430142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:19.430142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:19.430142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:19.430142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:19.430142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:19.430142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:19.430142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:19.430142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:19.430142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:19.431070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:19.431070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:19.431070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:19.431070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:19.431070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:19.431070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:19.431070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:19.431070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:19.431070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:19.431070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:19.431070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:19.431070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:19.431070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:19.431070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:19.431070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:19.431070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:19.431070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:19.431940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:19.431940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:19.431940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:19.431940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:19.431940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:19.431940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:19.431940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:19.431940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:19.436325 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 417/835] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:19.437724 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95673c-5884-42d5-b6be-cb1f25d918d0 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:19.444216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84893ced-2483-4bef-929d-1488d9a79616 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:19.444800 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84893ced-2483-4bef-929d-1488d9a79616 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:19.445286 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84893ced-2483-4bef-929d-1488d9a79616 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:19.447191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 418/836] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:19.453267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4566e-0d2b-4d09-9e2e-fced672ef1a4 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:19.453805 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4566e-0d2b-4d09-9e2e-fced672ef1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:19.454358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4566e-0d2b-4d09-9e2e-fced672ef1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:19.474752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-39f4566e-0d2b-4d09-9e2e-fced672ef1a4 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:19.476424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-39f4566e-0d2b-4d09-9e2e-fced672ef1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:19.487655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:19.564826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 419/837] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:19.566695 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95673c-5884-42d5-b6be-cb1f25d918d0 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:19.588414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4566e-0d2b-4d09-9e2e-fced672ef1a4 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:19.610004 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bab21-548f-492b-b22b-93066c83bbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:19.611952 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bab21-548f-492b-b22b-93066c83bbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:19.612414 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bab21-548f-492b-b22b-93066c83bbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:19.612891 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bab21-548f-492b-b22b-93066c83bbf7 None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:19.613850 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bab21-548f-492b-b22b-93066c83bbf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:19.614369 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bab21-548f-492b-b22b-93066c83bbf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:19.616605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bab21-548f-492b-b22b-93066c83bbf7 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:19.634309 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 419/838] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:02:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:19.644150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bab21-548f-492b-b22b-93066c83bbf7 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:19.715917 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:19.725010 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4566e-0d2b-4d09-9e2e-fced672ef1a4 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:19.765185 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab2e30-7930-4490-8583-f8ac3bb95851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:19.766581 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab2e30-7930-4490-8583-f8ac3bb95851 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:19.767308 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab2e30-7930-4490-8583-f8ac3bb95851 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:19.767772 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab2e30-7930-4490-8583-f8ac3bb95851 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:19.782240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab2e30-7930-4490-8583-f8ac3bb95851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:19.785517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bab21-548f-492b-b22b-93066c83bbf7 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:19.792379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-c4ab2e30-7930-4490-8583-f8ac3bb95851 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:02:19.792379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:19.792379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:19.792379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:19.792379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:19.792379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:19.792379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:19.792379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:19.792379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:19.792379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:19.792379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:19.792379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:19.792379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:19.792379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:19.792379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:19.792379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:19.793389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:19.793389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:19.793389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:19.793389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:19.793389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:19.793389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:19.793389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:19.793389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:19.793389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:19.793389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:19.793389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:19.793389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:19.793389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:19.793389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:19.793389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:19.793389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:19.794247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:19.794247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:19.794247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:19.794247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:19.794247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:19.794247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:19.794247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:19.794247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:19.794247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:19.794247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:19.794247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:02:19.794247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:19.802980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 420/839] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:02:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:19.803639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab2e30-7930-4490-8583-f8ac3bb95851 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:19.810854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:19.839490 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1811e8-3ccf-41b0-8ec7-7be6a0f09615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:19.841132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1811e8-3ccf-41b0-8ec7-7be6a0f09615 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:19.841636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1811e8-3ccf-41b0-8ec7-7be6a0f09615 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:19.842360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1811e8-3ccf-41b0-8ec7-7be6a0f09615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:19.843597 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1811e8-3ccf-41b0-8ec7-7be6a0f09615 None admin] RBAC: Adding query filter params (role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=df008eed25464be387741ee7a1e5ce80) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:19.844524 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1811e8-3ccf-41b0-8ec7-7be6a0f09615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:19.846648 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1811e8-3ccf-41b0-8ec7-7be6a0f09615 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:19.855110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 420/840] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:02:19 2022] GET /identity/v3/role_assignments?user.id=df008eed25464be387741ee7a1e5ce80&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:19.946438 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab2e30-7930-4490-8583-f8ac3bb95851 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:19.985686 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ef9a3-dab2-4759-9e52-4a00a0c47262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:19.986371 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ef9a3-dab2-4759-9e52-4a00a0c47262 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:19.986655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ef9a3-dab2-4759-9e52-4a00a0c47262 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:19.986932 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ef9a3-dab2-4759-9e52-4a00a0c47262 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:19.987690 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ef9a3-dab2-4759-9e52-4a00a0c47262 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:19.987996 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ef9a3-dab2-4759-9e52-4a00a0c47262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:19.989431 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ef9a3-dab2-4759-9e52-4a00a0c47262 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:20.000196 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 421/841] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:02:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:20.006194 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1811e8-3ccf-41b0-8ec7-7be6a0f09615 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:20.130895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1811e8-3ccf-41b0-8ec7-7be6a0f09615 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:20.142792 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:20.168406 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31beba-9a7f-4215-9e2b-99e7b4dda07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:20.169514 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31beba-9a7f-4215-9e2b-99e7b4dda07c None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:20.169950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31beba-9a7f-4215-9e2b-99e7b4dda07c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:20.170379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31beba-9a7f-4215-9e2b-99e7b4dda07c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:20.182602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31beba-9a7f-4215-9e2b-99e7b4dda07c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:20.185148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31beba-9a7f-4215-9e2b-99e7b4dda07c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:20.203107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-5b31beba-9a7f-4215-9e2b-99e7b4dda07c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:20.203107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:20.203107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:20.203107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:20.203107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:20.203107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:20.203107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:20.203107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:20.203107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:20.203107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:20.203107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:20.203107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:20.203107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:20.203107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:20.203107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:20.204198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:20.204198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:20.204198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:20.204198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:20.204198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:20.204198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:20.204198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:20.204198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:20.204198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:20.204198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:20.204198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:20.204198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:20.204198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:20.204198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:20.204198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:20.204198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:20.204198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:20.205331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:20.205331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:20.205331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:20.205331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:20.207174 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 421/842] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:20.213032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ef9a3-dab2-4759-9e52-4a00a0c47262 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:20.262207 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5c380-3feb-48bc-bdbd-c71d7a283fb4 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:20.262861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5c380-3feb-48bc-bdbd-c71d7a283fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:20.263503 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5c380-3feb-48bc-bdbd-c71d7a283fb4 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:20.265429 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 422/843] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:20.277865 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bf42a-def4-4680-8397-050def5d0675 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:20.279178 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bf42a-def4-4680-8397-050def5d0675 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:20.279955 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bf42a-def4-4680-8397-050def5d0675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:20.284854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:20.305292 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-873bf42a-def4-4680-8397-050def5d0675 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:20.306928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-873bf42a-def4-4680-8397-050def5d0675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:20.323005 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ef9a3-dab2-4759-9e52-4a00a0c47262 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:20.365082 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa5962-7a9e-4aa4-ae9f-a38fcf28b70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:20.366695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa5962-7a9e-4aa4-ae9f-a38fcf28b70c None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:20.367199 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa5962-7a9e-4aa4-ae9f-a38fcf28b70c None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:20.368155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa5962-7a9e-4aa4-ae9f-a38fcf28b70c None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:20.369636 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa5962-7a9e-4aa4-ae9f-a38fcf28b70c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:20.370179 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa5962-7a9e-4aa4-ae9f-a38fcf28b70c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:20.373009 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa5962-7a9e-4aa4-ae9f-a38fcf28b70c None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:20.394549 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 422/844] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:20.400113 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa5962-7a9e-4aa4-ae9f-a38fcf28b70c None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:20.403233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 423/845] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:20.427632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bf42a-def4-4680-8397-050def5d0675 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:20.509632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa5962-7a9e-4aa4-ae9f-a38fcf28b70c None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:20.530626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:20.537686 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:20.540887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bf42a-def4-4680-8397-050def5d0675 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:20.547451 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fbb77-7e9a-4cb5-8fe4-b51831b1e6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:20.548547 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fbb77-7e9a-4cb5-8fe4-b51831b1e6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:20.549131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fbb77-7e9a-4cb5-8fe4-b51831b1e6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:20.549627 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fbb77-7e9a-4cb5-8fe4-b51831b1e6b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:20.557489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fbb77-7e9a-4cb5-8fe4-b51831b1e6b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:20.559693 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fbb77-7e9a-4cb5-8fe4-b51831b1e6b3 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:20.575380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-1e4fbb77-7e9a-4cb5-8fe4-b51831b1e6b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 21:02:20.575380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:20.575380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:20.575380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:20.575380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:20.575380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:20.575380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:20.575380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:20.575380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:20.575380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:20.575380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:20.575380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:20.575380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:02:20.575380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:02:20.575380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:02:20.575380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:02:20.576829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:20.576829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:20.576829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:02:20.576829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:20.576829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:02:20.576829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:20.576829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:20.576829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:20.576829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:20.576829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:20.576829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:20.576829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:20.576829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:20.576829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:20.576829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:20.576829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:20.576829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:20.576829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:20.577766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:20.577766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:20.577766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:02:20.577766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:02:20.577766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:02:20.577766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:02:20.577766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:02:20.577766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:02:20.577766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 21:02:20.577766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:20.583564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 423/846] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:02:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:20.583564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d2ee2-5922-4762-ad7b-207a73166550 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:20.583564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d2ee2-5922-4762-ad7b-207a73166550 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:20.583564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d2ee2-5922-4762-ad7b-207a73166550 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:20.583564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 424/847] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:20.586024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d2ee2-5922-4762-ad7b-207a73166550 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:20.595215 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e79290-99fc-4d38-8e52-85dce756e460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:20.596678 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e79290-99fc-4d38-8e52-85dce756e460 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:20.596973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e79290-99fc-4d38-8e52-85dce756e460 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:20.597256 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e79290-99fc-4d38-8e52-85dce756e460 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:20.611262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e79290-99fc-4d38-8e52-85dce756e460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:20.619371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-c0e79290-99fc-4d38-8e52-85dce756e460 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:02:20.619371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:20.619371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:20.619371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:20.619371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:20.619371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:20.619371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:20.619371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:20.619371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:20.619371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:20.619371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:20.619371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:20.619371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:20.619371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:20.619371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:20.619371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:20.620329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:20.620329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:20.620329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:20.620329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:20.620329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:20.620329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:20.620329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:20.620329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:20.620329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:20.620329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:20.620329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:20.620329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:20.620329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:20.620329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:20.620329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:20.620329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:20.621337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:20.621337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:20.621337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:20.621337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:20.621337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:20.621337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:20.621337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:20.621337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:20.621337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:20.621337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:20.621337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:02:20.621337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:20.621337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 424/848] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:02:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:20.626531 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e664d-396a-40e1-a895-221077e4a944 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:20.626898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e664d-396a-40e1-a895-221077e4a944 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:20.627254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e664d-396a-40e1-a895-221077e4a944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:20.643930 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-370e664d-396a-40e1-a895-221077e4a944 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:20.645136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-370e664d-396a-40e1-a895-221077e4a944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:20.704503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d2ee2-5922-4762-ad7b-207a73166550 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:20.716429 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 425/849] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:20.717227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e664d-396a-40e1-a895-221077e4a944 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:20.746766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b10f82-a676-4b0c-9e38-1d3bf5a54143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:20.747437 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b10f82-a676-4b0c-9e38-1d3bf5a54143 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:20.747746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b10f82-a676-4b0c-9e38-1d3bf5a54143 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:20.748016 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b10f82-a676-4b0c-9e38-1d3bf5a54143 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:20.748879 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b10f82-a676-4b0c-9e38-1d3bf5a54143 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:20.749187 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b10f82-a676-4b0c-9e38-1d3bf5a54143 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:20.750609 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b10f82-a676-4b0c-9e38-1d3bf5a54143 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:20.769042 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 425/850] 10.222.0.66 () {56 vars in 1135 bytes} [Thu May 26 21:02:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:20.769872 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b10f82-a676-4b0c-9e38-1d3bf5a54143 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:20.810208 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:20.825149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:20.833798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e664d-396a-40e1-a895-221077e4a944 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:20.868997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df284f1-2675-4947-bf6b-71d186fb163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:20.869676 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df284f1-2675-4947-bf6b-71d186fb163e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:20.869963 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df284f1-2675-4947-bf6b-71d186fb163e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:20.870249 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df284f1-2675-4947-bf6b-71d186fb163e None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:20.870996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df284f1-2675-4947-bf6b-71d186fb163e None admin] RBAC: Adding query filter params (name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:20.871308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df284f1-2675-4947-bf6b-71d186fb163e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:20.872710 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df284f1-2675-4947-bf6b-71d186fb163e None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:20.880683 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 426/851] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:02:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:20.881497 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df284f1-2675-4947-bf6b-71d186fb163e None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:20.893552 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b10f82-a676-4b0c-9e38-1d3bf5a54143 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:20.934935 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49263d64-70d7-435c-a92e-0c4db678122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:20.935657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49263d64-70d7-435c-a92e-0c4db678122d None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:20.935891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49263d64-70d7-435c-a92e-0c4db678122d None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:20.936168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49263d64-70d7-435c-a92e-0c4db678122d None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:20.936929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49263d64-70d7-435c-a92e-0c4db678122d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:20.938358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49263d64-70d7-435c-a92e-0c4db678122d None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:20.997593 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 426/852] 10.222.0.66 () {60 vars in 1141 bytes} [Thu May 26 21:02:20 2022] POST /identity/v3/services => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:02:21.000969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df284f1-2675-4947-bf6b-71d186fb163e None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:21.009704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49263d64-70d7-435c-a92e-0c4db678122d None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:21.078739 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3906e10-52d7-4d9f-a9bc-fe23c6c5f5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:21.080330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3906e10-52d7-4d9f-a9bc-fe23c6c5f5bf None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:21.080330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3906e10-52d7-4d9f-a9bc-fe23c6c5f5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:21.080840 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3906e10-52d7-4d9f-a9bc-fe23c6c5f5bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:21.105074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:21.168440 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49263d64-70d7-435c-a92e-0c4db678122d None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:21.172495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:21.186522 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3906e10-52d7-4d9f-a9bc-fe23c6c5f5bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:21.188283 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3906e10-52d7-4d9f-a9bc-fe23c6c5f5bf None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:21.217324 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efdb61-81e2-420b-9b02-2824a2ace160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:21.228281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efdb61-81e2-420b-9b02-2824a2ace160 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:21.228281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efdb61-81e2-420b-9b02-2824a2ace160 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:21.228281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efdb61-81e2-420b-9b02-2824a2ace160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:21.231158 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93efdb61-81e2-420b-9b02-2824a2ace160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:21.233047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93efdb61-81e2-420b-9b02-2824a2ace160 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:21.255589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-93efdb61-81e2-420b-9b02-2824a2ace160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:21.255589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:21.255589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:21.255589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:21.255589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:21.255589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:21.255589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:21.255589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:21.255589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:21.255589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:21.255589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:21.255589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:21.255589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:21.255589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:21.255589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:21.256694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:21.256694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:21.256694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:21.256694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:21.256694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:21.256694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:21.256694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:21.256694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:21.256694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:21.256694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:21.256694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:21.256694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:21.256694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:21.256694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:21.256694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:21.256694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:21.256694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:21.257601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:21.257601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:21.257601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:21.257601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:21.259575 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 427/853] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:21.270561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efdb61-81e2-420b-9b02-2824a2ace160 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:21.327653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 427/854] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:02:20 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:02:21.333733 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3906e10-52d7-4d9f-a9bc-fe23c6c5f5bf None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:21.387464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:21.413956 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efdb61-81e2-420b-9b02-2824a2ace160 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:21.453246 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3aac4-0dcd-49d3-ac97-29d837b5e709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:21.454094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3aac4-0dcd-49d3-ac97-29d837b5e709 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:21.454485 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3aac4-0dcd-49d3-ac97-29d837b5e709 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:21.454863 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3aac4-0dcd-49d3-ac97-29d837b5e709 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:21.455699 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3aac4-0dcd-49d3-ac97-29d837b5e709 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:21.456110 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3aac4-0dcd-49d3-ac97-29d837b5e709 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:21.457631 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3aac4-0dcd-49d3-ac97-29d837b5e709 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:21.470425 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 428/855] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:21.475601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3aac4-0dcd-49d3-ac97-29d837b5e709 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:21.482084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3906e10-52d7-4d9f-a9bc-fe23c6c5f5bf None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:21.496769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:21.524532 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82638c2-d6bf-4b9f-9aa2-a4c079f4351d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:21.525686 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82638c2-d6bf-4b9f-9aa2-a4c079f4351d None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:21.525971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82638c2-d6bf-4b9f-9aa2-a4c079f4351d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:21.526536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82638c2-d6bf-4b9f-9aa2-a4c079f4351d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:21.539984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82638c2-d6bf-4b9f-9aa2-a4c079f4351d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:21.542035 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82638c2-d6bf-4b9f-9aa2-a4c079f4351d None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:21.566308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-c82638c2-d6bf-4b9f-9aa2-a4c079f4351d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:21.566308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:21.566308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:21.566308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:21.566308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:21.566308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:21.566308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:21.566308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:21.566308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:21.566308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:21.566308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:21.566308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:21.566308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:21.566308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:21.566308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:21.568254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:21.568254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:21.568254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:21.568254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:21.568254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:21.568254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:21.568254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:21.568254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:21.568254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:21.568254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:21.568254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:21.568254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:21.568254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:21.568254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:21.568254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:21.568254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:21.568254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:21.570423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:21.570423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:21.570423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:21.570423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:21.572860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 428/856] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:21.573774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82638c2-d6bf-4b9f-9aa2-a4c079f4351d None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:21.592537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3aac4-0dcd-49d3-ac97-29d837b5e709 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:21.631192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb1b43-cf66-486c-8046-be644c8a0571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:21.632207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb1b43-cf66-486c-8046-be644c8a0571 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:21.632616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb1b43-cf66-486c-8046-be644c8a0571 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:21.633023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb1b43-cf66-486c-8046-be644c8a0571 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:21.640944 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb1b43-cf66-486c-8046-be644c8a0571 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:21.642559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb1b43-cf66-486c-8046-be644c8a0571 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:21.658272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-6ecb1b43-cf66-486c-8046-be644c8a0571 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 21:02:21.658272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:21.658272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:21.658272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:21.658272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:21.658272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:21.658272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:21.658272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:21.658272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:21.658272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:21.658272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:21.658272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:21.658272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:02:21.658272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:02:21.658272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:02:21.658272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:02:21.659878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:21.659878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:21.659878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:02:21.659878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:21.659878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:02:21.659878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:21.659878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:21.659878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:21.659878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:21.659878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:21.659878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:21.659878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:21.659878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:21.659878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:21.659878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:21.659878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:21.659878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:21.659878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:21.662100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:21.662100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:21.662100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:02:21.662100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:02:21.662100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:02:21.662100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:02:21.662100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:02:21.662100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:02:21.662100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 21:02:21.662100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:21.662100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 429/857] 10.222.0.66 () {56 vars in 1117 bytes} [Thu May 26 21:02:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:21.668416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb1b43-cf66-486c-8046-be644c8a0571 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:21.685776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:21.695527 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82638c2-d6bf-4b9f-9aa2-a4c079f4351d None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:21.732187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f4ef2-8401-4735-8572-60c02a38f105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:21.732929 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f4ef2-8401-4735-8572-60c02a38f105 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:21.733213 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f4ef2-8401-4735-8572-60c02a38f105 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:21.733489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f4ef2-8401-4735-8572-60c02a38f105 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:21.734226 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f4ef2-8401-4735-8572-60c02a38f105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:21.734540 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f4ef2-8401-4735-8572-60c02a38f105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:21.735914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f4ef2-8401-4735-8572-60c02a38f105 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:21.752943 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 429/858] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:21.754327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f4ef2-8401-4735-8572-60c02a38f105 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:21.756293 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:21.783292 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb1b43-cf66-486c-8046-be644c8a0571 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:21.825512 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233982f-c493-4577-9cf6-0132c1ac6a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:21.826558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233982f-c493-4577-9cf6-0132c1ac6a85 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:21.827025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233982f-c493-4577-9cf6-0132c1ac6a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:21.827465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233982f-c493-4577-9cf6-0132c1ac6a85 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:21.828482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233982f-c493-4577-9cf6-0132c1ac6a85 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:21.829062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233982f-c493-4577-9cf6-0132c1ac6a85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:21.830821 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233982f-c493-4577-9cf6-0132c1ac6a85 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:21.851726 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 430/859] 10.222.0.66 () {56 vars in 1149 bytes} [Thu May 26 21:02:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:21.857807 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233982f-c493-4577-9cf6-0132c1ac6a85 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:21.868071 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f4ef2-8401-4735-8572-60c02a38f105 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:21.905979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe10686-21ea-429d-86a9-a947bbe815e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:21.906786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe10686-21ea-429d-86a9-a947bbe815e9 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:21.907070 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe10686-21ea-429d-86a9-a947bbe815e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:21.907346 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe10686-21ea-429d-86a9-a947bbe815e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:21.914879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe10686-21ea-429d-86a9-a947bbe815e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:21.916333 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe10686-21ea-429d-86a9-a947bbe815e9 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:21.931454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-ebe10686-21ea-429d-86a9-a947bbe815e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:21.931454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:21.931454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:21.931454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:21.931454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:21.931454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:21.931454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:21.931454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:21.931454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:21.931454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:21.931454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:21.931454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:21.931454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:21.931454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:21.931454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:21.932636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:21.932636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:21.932636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:21.932636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:21.932636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:21.932636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:21.932636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:21.932636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:21.932636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:21.932636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:21.932636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:21.932636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:21.932636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:21.932636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:21.932636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:21.932636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:21.932636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:21.934461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:21.934461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:21.934461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:21.934461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:21.934461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:21.934461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:21.934461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:21.934461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:21.936922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 430/860] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:21.939516 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe10686-21ea-429d-86a9-a947bbe815e9 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:21.954579 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:21.983769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233982f-c493-4577-9cf6-0132c1ac6a85 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:22.023100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fd35c-ba81-401f-9d92-516c483320a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:22.024011 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fd35c-ba81-401f-9d92-516c483320a4 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:22.024535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fd35c-ba81-401f-9d92-516c483320a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:22.025036 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fd35c-ba81-401f-9d92-516c483320a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:22.028949 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:22.046372 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe10686-21ea-429d-86a9-a947bbe815e9 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:22.085771 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca45b79-1d18-4652-aaf7-4d7df52270f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:22.086457 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca45b79-1d18-4652-aaf7-4d7df52270f4 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:22.086741 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca45b79-1d18-4652-aaf7-4d7df52270f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:22.087017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca45b79-1d18-4652-aaf7-4d7df52270f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:22.087931 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca45b79-1d18-4652-aaf7-4d7df52270f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:22.088129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca45b79-1d18-4652-aaf7-4d7df52270f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:22.090155 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca45b79-1d18-4652-aaf7-4d7df52270f4 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:22.108751 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 431/861] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:02:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:22.110010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca45b79-1d18-4652-aaf7-4d7df52270f4 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:22.112284 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fd35c-ba81-401f-9d92-516c483320a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:22.114282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fd35c-ba81-401f-9d92-516c483320a4 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:22.185437 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:22.220510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca45b79-1d18-4652-aaf7-4d7df52270f4 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:22.233942 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 431/862] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:02:21 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 21:02:22.239371 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fd35c-ba81-401f-9d92-516c483320a4 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:22.267885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c897c-b3f6-4808-9f66-a6f13042a058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:22.268573 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c897c-b3f6-4808-9f66-a6f13042a058 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:22.268882 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c897c-b3f6-4808-9f66-a6f13042a058 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:22.269162 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c897c-b3f6-4808-9f66-a6f13042a058 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:22.270039 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c897c-b3f6-4808-9f66-a6f13042a058 None admin] RBAC: Adding query filter params (role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=6304e47844214d2db0acfae11e4714ee) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:22.270332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c897c-b3f6-4808-9f66-a6f13042a058 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:22.271788 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c897c-b3f6-4808-9f66-a6f13042a058 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:22.279065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 432/863] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:02:22 2022] GET /identity/v3/role_assignments?user.id=6304e47844214d2db0acfae11e4714ee&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:22.280445 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f02d0e-3e15-4988-a97c-bb638088f5ca None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:22.280773 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f02d0e-3e15-4988-a97c-bb638088f5ca None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:22.281055 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f02d0e-3e15-4988-a97c-bb638088f5ca None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:22.282665 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 433/864] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:22.287251 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:22.288329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ac913-439a-472f-9486-33e44ad4dd51 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:22.288658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ac913-439a-472f-9486-33e44ad4dd51 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:22.288940 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ac913-439a-472f-9486-33e44ad4dd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:22.307381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-c60ac913-439a-472f-9486-33e44ad4dd51 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:22.308966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-c60ac913-439a-472f-9486-33e44ad4dd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:22.377878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fd35c-ba81-401f-9d92-516c483320a4 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:22.401033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 434/865] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:22 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:22.418329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ac913-439a-472f-9486-33e44ad4dd51 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:22.425438 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b2942-a78a-4a8c-b4d8-b026c8c806cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:22.426316 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b2942-a78a-4a8c-b4d8-b026c8c806cb None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:22.426596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b2942-a78a-4a8c-b4d8-b026c8c806cb None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:22.427625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b2942-a78a-4a8c-b4d8-b026c8c806cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:22.443046 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b2942-a78a-4a8c-b4d8-b026c8c806cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:22.444838 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b2942-a78a-4a8c-b4d8-b026c8c806cb None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:22.475085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-711b2942-a78a-4a8c-b4d8-b026c8c806cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:22.475085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:22.475085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:22.475085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:22.475085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:22.475085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:22.475085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:22.475085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:22.475085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:22.475085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:22.475085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:22.475085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:22.475085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:22.475085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:22.475085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:22.476061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:22.476061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:22.476061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:22.476061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:22.476061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:22.476061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:22.476061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:22.476061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:22.476061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:22.476061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:22.476061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:22.476061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:22.476061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:22.476061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:22.476061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:22.476061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:22.476061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:22.476977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:22.476977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:22.476977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:22.476977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:22.480607 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 432/866] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:22.482817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b2942-a78a-4a8c-b4d8-b026c8c806cb None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:22.502490 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:22.552121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ac913-439a-472f-9486-33e44ad4dd51 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:22.596533 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:22.601634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a37c37-3726-4dd3-a548-2e1a086c6bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:22.604389 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a37c37-3726-4dd3-a548-2e1a086c6bbc None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:22.604389 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a37c37-3726-4dd3-a548-2e1a086c6bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:22.604389 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a37c37-3726-4dd3-a548-2e1a086c6bbc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:22.604389 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a37c37-3726-4dd3-a548-2e1a086c6bbc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:22.607793 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a37c37-3726-4dd3-a548-2e1a086c6bbc None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:22.614867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b2942-a78a-4a8c-b4d8-b026c8c806cb None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:22.624129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-f8a37c37-3726-4dd3-a548-2e1a086c6bbc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 21:02:22.624129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:22.624129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:22.624129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:22.624129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:22.624129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:22.624129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:22.624129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:22.624129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 21:02:22.624129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:22.624129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:22.624129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:22.624129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:22.624129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:22.624129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:22.624129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:22.625131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:22.625131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:22.625131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:22.625131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:22.625131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:22.625131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:22.625131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:22.625131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:22.625131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:22.625131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:22.625131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:22.625131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:22.625131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:22.625131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:22.625131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:22.625131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:22.625997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:22.625997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:22.625997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:22.625997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:22.625997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:22.625997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:22.625997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:22.625997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:22.625997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:22.625997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:22.625997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:22.625997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:22.625997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:22.625997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 21:02:22.625997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:22.626762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 435/867] 10.222.0.66 () {56 vars in 1132 bytes} [Thu May 26 21:02:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:22.632503 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a37c37-3726-4dd3-a548-2e1a086c6bbc None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:22.655573 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a1397-3dad-46f7-9ed9-844aa6440adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:22.656251 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a1397-3dad-46f7-9ed9-844aa6440adc None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:22.656535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a1397-3dad-46f7-9ed9-844aa6440adc None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:22.656850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a1397-3dad-46f7-9ed9-844aa6440adc None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:22.657584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a1397-3dad-46f7-9ed9-844aa6440adc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:22.657894 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a1397-3dad-46f7-9ed9-844aa6440adc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:22.660166 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a1397-3dad-46f7-9ed9-844aa6440adc None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:22.680192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 433/868] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:22.686064 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a1397-3dad-46f7-9ed9-844aa6440adc None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:22.753012 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a37c37-3726-4dd3-a548-2e1a086c6bbc None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:22.783892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:22.792979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cd56e-60fa-4d25-8ee9-d864f53b4e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:22.793658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cd56e-60fa-4d25-8ee9-d864f53b4e13 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:22.793945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cd56e-60fa-4d25-8ee9-d864f53b4e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:22.794220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cd56e-60fa-4d25-8ee9-d864f53b4e13 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:22.794942 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609cd56e-60fa-4d25-8ee9-d864f53b4e13 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:22.795252 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609cd56e-60fa-4d25-8ee9-d864f53b4e13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:22.796709 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609cd56e-60fa-4d25-8ee9-d864f53b4e13 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:22.806887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 436/869] 10.222.0.66 () {56 vars in 1126 bytes} [Thu May 26 21:02:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:22.808163 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cd56e-60fa-4d25-8ee9-d864f53b4e13 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:22.827818 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a1397-3dad-46f7-9ed9-844aa6440adc None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:22.866690 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de4433-e763-44ed-bead-19518c765183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:22.867870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de4433-e763-44ed-bead-19518c765183 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:22.868397 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de4433-e763-44ed-bead-19518c765183 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:22.868912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de4433-e763-44ed-bead-19518c765183 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:22.877559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de4433-e763-44ed-bead-19518c765183 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:22.879402 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de4433-e763-44ed-bead-19518c765183 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:22.896192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-f4de4433-e763-44ed-bead-19518c765183 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:22.896192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:22.896192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:22.896192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:22.896192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:22.896192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:22.896192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:22.896192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:22.896192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:22.896192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:22.896192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:22.896192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:22.896192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:22.896192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:22.896192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:22.897138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:22.897138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:22.897138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:22.897138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:22.897138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:22.897138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:22.897138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:22.897138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:22.897138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:22.897138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:22.897138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:22.897138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:22.897138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:22.897138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:22.897138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:22.897138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:22.897138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:22.898022 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:22.898022 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:22.898022 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:22.898022 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:22.898022 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:22.898022 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:22.898022 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:22.898022 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:22.900723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 434/870] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:22.906871 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de4433-e763-44ed-bead-19518c765183 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:22.916274 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:22.920138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cd56e-60fa-4d25-8ee9-d864f53b4e13 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:22.956750 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc75bd6-5d84-46da-bedf-6aef2cca0b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:22.957441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc75bd6-5d84-46da-bedf-6aef2cca0b38 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:22.957730 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc75bd6-5d84-46da-bedf-6aef2cca0b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:22.958008 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc75bd6-5d84-46da-bedf-6aef2cca0b38 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:22.958734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc75bd6-5d84-46da-bedf-6aef2cca0b38 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:22.959044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc75bd6-5d84-46da-bedf-6aef2cca0b38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:22.960443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc75bd6-5d84-46da-bedf-6aef2cca0b38 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:22.965947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 437/871] 10.222.0.66 () {56 vars in 1126 bytes} [Thu May 26 21:02:22 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:23.024567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de4433-e763-44ed-bead-19518c765183 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:23.065537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b63ec-38e9-4107-bc96-e6c462dd63ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:23.066604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b63ec-38e9-4107-bc96-e6c462dd63ee None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:23.067101 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b63ec-38e9-4107-bc96-e6c462dd63ee None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:23.067586 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b63ec-38e9-4107-bc96-e6c462dd63ee None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:23.068653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b63ec-38e9-4107-bc96-e6c462dd63ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:23.069235 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b63ec-38e9-4107-bc96-e6c462dd63ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:23.070970 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b63ec-38e9-4107-bc96-e6c462dd63ee None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:23.090886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 435/872] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:02:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:23.092668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc75bd6-5d84-46da-bedf-6aef2cca0b38 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:23.168499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:23.218979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc75bd6-5d84-46da-bedf-6aef2cca0b38 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:23.256862 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94260926-647f-4a76-9432-053b920a9753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:23.257533 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94260926-647f-4a76-9432-053b920a9753 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:23.257819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94260926-647f-4a76-9432-053b920a9753 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:23.258099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94260926-647f-4a76-9432-053b920a9753 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:23.258983 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94260926-647f-4a76-9432-053b920a9753 None admin] RBAC: Adding query filter params (role.id=6391321aa2bd4ed5980bebfc65f307a9, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=5890e1e70ffd4e33a812691e9c43b6d2) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:23.259290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94260926-647f-4a76-9432-053b920a9753 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:23.260755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94260926-647f-4a76-9432-053b920a9753 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:23.267467 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 438/873] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:02:23 2022] GET /identity/v3/role_assignments?user.id=5890e1e70ffd4e33a812691e9c43b6d2&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=6391321aa2bd4ed5980bebfc65f307a9 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:23.353008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacbc00-2990-452a-baff-9be372c65b81 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:23.353314 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacbc00-2990-452a-baff-9be372c65b81 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:23.353573 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacbc00-2990-452a-baff-9be372c65b81 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:23.356070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 436/874] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:23.361995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9236a91-4fad-46fd-bdbb-bd81e572736a None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:23.362327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9236a91-4fad-46fd-bdbb-bd81e572736a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:23.362563 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9236a91-4fad-46fd-bdbb-bd81e572736a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:23.381390 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-f9236a91-4fad-46fd-bdbb-bd81e572736a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:23.383008 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f9236a91-4fad-46fd-bdbb-bd81e572736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:23.461256 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 439/875] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:23 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:23.485588 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacbc00-2990-452a-baff-9be372c65b81 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:23.566732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:23.610423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacbc00-2990-452a-baff-9be372c65b81 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:23.645544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c84a11-bda9-43ba-a3d9-7b804f48f653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:23.646414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c84a11-bda9-43ba-a3d9-7b804f48f653 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:23.646701 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c84a11-bda9-43ba-a3d9-7b804f48f653 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:23.646975 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c84a11-bda9-43ba-a3d9-7b804f48f653 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:23.647637 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c84a11-bda9-43ba-a3d9-7b804f48f653 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:23.649058 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c84a11-bda9-43ba-a3d9-7b804f48f653 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:23.662238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-d1c84a11-bda9-43ba-a3d9-7b804f48f653 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 21:02:23.662238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:23.662238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:23.662238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:23.662238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:23.662238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:23.662238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:23.662238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:23.662238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 21:02:23.662238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:23.662238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:23.662238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:23.662238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:23.662238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:23.662238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:23.662238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:23.662238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:23.663359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:23.663359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:23.663359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:23.663359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:23.663359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:23.663359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:23.663359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:23.663359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:23.663359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:23.663359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:23.663359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:23.663359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:23.663359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:23.663359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:23.663359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:23.663359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:23.664264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:23.664264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:23.664264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:23.664264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:23.664264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:23.664264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:23.664264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:23.664264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:23.664264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:23.664264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:23.664264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:23.664264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:23.664264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 21:02:23.664264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:23.668705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 437/876] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:02:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:23.670450 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9236a91-4fad-46fd-bdbb-bd81e572736a None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:23.728774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:23.779874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9236a91-4fad-46fd-bdbb-bd81e572736a None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:23.816608 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08ad42-de74-4964-acc2-1591e3eb0595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:23.817297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08ad42-de74-4964-acc2-1591e3eb0595 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:23.817579 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08ad42-de74-4964-acc2-1591e3eb0595 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:23.817855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08ad42-de74-4964-acc2-1591e3eb0595 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:23.818569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08ad42-de74-4964-acc2-1591e3eb0595 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:23.818874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08ad42-de74-4964-acc2-1591e3eb0595 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:23.820235 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08ad42-de74-4964-acc2-1591e3eb0595 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:23.830263 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 440/877] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:02:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:23.831655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c84a11-bda9-43ba-a3d9-7b804f48f653 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:23.936779 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c84a11-bda9-43ba-a3d9-7b804f48f653 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:23.965883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:23.971849 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29901d-741a-4041-aca4-e6770691bbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:23.972521 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29901d-741a-4041-aca4-e6770691bbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:23.972835 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29901d-741a-4041-aca4-e6770691bbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:23.973122 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29901d-741a-4041-aca4-e6770691bbc5 None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:23.973825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29901d-741a-4041-aca4-e6770691bbc5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:23.974130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29901d-741a-4041-aca4-e6770691bbc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:23.975620 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29901d-741a-4041-aca4-e6770691bbc5 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:23.981616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 438/878] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:02:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:23.989530 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08ad42-de74-4964-acc2-1591e3eb0595 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:24.093628 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08ad42-de74-4964-acc2-1591e3eb0595 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:24.111212 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:24.129277 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb57aaf-5306-486b-8024-d8cf13302048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:24.129948 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb57aaf-5306-486b-8024-d8cf13302048 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:24.130234 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb57aaf-5306-486b-8024-d8cf13302048 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:24.130510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb57aaf-5306-486b-8024-d8cf13302048 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:24.131312 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb57aaf-5306-486b-8024-d8cf13302048 None admin] RBAC: Adding query filter params (interface=public, service_id=e9cc1b8a3f28405fb3ced2293b63b04c, region_id=RegionOne) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:24.131622 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb57aaf-5306-486b-8024-d8cf13302048 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:24.133140 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb57aaf-5306-486b-8024-d8cf13302048 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:24.143888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 441/879] 10.222.0.66 () {56 vars in 1251 bytes} [Thu May 26 21:02:23 2022] GET /identity/v3/endpoints?service_id=e9cc1b8a3f28405fb3ced2293b63b04c&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:24.145195 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29901d-741a-4041-aca4-e6770691bbc5 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:24.254751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29901d-741a-4041-aca4-e6770691bbc5 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:24.290615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed155d-3a91-4117-a21b-b50042e6c428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:24.291288 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed155d-3a91-4117-a21b-b50042e6c428 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:24.291570 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed155d-3a91-4117-a21b-b50042e6c428 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:24.291846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed155d-3a91-4117-a21b-b50042e6c428 None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:24.292595 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed155d-3a91-4117-a21b-b50042e6c428 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:24.293989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed155d-3a91-4117-a21b-b50042e6c428 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:24.300129 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 439/880] 10.222.0.66 () {56 vars in 1087 bytes} [Thu May 26 21:02:24 2022] GET /identity/v3/services => generated 1011 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:02:24.749202 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b584a6-774d-49e0-a7e3-a6fa3f022f2d None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:24.749607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b584a6-774d-49e0-a7e3-a6fa3f022f2d None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:24.749794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b584a6-774d-49e0-a7e3-a6fa3f022f2d None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:24.751408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 442/881] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:24.756909 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d898047-2211-4ff6-a9b3-8c86f0a591db None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:24.757382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d898047-2211-4ff6-a9b3-8c86f0a591db None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:24.757474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d898047-2211-4ff6-a9b3-8c86f0a591db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:24.774933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-5d898047-2211-4ff6-a9b3-8c86f0a591db None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:24.776134 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-5d898047-2211-4ff6-a9b3-8c86f0a591db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:24.834239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:24.848440 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 440/882] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:24 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:24.871453 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b584a6-774d-49e0-a7e3-a6fa3f022f2d None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:24.985002 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b584a6-774d-49e0-a7e3-a6fa3f022f2d None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:25.021596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bccfce-d5fe-46d2-8f30-eeeb44424be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:25.022412 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bccfce-d5fe-46d2-8f30-eeeb44424be2 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:25.022690 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bccfce-d5fe-46d2-8f30-eeeb44424be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:25.022958 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bccfce-d5fe-46d2-8f30-eeeb44424be2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:25.023614 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bccfce-d5fe-46d2-8f30-eeeb44424be2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:25.025011 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bccfce-d5fe-46d2-8f30-eeeb44424be2 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:25.039010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-c7bccfce-d5fe-46d2-8f30-eeeb44424be2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 21:02:25.039010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:25.039010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:25.039010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:25.039010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:25.039010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:25.039010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:25.039010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:25.039010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 21:02:25.039010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:25.039010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:25.039010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:25.039010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:25.039010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:25.039010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:25.039010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:25.039010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:25.040077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:25.040077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:25.040077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:25.040077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:25.040077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:25.040077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:25.040077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:25.040077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:25.040077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:25.040077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:25.040077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:25.040077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:25.040077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:25.040077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:25.040077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:25.040077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:25.040927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:25.040927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:25.040927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:25.040927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:25.040927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:25.040927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:25.040927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:25.040927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:25.040927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:25.040927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:25.040927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:25.040927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:25.040927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 21:02:25.040927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:25.041915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 443/883] 10.222.0.66 () {56 vars in 1126 bytes} [Thu May 26 21:02:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:25.050148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d898047-2211-4ff6-a9b3-8c86f0a591db None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:25.160998 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d898047-2211-4ff6-a9b3-8c86f0a591db None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:25.197556 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6d8de-d74c-41c0-bbe2-4ba574dc4297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:25.198232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6d8de-d74c-41c0-bbe2-4ba574dc4297 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:25.198515 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6d8de-d74c-41c0-bbe2-4ba574dc4297 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:25.198829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6d8de-d74c-41c0-bbe2-4ba574dc4297 None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:25.199546 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6d8de-d74c-41c0-bbe2-4ba574dc4297 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:25.199849 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6d8de-d74c-41c0-bbe2-4ba574dc4297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:25.201353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6d8de-d74c-41c0-bbe2-4ba574dc4297 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:25.206962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 441/884] 10.222.0.66 () {56 vars in 1122 bytes} [Thu May 26 21:02:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:25.212692 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bccfce-d5fe-46d2-8f30-eeeb44424be2 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:25.263861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:25.319631 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bccfce-d5fe-46d2-8f30-eeeb44424be2 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:25.326934 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9a689-9d13-4d25-a46b-073ec1efca0e None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:25.327255 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9a689-9d13-4d25-a46b-073ec1efca0e None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:25.327503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9a689-9d13-4d25-a46b-073ec1efca0e None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:25.329191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 442/885] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:25.334587 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4184c8b-6426-476e-82c8-52a57dfd20e3 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:25.334880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4184c8b-6426-476e-82c8-52a57dfd20e3 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:25.335164 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4184c8b-6426-476e-82c8-52a57dfd20e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:25.352852 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-b4184c8b-6426-476e-82c8-52a57dfd20e3 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:25.354072 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b4184c8b-6426-476e-82c8-52a57dfd20e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:25.357648 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785799c-1837-437a-a3a6-ad10d560bdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:25.358330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785799c-1837-437a-a3a6-ad10d560bdfa None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:25.358613 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785799c-1837-437a-a3a6-ad10d560bdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:25.358893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785799c-1837-437a-a3a6-ad10d560bdfa None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:25.359608 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785799c-1837-437a-a3a6-ad10d560bdfa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:25.359918 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785799c-1837-437a-a3a6-ad10d560bdfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:25.361322 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785799c-1837-437a-a3a6-ad10d560bdfa None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:25.366668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 444/886] 10.222.0.66 () {56 vars in 1122 bytes} [Thu May 26 21:02:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:25.417850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:25.442613 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 443/887] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:25 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:25.468232 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785799c-1837-437a-a3a6-ad10d560bdfa None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:25.588243 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785799c-1837-437a-a3a6-ad10d560bdfa None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:25.599016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:25.624705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2e20b-1f96-4202-8d53-c33934b0ce0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:25.625382 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2e20b-1f96-4202-8d53-c33934b0ce0d None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:25.625662 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2e20b-1f96-4202-8d53-c33934b0ce0d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:25.625937 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2e20b-1f96-4202-8d53-c33934b0ce0d None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:25.626680 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2e20b-1f96-4202-8d53-c33934b0ce0d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:25.628046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2e20b-1f96-4202-8d53-c33934b0ce0d None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:25.701259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 445/888] 10.222.0.66 () {60 vars in 1141 bytes} [Thu May 26 21:02:25 2022] POST /identity/v3/services => generated 269 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:02:25.734150 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ca38c-d086-4141-b8b8-d47fc037d0bf None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:25.735010 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ca38c-d086-4141-b8b8-d47fc037d0bf None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:25.735532 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ca38c-d086-4141-b8b8-d47fc037d0bf None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:25.737546 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 444/889] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:25.743771 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044f77b-f971-44ac-8847-79def076f79a None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:25.744407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044f77b-f971-44ac-8847-79def076f79a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:25.744951 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044f77b-f971-44ac-8847-79def076f79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:25.765585 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-0044f77b-f971-44ac-8847-79def076f79a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:25.766861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0044f77b-f971-44ac-8847-79def076f79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:25.851280 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 446/890] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:25.875466 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ca38c-d086-4141-b8b8-d47fc037d0bf None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:25.987128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ca38c-d086-4141-b8b8-d47fc037d0bf None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:26.026022 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c4211-ebef-4451-9102-6147799f0062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:26.026950 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c4211-ebef-4451-9102-6147799f0062 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:26.027235 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c4211-ebef-4451-9102-6147799f0062 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:26.027513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c4211-ebef-4451-9102-6147799f0062 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:26.039513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c4211-ebef-4451-9102-6147799f0062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:26.047989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-322c4211-ebef-4451-9102-6147799f0062 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 21:02:26.047989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:26.047989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:26.047989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:26.047989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:26.047989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:26.047989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:26.047989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:26.047989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:26.047989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:26.047989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:26.047989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:26.047989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:26.047989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:26.047989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:26.047989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:26.048968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:26.048968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:26.048968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:26.048968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:26.048968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:26.048968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:26.048968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:26.048968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:26.048968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:26.048968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:26.048968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:26.048968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:26.048968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:26.048968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:26.048968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:26.048968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:26.049824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:26.049824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:26.049824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:26.049824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:26.049824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:26.049824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:26.049824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:26.049824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:26.049824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:26.049824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:26.049824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 21:02:26.049824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:26.049824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 445/891] 10.222.0.66 () {56 vars in 1120 bytes} [Thu May 26 21:02:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:26.057136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044f77b-f971-44ac-8847-79def076f79a None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:26.158076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:26.165631 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044f77b-f971-44ac-8847-79def076f79a None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:26.202471 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ad977-a7ad-4475-a2b4-28877d06dbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:26.203535 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ad977-a7ad-4475-a2b4-28877d06dbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:26.204031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ad977-a7ad-4475-a2b4-28877d06dbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:26.204560 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ad977-a7ad-4475-a2b4-28877d06dbc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:26.205588 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ad977-a7ad-4475-a2b4-28877d06dbc8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:26.206120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ad977-a7ad-4475-a2b4-28877d06dbc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:26.207838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ad977-a7ad-4475-a2b4-28877d06dbc8 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:26.217510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 447/892] 10.222.0.66 () {56 vars in 1115 bytes} [Thu May 26 21:02:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:26.223451 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c4211-ebef-4451-9102-6147799f0062 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:26.273755 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:26.338408 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c4211-ebef-4451-9102-6147799f0062 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:26.374731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35640732-3923-4b91-9f55-9bcb34172562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:26.375535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35640732-3923-4b91-9f55-9bcb34172562 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:26.375815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35640732-3923-4b91-9f55-9bcb34172562 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:26.376089 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35640732-3923-4b91-9f55-9bcb34172562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:26.387268 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35640732-3923-4b91-9f55-9bcb34172562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:26.388768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35640732-3923-4b91-9f55-9bcb34172562 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:26.406128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-35640732-3923-4b91-9f55-9bcb34172562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:26.406128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:26.406128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:26.406128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:26.406128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:26.406128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:26.406128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:26.406128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:26.406128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:26.406128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:26.406128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:26.406128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:26.406128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:26.406128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:26.406128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:26.407094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:26.407094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:26.407094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:26.407094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:26.407094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:26.407094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:26.407094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:26.407094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:26.407094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:26.407094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:26.407094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:26.407094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:26.407094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:26.407094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:26.407094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:26.407094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:26.407094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:26.407973 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:26.407973 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:26.407973 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:26.407973 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:26.407973 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 446/893] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:26.414553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ad977-a7ad-4475-a2b4-28877d06dbc8 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:26.526016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ad977-a7ad-4475-a2b4-28877d06dbc8 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:26.567740 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a350a3-b38d-4b9e-b83f-9e8be9695c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:26.568761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a350a3-b38d-4b9e-b83f-9e8be9695c8f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:26.569260 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a350a3-b38d-4b9e-b83f-9e8be9695c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:26.569755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a350a3-b38d-4b9e-b83f-9e8be9695c8f None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:26.570698 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a350a3-b38d-4b9e-b83f-9e8be9695c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:26.571238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a350a3-b38d-4b9e-b83f-9e8be9695c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:26.578419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a350a3-b38d-4b9e-b83f-9e8be9695c8f None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:26.594479 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 448/894] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:26.599819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35640732-3923-4b91-9f55-9bcb34172562 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:26.661123 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9b196-1736-4091-9c6d-0f367f00d96a None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:26.661784 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9b196-1736-4091-9c6d-0f367f00d96a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:26.662295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9b196-1736-4091-9c6d-0f367f00d96a None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:26.664134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 449/895] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:26.670123 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fd2b6-cdc3-443c-894a-b3abf549668e None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:26.670681 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fd2b6-cdc3-443c-894a-b3abf549668e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:26.671205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fd2b6-cdc3-443c-894a-b3abf549668e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:26.688751 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-fc7fd2b6-cdc3-443c-894a-b3abf549668e None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:26.690307 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-fc7fd2b6-cdc3-443c-894a-b3abf549668e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:26.701448 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:26.702480 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:26.709171 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35640732-3923-4b91-9f55-9bcb34172562 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:26.745932 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8618c-9fe0-4e98-9211-11d68084abcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:26.747035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8618c-9fe0-4e98-9211-11d68084abcc None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:26.747517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8618c-9fe0-4e98-9211-11d68084abcc None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:26.747939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8618c-9fe0-4e98-9211-11d68084abcc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:26.755721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8618c-9fe0-4e98-9211-11d68084abcc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:26.757497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8618c-9fe0-4e98-9211-11d68084abcc None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:26.773042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 450/896] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:26.773347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-35c8618c-9fe0-4e98-9211-11d68084abcc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 21:02:26.773347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:26.773347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:26.773347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:26.773347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:26.773347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:26.773347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:26.773347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:26.773347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:26.773347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:26.773347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:26.773347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:26.773347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:02:26.773347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:02:26.773347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:02:26.773347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:02:26.774263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:26.774263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:26.774263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:02:26.774263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:26.774263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:02:26.774263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:26.774263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:26.774263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:26.774263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:26.774263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:26.774263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:26.774263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:26.774263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:26.774263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:26.774263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:26.774263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:26.774263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:26.774263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:26.775211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:26.775211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:26.775211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:02:26.775211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:02:26.775211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:02:26.775211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:02:26.775211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:02:26.775211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:02:26.775211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 21:02:26.775211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:26.775211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 447/897] 10.222.0.66 () {56 vars in 1117 bytes} [Thu May 26 21:02:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:26.782439 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fd2b6-cdc3-443c-894a-b3abf549668e None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:26.798920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8618c-9fe0-4e98-9211-11d68084abcc None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:26.889208 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fd2b6-cdc3-443c-894a-b3abf549668e None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:26.901390 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8618c-9fe0-4e98-9211-11d68084abcc None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:26.926876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57511bed-96e9-46b0-bc28-aec8bb5552a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:26.927744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57511bed-96e9-46b0-bc28-aec8bb5552a8 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:26.928131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57511bed-96e9-46b0-bc28-aec8bb5552a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:26.928707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57511bed-96e9-46b0-bc28-aec8bb5552a8 None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:26.929834 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57511bed-96e9-46b0-bc28-aec8bb5552a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:26.930382 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57511bed-96e9-46b0-bc28-aec8bb5552a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:26.932095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57511bed-96e9-46b0-bc28-aec8bb5552a8 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:26.939819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311ea5-b65f-4f4a-bf1b-55da32f1240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:26.941021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311ea5-b65f-4f4a-bf1b-55da32f1240f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:26.941504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311ea5-b65f-4f4a-bf1b-55da32f1240f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:26.941970 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311ea5-b65f-4f4a-bf1b-55da32f1240f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:26.942889 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a311ea5-b65f-4f4a-bf1b-55da32f1240f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:26.944655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a311ea5-b65f-4f4a-bf1b-55da32f1240f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:26.958021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-7a311ea5-b65f-4f4a-bf1b-55da32f1240f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 21:02:26.958021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:26.958021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:26.958021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:26.958021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:26.958021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:26.958021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:26.958021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:26.958021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 21:02:26.958021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:26.958021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:26.958021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:26.958021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:26.958021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:26.958021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:26.958021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:26.958021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:26.959035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:26.959035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:26.959035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:26.959035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:26.959035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:26.959035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:26.959035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:26.959035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:26.959035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:26.959035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:26.959035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:26.959035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:26.959035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:26.959035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:26.959035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:26.959035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:26.959867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:26.959867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:26.959867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:26.959867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:26.959867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:26.959867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:26.959867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:26.959867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:26.959867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:26.959867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:26.959867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:26.959867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:26.959867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 21:02:26.959867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:26.960605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 451/898] 10.222.0.66 () {56 vars in 1149 bytes} [Thu May 26 21:02:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:26.960605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57511bed-96e9-46b0-bc28-aec8bb5552a8 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:26.968225 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:26.968565 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 448/899] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:02:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:26.969773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311ea5-b65f-4f4a-bf1b-55da32f1240f None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:26.992565 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:27.073116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57511bed-96e9-46b0-bc28-aec8bb5552a8 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:27.077739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311ea5-b65f-4f4a-bf1b-55da32f1240f None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:27.111743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23629c6e-93a5-4052-a23e-cda31b991534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:27.112407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23629c6e-93a5-4052-a23e-cda31b991534 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:27.112749 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23629c6e-93a5-4052-a23e-cda31b991534 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:27.113036 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23629c6e-93a5-4052-a23e-cda31b991534 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:27.116901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d58425-ff8c-4bcc-9adb-a08fbc755786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:27.117879 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d58425-ff8c-4bcc-9adb-a08fbc755786 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:27.118382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d58425-ff8c-4bcc-9adb-a08fbc755786 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:27.118876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d58425-ff8c-4bcc-9adb-a08fbc755786 None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:27.119809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d58425-ff8c-4bcc-9adb-a08fbc755786 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:27.120318 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d58425-ff8c-4bcc-9adb-a08fbc755786 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:27.122014 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d58425-ff8c-4bcc-9adb-a08fbc755786 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:27.132269 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 449/900] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:02:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:27.133567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d58425-ff8c-4bcc-9adb-a08fbc755786 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:27.190353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23629c6e-93a5-4052-a23e-cda31b991534 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:27.191612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23629c6e-93a5-4052-a23e-cda31b991534 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:27.194737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:27.221728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:27.240841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d58425-ff8c-4bcc-9adb-a08fbc755786 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:27.276865 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f0f8-2c55-4c69-9b73-b638ef3a5ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:27.277643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f0f8-2c55-4c69-9b73-b638ef3a5ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:27.278030 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f0f8-2c55-4c69-9b73-b638ef3a5ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:27.278407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f0f8-2c55-4c69-9b73-b638ef3a5ba2 None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:27.279403 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637f0f8-2c55-4c69-9b73-b638ef3a5ba2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:27.279836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637f0f8-2c55-4c69-9b73-b638ef3a5ba2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:27.281377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637f0f8-2c55-4c69-9b73-b638ef3a5ba2 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:27.292470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 450/901] 10.222.0.66 () {56 vars in 1114 bytes} [Thu May 26 21:02:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:27.293533 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f0f8-2c55-4c69-9b73-b638ef3a5ba2 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:27.314624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 452/902] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:02:26 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:02:27.315777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23629c6e-93a5-4052-a23e-cda31b991534 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:27.404759 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f0f8-2c55-4c69-9b73-b638ef3a5ba2 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:27.430947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23629c6e-93a5-4052-a23e-cda31b991534 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:27.434778 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:27.454167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6272c7-d54e-49d9-99d0-ed412341dccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:27.455974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6272c7-d54e-49d9-99d0-ed412341dccf None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:27.455974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6272c7-d54e-49d9-99d0-ed412341dccf None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:27.456778 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6272c7-d54e-49d9-99d0-ed412341dccf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:27.458065 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6272c7-d54e-49d9-99d0-ed412341dccf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:27.460850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6272c7-d54e-49d9-99d0-ed412341dccf None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:27.472639 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a5161-5078-4fe5-a5bd-54dff8c99b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:27.473837 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a5161-5078-4fe5-a5bd-54dff8c99b6a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:27.474335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a5161-5078-4fe5-a5bd-54dff8c99b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:27.474804 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a5161-5078-4fe5-a5bd-54dff8c99b6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:27.487566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a5161-5078-4fe5-a5bd-54dff8c99b6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:27.489439 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a5161-5078-4fe5-a5bd-54dff8c99b6a None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:27.509347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-562a5161-5078-4fe5-a5bd-54dff8c99b6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:27.509347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:27.509347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:27.509347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:27.509347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:27.509347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:27.509347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:27.509347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:27.509347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:27.509347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:27.509347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:27.509347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:27.509347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:27.509347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:27.509347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:27.510515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:27.510515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:27.510515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:27.510515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:27.510515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:27.510515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:27.510515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:27.510515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:27.510515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:27.510515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:27.510515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:27.510515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:27.510515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:27.510515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:27.510515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:27.510515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:27.510515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:27.512007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:27.512007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:27.512007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:27.512007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:27.517060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 453/903] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:27.524856 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a5161-5078-4fe5-a5bd-54dff8c99b6a None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:27.552057 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 451/904] 10.222.0.66 () {60 vars in 1144 bytes} [Thu May 26 21:02:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:02:27.666523 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a5161-5078-4fe5-a5bd-54dff8c99b6a None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:27.735764 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21335e36-6d07-46be-ad3e-1e9856546706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:27.736811 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84641a86-1b23-47a4-a4f9-15841403e824 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:27.737102 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84641a86-1b23-47a4-a4f9-15841403e824 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:27.737379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84641a86-1b23-47a4-a4f9-15841403e824 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:27.738163 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21335e36-6d07-46be-ad3e-1e9856546706 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:27.738906 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21335e36-6d07-46be-ad3e-1e9856546706 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:27.739654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21335e36-6d07-46be-ad3e-1e9856546706 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:27.740300 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 452/905] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:27.741572 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21335e36-6d07-46be-ad3e-1e9856546706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:27.742402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21335e36-6d07-46be-ad3e-1e9856546706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:27.744878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac95b2-1c6c-4bc1-bde5-4f3754ca028d None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:27.745170 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac95b2-1c6c-4bc1-bde5-4f3754ca028d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:27.745499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac95b2-1c6c-4bc1-bde5-4f3754ca028d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:27.746748 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21335e36-6d07-46be-ad3e-1e9856546706 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:27.751658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:27.765626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-f3ac95b2-1c6c-4bc1-bde5-4f3754ca028d None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:27.767135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f3ac95b2-1c6c-4bc1-bde5-4f3754ca028d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:27.784390 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 454/906] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:27.788390 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21335e36-6d07-46be-ad3e-1e9856546706 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:27.806565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:27.863215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 453/907] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:27.887376 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac95b2-1c6c-4bc1-bde5-4f3754ca028d None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:27.923253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21335e36-6d07-46be-ad3e-1e9856546706 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:27.959766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebbc67-4b61-4a5e-85f9-7d6aa9e106b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:27.960575 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebbc67-4b61-4a5e-85f9-7d6aa9e106b3 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:27.960890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebbc67-4b61-4a5e-85f9-7d6aa9e106b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:27.961164 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebbc67-4b61-4a5e-85f9-7d6aa9e106b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:27.969452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebbc67-4b61-4a5e-85f9-7d6aa9e106b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:27.970914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebbc67-4b61-4a5e-85f9-7d6aa9e106b3 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:27.987583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-62ebbc67-4b61-4a5e-85f9-7d6aa9e106b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:27.987583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:27.987583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:27.987583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:27.987583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:27.987583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:27.987583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:27.987583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:27.987583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:27.987583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:27.987583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:27.987583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:27.987583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:27.987583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:27.987583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:27.988746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:27.988746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:27.988746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:27.988746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:27.988746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:27.988746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:27.988746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:27.988746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:27.988746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:27.988746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:27.988746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:27.988746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:27.988746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:27.988746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:27.988746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:27.988746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:27.988746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:27.989640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:27.989640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:27.989640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:27.989640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:27.989640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:27.989640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:27.989640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:27.989640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:27.989640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 455/908] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:27.994825 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebbc67-4b61-4a5e-85f9-7d6aa9e106b3 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:28.005610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac95b2-1c6c-4bc1-bde5-4f3754ca028d None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:28.043057 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89727ce7-b1ab-4d8e-9c02-aa9996926987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:28.044049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89727ce7-b1ab-4d8e-9c02-aa9996926987 None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:28.044554 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89727ce7-b1ab-4d8e-9c02-aa9996926987 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:28.045044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89727ce7-b1ab-4d8e-9c02-aa9996926987 None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:28.045997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89727ce7-b1ab-4d8e-9c02-aa9996926987 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:28.047584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89727ce7-b1ab-4d8e-9c02-aa9996926987 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:28.053076 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:28.071388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:28.100573 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebbc67-4b61-4a5e-85f9-7d6aa9e106b3 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:28.129312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 454/909] 10.222.0.66 () {60 vars in 1141 bytes} [Thu May 26 21:02:27 2022] POST /identity/v3/services => generated 241 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:02:28.130650 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdad1a-bfb1-4265-9332-df1cf1e49946 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:28.130942 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdad1a-bfb1-4265-9332-df1cf1e49946 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:28.131222 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdad1a-bfb1-4265-9332-df1cf1e49946 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:28.132662 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 455/910] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:28.139232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09f9e8-f9a0-4a92-a54f-82a629a194f7 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:28.141564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09f9e8-f9a0-4a92-a54f-82a629a194f7 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:28.141564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09f9e8-f9a0-4a92-a54f-82a629a194f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:28.157503 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ad4d6-c95b-4a34-8261-e024042ef02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:28.158675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ad4d6-c95b-4a34-8261-e024042ef02b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:28.159451 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ad4d6-c95b-4a34-8261-e024042ef02b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:28.159931 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ad4d6-c95b-4a34-8261-e024042ef02b None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:28.161276 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ad4d6-c95b-4a34-8261-e024042ef02b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:28.161803 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ad4d6-c95b-4a34-8261-e024042ef02b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:28.163562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ad4d6-c95b-4a34-8261-e024042ef02b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:28.167405 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-fc09f9e8-f9a0-4a92-a54f-82a629a194f7 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:28.168850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-fc09f9e8-f9a0-4a92-a54f-82a629a194f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:28.179520 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 456/911] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:02:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:28.186076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ad4d6-c95b-4a34-8261-e024042ef02b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:28.264813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 456/912] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:28.297010 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09f9e8-f9a0-4a92-a54f-82a629a194f7 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:28.333661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ad4d6-c95b-4a34-8261-e024042ef02b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:28.363901 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:28.374315 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c022f-500d-479d-9d57-93e8598d6785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:28.374987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c022f-500d-479d-9d57-93e8598d6785 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:28.375274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c022f-500d-479d-9d57-93e8598d6785 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:28.375556 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c022f-500d-479d-9d57-93e8598d6785 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:28.376642 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c022f-500d-479d-9d57-93e8598d6785 None admin] RBAC: Adding query filter params (role.id=1a67a38c7559419081284aa53b1fdfaa, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=5890e1e70ffd4e33a812691e9c43b6d2) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:28.377494 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c022f-500d-479d-9d57-93e8598d6785 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:28.378967 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c022f-500d-479d-9d57-93e8598d6785 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:28.385607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 457/913] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:02:28 2022] GET /identity/v3/role_assignments?user.id=5890e1e70ffd4e33a812691e9c43b6d2&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=1a67a38c7559419081284aa53b1fdfaa => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:28.421866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09f9e8-f9a0-4a92-a54f-82a629a194f7 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:28.452829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:28.467227 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666c4ee-37a2-4276-b061-700e736449ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:28.468063 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666c4ee-37a2-4276-b061-700e736449ed None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:28.468350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666c4ee-37a2-4276-b061-700e736449ed None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:28.468663 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666c4ee-37a2-4276-b061-700e736449ed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:28.469448 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666c4ee-37a2-4276-b061-700e736449ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:28.470937 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666c4ee-37a2-4276-b061-700e736449ed None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:28.484920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-1666c4ee-37a2-4276-b061-700e736449ed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 21:02:28.484920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:28.484920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:28.484920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:28.484920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:28.484920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:28.484920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:28.484920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:28.484920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 21:02:28.484920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:28.484920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:28.484920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:28.484920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:28.484920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:28.484920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:28.484920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:28.485917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:28.485917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:28.485917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:28.485917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:28.485917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:28.485917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:28.485917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:28.485917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:28.485917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:28.485917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:28.485917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:28.485917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:28.485917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:28.485917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:28.485917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:28.485917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:28.487209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:28.487209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:28.487209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:28.487209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:28.487209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:28.487209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:28.487209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:28.487209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:28.487209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:28.487209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:28.487209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:28.487209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:28.487209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:28.487209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 21:02:28.487209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:28.487209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 457/914] 10.222.0.66 () {56 vars in 1132 bytes} [Thu May 26 21:02:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:28.492925 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c022f-500d-479d-9d57-93e8598d6785 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:28.619239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c022f-500d-479d-9d57-93e8598d6785 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:28.655415 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75bd62-e52e-4ef2-b5af-e2631b180110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:28.656090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75bd62-e52e-4ef2-b5af-e2631b180110 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:28.656375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75bd62-e52e-4ef2-b5af-e2631b180110 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:28.656703 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75bd62-e52e-4ef2-b5af-e2631b180110 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:28.657421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75bd62-e52e-4ef2-b5af-e2631b180110 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:28.657727 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75bd62-e52e-4ef2-b5af-e2631b180110 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:28.659115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75bd62-e52e-4ef2-b5af-e2631b180110 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:28.664912 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 458/915] 10.222.0.66 () {56 vars in 1126 bytes} [Thu May 26 21:02:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:28.670746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666c4ee-37a2-4276-b061-700e736449ed None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:28.778047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666c4ee-37a2-4276-b061-700e736449ed None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:28.813795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112c987-1b50-4825-9715-25340120a2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:28.814472 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112c987-1b50-4825-9715-25340120a2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:28.814759 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112c987-1b50-4825-9715-25340120a2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:28.815045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112c987-1b50-4825-9715-25340120a2b0 None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:28.815825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112c987-1b50-4825-9715-25340120a2b0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:28.816143 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112c987-1b50-4825-9715-25340120a2b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:28.817582 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112c987-1b50-4825-9715-25340120a2b0 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:28.824422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 458/916] 10.222.0.66 () {56 vars in 1126 bytes} [Thu May 26 21:02:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:28.830564 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75bd62-e52e-4ef2-b5af-e2631b180110 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:28.894887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:28.942485 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75bd62-e52e-4ef2-b5af-e2631b180110 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:28.982747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09239894-2be7-4e8f-8199-541b968bc127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:28.983444 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09239894-2be7-4e8f-8199-541b968bc127 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:28.983734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09239894-2be7-4e8f-8199-541b968bc127 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:28.984015 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09239894-2be7-4e8f-8199-541b968bc127 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:28.984999 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09239894-2be7-4e8f-8199-541b968bc127 None admin] RBAC: Adding query filter params (interface=public, service_id=d6687868a4b9469abbf1e4f1dd8b149f, region_id=RegionOne) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:28.985315 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09239894-2be7-4e8f-8199-541b968bc127 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:28.986837 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09239894-2be7-4e8f-8199-541b968bc127 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:28.993798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 459/917] 10.222.0.66 () {56 vars in 1251 bytes} [Thu May 26 21:02:28 2022] GET /identity/v3/endpoints?service_id=d6687868a4b9469abbf1e4f1dd8b149f&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:28.999834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112c987-1b50-4825-9715-25340120a2b0 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:29.057070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:29.108002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112c987-1b50-4825-9715-25340120a2b0 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:29.143331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34002ba-2a9b-408d-97ed-42bcd31ef6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:29.144015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34002ba-2a9b-408d-97ed-42bcd31ef6fe None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:29.144304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34002ba-2a9b-408d-97ed-42bcd31ef6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:29.144606 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34002ba-2a9b-408d-97ed-42bcd31ef6fe None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:29.145311 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34002ba-2a9b-408d-97ed-42bcd31ef6fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:29.146813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34002ba-2a9b-408d-97ed-42bcd31ef6fe None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:29.153838 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 459/918] 10.222.0.66 () {56 vars in 1087 bytes} [Thu May 26 21:02:28 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:02:30.008232 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fef5b8-1267-4e4d-bfc3-bc15ea36a5c1 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:30.008816 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fef5b8-1267-4e4d-bfc3-bc15ea36a5c1 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:30.008816 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fef5b8-1267-4e4d-bfc3-bc15ea36a5c1 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:30.010403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 460/919] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:30.016769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19c03c-6310-41d3-8e25-4fc1702bf600 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:30.017117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19c03c-6310-41d3-8e25-4fc1702bf600 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:30.017403 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19c03c-6310-41d3-8e25-4fc1702bf600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:30.034964 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-8e19c03c-6310-41d3-8e25-4fc1702bf600 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:30.036151 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-8e19c03c-6310-41d3-8e25-4fc1702bf600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:30.104506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 460/920] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:30.127575 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fef5b8-1267-4e4d-bfc3-bc15ea36a5c1 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:30.231470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fef5b8-1267-4e4d-bfc3-bc15ea36a5c1 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:30.252698 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:30.267828 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a1816-cdde-4396-9dee-c4c134d111c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:30.268805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a1816-cdde-4396-9dee-c4c134d111c3 None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:30.269282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a1816-cdde-4396-9dee-c4c134d111c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:30.269725 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a1816-cdde-4396-9dee-c4c134d111c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:30.270694 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a1816-cdde-4396-9dee-c4c134d111c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:30.272388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a1816-cdde-4396-9dee-c4c134d111c3 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:30.273952 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: WARNING keystone.server.flask.common [None req-133a1816-cdde-4396-9dee-c4c134d111c3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 21:02:30.310898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.sql.core [None req-133a1816-cdde-4396-9dee-c4c134d111c3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 21:02:30.310898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 21:02:30.310898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [parameters: {'id': '744ad0f6cbcc4cee977c70a04e73b26d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 21:02:30.310898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80747) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 21:02:30.319596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-133a1816-cdde-4396-9dee-c4c134d111c3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 744ad0f6cbcc4cee977c70a04e73b26d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 744ad0f6cbcc4cee977c70a04e73b26d. May 26 21:02:30.319596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:30.319596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 21:02:30.319596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 21:02:30.319596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 21:02:30.319596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 21:02:30.319596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 21:02:30.319596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application result = self._query(query) May 26 21:02:30.319596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 21:02:30.319596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application conn.query(q) May 26 21:02:30.319596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 21:02:30.319596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 21:02:30.319596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 21:02:30.327765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application result.read() May 26 21:02:30.327765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 21:02:30.327765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 21:02:30.327765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 21:02:30.327765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 21:02:30.327765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 21:02:30.327765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 21:02:30.327765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 21:02:30.327765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 21:02:30.327765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 21:02:30.327765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:30.327765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 21:02:30.327765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:30.327765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:30.327765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 21:02:30.327765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 21:02:30.327765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 21:02:30.327765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 21:02:30.328966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 21:02:30.328966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application next(self.gen) May 26 21:02:30.328966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 21:02:30.328966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application yield resource May 26 21:02:30.328966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 21:02:30.328966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application next(self.gen) May 26 21:02:30.328966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 21:02:30.328966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self.session.rollback() May 26 21:02:30.328966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 21:02:30.328966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self.force_reraise() May 26 21:02:30.328966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 21:02:30.328966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise self.value May 26 21:02:30.328966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 21:02:30.328966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 21:02:30.328966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 21:02:30.328966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application session.commit() May 26 21:02:30.328966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 21:02:30.330136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 21:02:30.330136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 21:02:30.330136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._prepare_impl() May 26 21:02:30.330136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 21:02:30.330136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self.session.flush() May 26 21:02:30.330136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 21:02:30.330136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._flush(objects) May 26 21:02:30.330136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 21:02:30.330136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 21:02:30.330136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 21:02:30.330136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application compat.raise_( May 26 21:02:30.330136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 21:02:30.330136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception May 26 21:02:30.330136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 21:02:30.330136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application flush_context.execute() May 26 21:02:30.330136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 21:02:30.330136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rec.execute(self) May 26 21:02:30.331223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 21:02:30.331223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 21:02:30.331223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 21:02:30.331223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 21:02:30.331223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 21:02:30.331223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 21:02:30.331223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 21:02:30.331223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 21:02:30.331223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 21:02:30.331223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 21:02:30.331223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 21:02:30.331223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 21:02:30.331223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 21:02:30.331223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 21:02:30.331223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 21:02:30.332321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 21:02:30.332321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 21:02:30.332321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception May 26 21:02:30.332321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 21:02:30.332321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 21:02:30.332321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 21:02:30.332321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 21:02:30.332321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 21:02:30.332321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application result = self._query(query) May 26 21:02:30.332321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 21:02:30.332321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application conn.query(q) May 26 21:02:30.332321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 21:02:30.332321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 21:02:30.332321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 21:02:30.332321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application result.read() May 26 21:02:30.332321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 21:02:30.332321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 21:02:30.334044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 21:02:30.334044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 21:02:30.334044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 21:02:30.334044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 21:02:30.334044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 21:02:30.334044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 21:02:30.334044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 21:02:30.334044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 21:02:30.334044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [parameters: {'id': '744ad0f6cbcc4cee977c70a04e73b26d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 21:02:30.334044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 21:02:30.334044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:30.334044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:30.334044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:30.334044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:30.334044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 21:02:30.335766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 21:02:30.335766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 21:02:30.335766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 21:02:30.335766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 21:02:30.335766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:30.335766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:30.335766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:30.335766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:30.335766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:30.335766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:30.335766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:30.335766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:30.335766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:30.335766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:30.335766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:30.335766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:30.335766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:30.337657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:30.337657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 21:02:30.337657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 21:02:30.337657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:30.337657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:30.337657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 21:02:30.337657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 21:02:30.337657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 744ad0f6cbcc4cee977c70a04e73b26d. May 26 21:02:30.337657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:30.337657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 461/921] 10.222.0.66 () {60 vars in 1140 bytes} [Thu May 26 21:02:30 2022] POST /identity/v3/projects => generated 262 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:30.338611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19c03c-6310-41d3-8e25-4fc1702bf600 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:30.388985 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:30.447117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19c03c-6310-41d3-8e25-4fc1702bf600 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:30.482692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec5dd1-bd5a-436b-a05b-28426e821543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:30.483502 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec5dd1-bd5a-436b-a05b-28426e821543 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:30.483788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec5dd1-bd5a-436b-a05b-28426e821543 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:30.484067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec5dd1-bd5a-436b-a05b-28426e821543 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:30.491406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec5dd1-bd5a-436b-a05b-28426e821543 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:30.493050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec5dd1-bd5a-436b-a05b-28426e821543 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:30.508394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-8aec5dd1-bd5a-436b-a05b-28426e821543 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:30.508394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:30.508394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:30.508394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:30.508394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:30.508394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:30.508394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:30.508394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:30.508394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:30.508394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:30.508394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:30.508394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:30.508394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:30.508394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:30.508394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:30.509785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:30.509785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:30.509785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:30.509785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:30.509785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:30.509785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:30.509785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:30.509785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:30.509785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:30.509785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:30.509785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:30.509785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:30.509785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:30.509785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:30.509785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:30.509785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:30.509785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:30.511905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:30.511905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:30.511905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:30.511905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:30.511905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:30.511905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:30.511905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:30.511905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:30.511905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 461/922] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:30.514512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78a457-02bb-45fb-a0b3-9bde9e99ccbe None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:30.514512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78a457-02bb-45fb-a0b3-9bde9e99ccbe None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:30.514512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78a457-02bb-45fb-a0b3-9bde9e99ccbe None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:30.515700 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec5dd1-bd5a-436b-a05b-28426e821543 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:30.518668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 462/923] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:30.524185 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eedd2-d5de-4b1b-ba2c-25b219342fc1 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:30.524468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eedd2-d5de-4b1b-ba2c-25b219342fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:30.524766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eedd2-d5de-4b1b-ba2c-25b219342fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:30.542785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-6c1eedd2-d5de-4b1b-ba2c-25b219342fc1 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:30.544543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6c1eedd2-d5de-4b1b-ba2c-25b219342fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:30.626781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec5dd1-bd5a-436b-a05b-28426e821543 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:30.632989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 463/924] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:30.635258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:30.647570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1eedd2-d5de-4b1b-ba2c-25b219342fc1 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:30.664446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654db7d4-9242-4193-b404-3259693409e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:30.665147 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654db7d4-9242-4193-b404-3259693409e1 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:30.665430 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654db7d4-9242-4193-b404-3259693409e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:30.665710 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654db7d4-9242-4193-b404-3259693409e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:30.666471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654db7d4-9242-4193-b404-3259693409e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:30.666777 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654db7d4-9242-4193-b404-3259693409e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:30.668942 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654db7d4-9242-4193-b404-3259693409e1 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:30.688767 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 462/925] 10.222.0.66 () {56 vars in 1112 bytes} [Thu May 26 21:02:30 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:30.762909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1eedd2-d5de-4b1b-ba2c-25b219342fc1 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:30.772055 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:30.804272 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53645ed-da34-4dc6-a5c5-dbfa726af251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:30.805204 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53645ed-da34-4dc6-a5c5-dbfa726af251 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:30.805488 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53645ed-da34-4dc6-a5c5-dbfa726af251 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:30.805761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53645ed-da34-4dc6-a5c5-dbfa726af251 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:30.806425 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53645ed-da34-4dc6-a5c5-dbfa726af251 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:30.808833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53645ed-da34-4dc6-a5c5-dbfa726af251 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:30.822007 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a45eca-0c35-4cf9-981d-789facb9e48b None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:30.822701 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a45eca-0c35-4cf9-981d-789facb9e48b None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:30.822814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-b53645ed-da34-4dc6-a5c5-dbfa726af251 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 21:02:30.822814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:30.822814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:30.822814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:30.822814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:30.822814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:30.822814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:30.822814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:30.822814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 21:02:30.822814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:30.822814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:30.822814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:30.822814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:30.822814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:30.822814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:30.822814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:30.822814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:30.823920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:30.823920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:30.823920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:30.823920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:30.823920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:30.823920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:30.823920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:30.823920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:30.823920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:30.823920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:30.823920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:30.823920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:30.823920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:30.823920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:30.823920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:30.823920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:30.824916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:30.824916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:30.824916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:30.824916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:30.824916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:30.824916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:30.824916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:30.824916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:30.824916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:30.824916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:30.824916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:30.824916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:30.824916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 21:02:30.824916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:30.824916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 464/926] 10.222.0.66 () {56 vars in 1126 bytes} [Thu May 26 21:02:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:30.826385 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a45eca-0c35-4cf9-981d-789facb9e48b None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:30.830510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53645ed-da34-4dc6-a5c5-dbfa726af251 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:30.832847 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 463/927] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:30 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:30.838274 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696af9af-9d14-49fa-889f-d290e733dbe9 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:30.838741 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696af9af-9d14-49fa-889f-d290e733dbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:30.839247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696af9af-9d14-49fa-889f-d290e733dbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:30.870113 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-696af9af-9d14-49fa-889f-d290e733dbe9 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:30.872885 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-696af9af-9d14-49fa-889f-d290e733dbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:30.949089 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53645ed-da34-4dc6-a5c5-dbfa726af251 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:30.975161 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 464/928] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:30.990496 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813c690-6ab5-4fc9-8aec-59aae7e2e12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:30.991171 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813c690-6ab5-4fc9-8aec-59aae7e2e12b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:30.991510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813c690-6ab5-4fc9-8aec-59aae7e2e12b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:30.991793 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813c690-6ab5-4fc9-8aec-59aae7e2e12b None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:30.992509 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813c690-6ab5-4fc9-8aec-59aae7e2e12b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:30.992882 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813c690-6ab5-4fc9-8aec-59aae7e2e12b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:30.994247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813c690-6ab5-4fc9-8aec-59aae7e2e12b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:30.998437 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696af9af-9d14-49fa-889f-d290e733dbe9 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:30.999741 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 465/929] 10.222.0.66 () {56 vars in 1122 bytes} [Thu May 26 21:02:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:31.006636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813c690-6ab5-4fc9-8aec-59aae7e2e12b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:31.053665 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:31.111353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:31.122451 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696af9af-9d14-49fa-889f-d290e733dbe9 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:31.140410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813c690-6ab5-4fc9-8aec-59aae7e2e12b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:31.170809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9094f5b-fafb-4893-a9c8-ec43398c9ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:31.172124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9094f5b-fafb-4893-a9c8-ec43398c9ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:31.172868 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9094f5b-fafb-4893-a9c8-ec43398c9ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:31.173704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9094f5b-fafb-4893-a9c8-ec43398c9ef7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:31.181947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9f55b-0bb0-4ad4-b985-3d5ed18be9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:31.183083 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9f55b-0bb0-4ad4-b985-3d5ed18be9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:31.183435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9f55b-0bb0-4ad4-b985-3d5ed18be9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:31.183965 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9f55b-0bb0-4ad4-b985-3d5ed18be9c6 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:31.184681 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9f55b-0bb0-4ad4-b985-3d5ed18be9c6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:31.185060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9f55b-0bb0-4ad4-b985-3d5ed18be9c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:31.186483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9f55b-0bb0-4ad4-b985-3d5ed18be9c6 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:31.187279 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9094f5b-fafb-4893-a9c8-ec43398c9ef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:31.192220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 466/930] 10.222.0.66 () {56 vars in 1122 bytes} [Thu May 26 21:02:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:31.197098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-d9094f5b-fafb-4893-a9c8-ec43398c9ef7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 21:02:31.197098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:31.197098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:31.197098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:31.197098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:31.197098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:31.197098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:31.197098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:31.197098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:31.197098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:31.197098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:31.197098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:31.197098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:31.197098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:31.197098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:31.197098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:31.198048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:31.198048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:31.198048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:31.198048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:31.198048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:31.198048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:31.198048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:31.198048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:31.198048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:31.198048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:31.198048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:31.198048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:31.198048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:31.198048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:31.198048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:31.198048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:31.198936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:31.198936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:31.198936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:31.198936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:31.198936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:31.198936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:31.198936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:31.198936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:31.198936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:31.198936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:31.198936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 21:02:31.198936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:31.199569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9f55b-0bb0-4ad4-b985-3d5ed18be9c6 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:31.201787 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 465/931] 10.222.0.66 () {56 vars in 1120 bytes} [Thu May 26 21:02:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:31.207418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9094f5b-fafb-4893-a9c8-ec43398c9ef7 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:31.314549 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:31.320486 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9f55b-0bb0-4ad4-b985-3d5ed18be9c6 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:31.350725 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9094f5b-fafb-4893-a9c8-ec43398c9ef7 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:31.362490 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90904a03-7d3d-4ee5-bd21-5340f46e4011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:31.363526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90904a03-7d3d-4ee5-bd21-5340f46e4011 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:31.364061 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90904a03-7d3d-4ee5-bd21-5340f46e4011 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:31.364545 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90904a03-7d3d-4ee5-bd21-5340f46e4011 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:31.365565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90904a03-7d3d-4ee5-bd21-5340f46e4011 None admin] RBAC: Adding query filter params (interface=public, service_id=b59d41f2d14a47d4b4555e1ac9cf04c8, region_id=RegionOne) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:31.366164 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90904a03-7d3d-4ee5-bd21-5340f46e4011 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:31.367836 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90904a03-7d3d-4ee5-bd21-5340f46e4011 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:31.374353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 467/932] 10.222.0.66 () {56 vars in 1251 bytes} [Thu May 26 21:02:31 2022] GET /identity/v3/endpoints?service_id=b59d41f2d14a47d4b4555e1ac9cf04c8&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:31.379216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90904a03-7d3d-4ee5-bd21-5340f46e4011 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:31.396733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49892816-801e-413d-bb44-c051a3c52b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:31.397507 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49892816-801e-413d-bb44-c051a3c52b42 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:31.397799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49892816-801e-413d-bb44-c051a3c52b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:31.398082 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49892816-801e-413d-bb44-c051a3c52b42 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:31.398840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49892816-801e-413d-bb44-c051a3c52b42 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:31.399152 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49892816-801e-413d-bb44-c051a3c52b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:31.401147 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49892816-801e-413d-bb44-c051a3c52b42 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:31.412576 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 466/933] 10.222.0.66 () {56 vars in 1115 bytes} [Thu May 26 21:02:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:31.417597 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49892816-801e-413d-bb44-c051a3c52b42 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:31.441844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:31.513755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90904a03-7d3d-4ee5-bd21-5340f46e4011 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:31.546319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49892816-801e-413d-bb44-c051a3c52b42 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:31.549704 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc085f9-fda7-4ee5-8b75-d7af8a7d09b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:31.550376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc085f9-fda7-4ee5-8b75-d7af8a7d09b8 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:31.550719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc085f9-fda7-4ee5-8b75-d7af8a7d09b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:31.551004 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc085f9-fda7-4ee5-8b75-d7af8a7d09b8 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:31.551695 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc085f9-fda7-4ee5-8b75-d7af8a7d09b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:31.556467 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc085f9-fda7-4ee5-8b75-d7af8a7d09b8 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:31.568707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 468/934] 10.222.0.66 () {56 vars in 1087 bytes} [Thu May 26 21:02:31 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:02:31.568707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e615f12-ded6-4c41-aa9b-a1f94c9f305c None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:31.568707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e615f12-ded6-4c41-aa9b-a1f94c9f305c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:31.568707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e615f12-ded6-4c41-aa9b-a1f94c9f305c None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:31.568707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 469/935] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:31.571034 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec8f50-084c-427f-bab4-ea3e73e156d4 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:31.571325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec8f50-084c-427f-bab4-ea3e73e156d4 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:31.571608 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec8f50-084c-427f-bab4-ea3e73e156d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:31.594625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-73ec8f50-084c-427f-bab4-ea3e73e156d4 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:31.596487 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-73ec8f50-084c-427f-bab4-ea3e73e156d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:31.600899 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac346a1-7a69-4053-9dd1-3eba823de0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:31.601860 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac346a1-7a69-4053-9dd1-3eba823de0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:31.602249 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac346a1-7a69-4053-9dd1-3eba823de0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:31.602630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac346a1-7a69-4053-9dd1-3eba823de0b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:31.615357 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac346a1-7a69-4053-9dd1-3eba823de0b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:31.617017 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac346a1-7a69-4053-9dd1-3eba823de0b0 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:31.637551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-5ac346a1-7a69-4053-9dd1-3eba823de0b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:31.637551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:31.637551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:31.637551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:31.637551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:31.637551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:31.637551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:31.637551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:31.637551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:31.637551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:31.637551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:31.637551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:31.637551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:31.637551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:31.637551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:31.638553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:31.638553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:31.638553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:31.638553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:31.638553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:31.638553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:31.638553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:31.638553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:31.638553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:31.638553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:31.638553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:31.638553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:31.638553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:31.638553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:31.638553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:31.638553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:31.638553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:31.639435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:31.639435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:31.639435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:31.639435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:31.639435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 467/936] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:31.640643 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:31.645353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac346a1-7a69-4053-9dd1-3eba823de0b0 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:31.695638 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 470/937] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:31.719005 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec8f50-084c-427f-bab4-ea3e73e156d4 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:31.751269 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:31.776878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac346a1-7a69-4053-9dd1-3eba823de0b0 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:31.817214 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd12c3-c65c-473f-8e14-aacc2aca6304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:31.819334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd12c3-c65c-473f-8e14-aacc2aca6304 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:31.819334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd12c3-c65c-473f-8e14-aacc2aca6304 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:31.819334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd12c3-c65c-473f-8e14-aacc2aca6304 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:31.819334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd12c3-c65c-473f-8e14-aacc2aca6304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:31.819649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd12c3-c65c-473f-8e14-aacc2aca6304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:31.824755 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd12c3-c65c-473f-8e14-aacc2aca6304 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:31.833737 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 468/938] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:31.839210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd12c3-c65c-473f-8e14-aacc2aca6304 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:31.845953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec8f50-084c-427f-bab4-ea3e73e156d4 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:31.884154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3db88-d1e9-4370-b534-e0d903f2efe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:31.885273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3db88-d1e9-4370-b534-e0d903f2efe4 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:31.885777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3db88-d1e9-4370-b534-e0d903f2efe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:31.886838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3db88-d1e9-4370-b534-e0d903f2efe4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:31.887727 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3db88-d1e9-4370-b534-e0d903f2efe4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:31.889372 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3db88-d1e9-4370-b534-e0d903f2efe4 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:31.902401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-57d3db88-d1e9-4370-b534-e0d903f2efe4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 21:02:31.902401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:31.902401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:31.902401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:31.902401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:31.902401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:31.902401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:31.902401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:31.902401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 21:02:31.902401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:31.902401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:31.902401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:31.902401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:31.902401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:31.902401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:31.902401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:31.903402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:31.903402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:31.903402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:31.903402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:31.903402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:31.903402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:31.903402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:31.903402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:31.903402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:31.903402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:31.903402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:31.903402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:31.903402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:31.903402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:31.903402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:31.903402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:31.904259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:31.904259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:31.904259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:31.904259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:31.904259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:31.904259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:31.904259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:31.904259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:31.904259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:31.904259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:31.904259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:31.904259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:31.904259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:31.904259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 21:02:31.904259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:31.907315 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 471/939] 10.222.0.66 () {56 vars in 1132 bytes} [Thu May 26 21:02:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:31.913421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3db88-d1e9-4370-b534-e0d903f2efe4 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:31.941621 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:31.964804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd12c3-c65c-473f-8e14-aacc2aca6304 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:31.999613 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:32.005213 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4b1ad-4b7c-4e1d-8cf0-986a21c3ebdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:32.008639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4b1ad-4b7c-4e1d-8cf0-986a21c3ebdf None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:32.009317 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4b1ad-4b7c-4e1d-8cf0-986a21c3ebdf None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:32.009905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4b1ad-4b7c-4e1d-8cf0-986a21c3ebdf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:32.021863 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4b1ad-4b7c-4e1d-8cf0-986a21c3ebdf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:32.024321 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4b1ad-4b7c-4e1d-8cf0-986a21c3ebdf None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:32.028460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3db88-d1e9-4370-b534-e0d903f2efe4 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:32.044224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-fea4b1ad-4b7c-4e1d-8cf0-986a21c3ebdf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 21:02:32.044224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:32.044224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:32.044224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:32.044224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:32.044224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:32.044224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:32.044224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:32.044224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:32.044224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:32.044224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:32.044224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:32.044224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:02:32.044224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:02:32.044224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:02:32.044224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:02:32.045261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:32.045261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:32.045261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:02:32.045261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:32.045261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:02:32.045261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:32.045261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:32.045261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:32.045261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:32.045261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:32.045261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:32.045261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:32.045261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:32.045261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:32.045261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:32.045261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:32.045261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:32.045261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:32.046210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:32.046210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:32.046210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:02:32.046210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:02:32.046210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:02:32.046210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:02:32.046210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:02:32.046210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:02:32.046210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 21:02:32.046210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:32.053956 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 469/940] 10.222.0.66 () {56 vars in 1117 bytes} [Thu May 26 21:02:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:32.054902 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4b1ad-4b7c-4e1d-8cf0-986a21c3ebdf None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:32.077839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddfde4-2263-4b72-8000-9ad8238fe2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:32.078513 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddfde4-2263-4b72-8000-9ad8238fe2fe None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:32.078834 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddfde4-2263-4b72-8000-9ad8238fe2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:32.079119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddfde4-2263-4b72-8000-9ad8238fe2fe None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:32.079834 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddfde4-2263-4b72-8000-9ad8238fe2fe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:32.080151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddfde4-2263-4b72-8000-9ad8238fe2fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:32.081552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddfde4-2263-4b72-8000-9ad8238fe2fe None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:32.091580 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 472/941] 10.222.0.66 () {56 vars in 1126 bytes} [Thu May 26 21:02:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:32.092659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddfde4-2263-4b72-8000-9ad8238fe2fe None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:32.181788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4b1ad-4b7c-4e1d-8cf0-986a21c3ebdf None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:32.199152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:32.219308 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760b973-c82e-4686-bc47-0831b5582bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:32.220013 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760b973-c82e-4686-bc47-0831b5582bee None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:32.220296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760b973-c82e-4686-bc47-0831b5582bee None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:32.220575 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760b973-c82e-4686-bc47-0831b5582bee None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:32.221193 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddfde4-2263-4b72-8000-9ad8238fe2fe None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:32.221441 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760b973-c82e-4686-bc47-0831b5582bee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:32.221764 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760b973-c82e-4686-bc47-0831b5582bee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:32.223189 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760b973-c82e-4686-bc47-0831b5582bee None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:32.248621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 470/942] 10.222.0.66 () {56 vars in 1149 bytes} [Thu May 26 21:02:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:32.250900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760b973-c82e-4686-bc47-0831b5582bee None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:32.265483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689bb29-26c8-4b8e-90db-d1b0b5c9ffdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:32.266109 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689bb29-26c8-4b8e-90db-d1b0b5c9ffdd None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:32.266395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689bb29-26c8-4b8e-90db-d1b0b5c9ffdd None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:32.266720 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689bb29-26c8-4b8e-90db-d1b0b5c9ffdd None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:32.267444 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689bb29-26c8-4b8e-90db-d1b0b5c9ffdd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:32.267791 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689bb29-26c8-4b8e-90db-d1b0b5c9ffdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:32.269365 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689bb29-26c8-4b8e-90db-d1b0b5c9ffdd None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:32.302830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:32.317280 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 473/943] 10.222.0.66 () {56 vars in 1126 bytes} [Thu May 26 21:02:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:32.318168 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689bb29-26c8-4b8e-90db-d1b0b5c9ffdd None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:32.376735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760b973-c82e-4686-bc47-0831b5582bee None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:32.428965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205470e2-82af-4723-9a3d-8a4b0f6c2d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:32.429776 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205470e2-82af-4723-9a3d-8a4b0f6c2d6e None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:32.430056 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205470e2-82af-4723-9a3d-8a4b0f6c2d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:32.430330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205470e2-82af-4723-9a3d-8a4b0f6c2d6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:32.437688 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689bb29-26c8-4b8e-90db-d1b0b5c9ffdd None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:32.443202 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205470e2-82af-4723-9a3d-8a4b0f6c2d6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:32.444697 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205470e2-82af-4723-9a3d-8a4b0f6c2d6e None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:32.463558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-205470e2-82af-4723-9a3d-8a4b0f6c2d6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:32.463558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:32.463558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:32.463558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:32.463558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:32.463558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:32.463558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:32.463558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:32.463558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:32.463558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:32.463558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:32.463558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:32.463558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:32.463558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:32.463558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:32.464564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:32.464564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:32.464564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:32.464564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:32.464564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:32.464564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:32.464564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:32.464564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:32.464564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:32.464564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:32.464564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:32.464564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:32.464564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:32.464564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:32.464564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:32.464564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:32.464564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:32.465474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:32.465474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:32.465474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:32.465474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:32.469821 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 471/944] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:32.470691 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205470e2-82af-4723-9a3d-8a4b0f6c2d6e None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:32.484755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da98d8f-4b05-4561-bf61-c38c1f2f8704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:32.485982 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da98d8f-4b05-4561-bf61-c38c1f2f8704 None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:32.486939 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da98d8f-4b05-4561-bf61-c38c1f2f8704 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:32.487460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da98d8f-4b05-4561-bf61-c38c1f2f8704 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:32.488636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da98d8f-4b05-4561-bf61-c38c1f2f8704 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:32.490853 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da98d8f-4b05-4561-bf61-c38c1f2f8704 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:32.568289 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 474/945] 10.222.0.66 () {60 vars in 1144 bytes} [Thu May 26 21:02:32 2022] POST /identity/v3/endpoints => generated 347 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:02:32.588227 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:32.593218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205470e2-82af-4723-9a3d-8a4b0f6c2d6e None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:32.643598 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7001f-dae4-4eaa-acd9-785c37ca9701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:32.644728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7001f-dae4-4eaa-acd9-785c37ca9701 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:32.645198 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7001f-dae4-4eaa-acd9-785c37ca9701 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:32.645658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7001f-dae4-4eaa-acd9-785c37ca9701 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:32.646665 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7001f-dae4-4eaa-acd9-785c37ca9701 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:32.647159 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7001f-dae4-4eaa-acd9-785c37ca9701 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:32.648831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7001f-dae4-4eaa-acd9-785c37ca9701 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:32.663097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 472/946] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:32.668784 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da98d8f-4b05-4561-bf61-c38c1f2f8704 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:32.674036 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:32.789139 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da98d8f-4b05-4561-bf61-c38c1f2f8704 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:32.829462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3e4ea-f892-4557-a984-fcb0d881ff43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:32.830531 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3e4ea-f892-4557-a984-fcb0d881ff43 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:32.830816 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3e4ea-f892-4557-a984-fcb0d881ff43 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:32.831092 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3e4ea-f892-4557-a984-fcb0d881ff43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:32.839525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3e4ea-f892-4557-a984-fcb0d881ff43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:32.841025 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3e4ea-f892-4557-a984-fcb0d881ff43 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:32.856543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-f7a3e4ea-f892-4557-a984-fcb0d881ff43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:32.856543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:32.856543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:32.856543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:32.856543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:32.856543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:32.856543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:32.856543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:32.856543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:32.856543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:32.856543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:32.856543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:32.856543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:32.856543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:32.856543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:32.857570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:32.857570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:32.857570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:32.857570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:32.857570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:32.857570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:32.857570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:32.857570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:32.857570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:32.857570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:32.857570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:32.857570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:32.857570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:32.857570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:32.857570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:32.857570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:32.857570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:32.858432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:32.858432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:32.858432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:32.858432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:32.858432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:32.858432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:32.858432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:32.858432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:32.858432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 475/947] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:32.865492 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7001f-dae4-4eaa-acd9-785c37ca9701 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:32.981383 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7001f-dae4-4eaa-acd9-785c37ca9701 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:33.017341 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a95b0e-b7df-45f0-82ea-bb5797272133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:33.018014 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a95b0e-b7df-45f0-82ea-bb5797272133 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:33.018296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a95b0e-b7df-45f0-82ea-bb5797272133 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:33.018577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a95b0e-b7df-45f0-82ea-bb5797272133 None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:33.019433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a95b0e-b7df-45f0-82ea-bb5797272133 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:33.019744 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a95b0e-b7df-45f0-82ea-bb5797272133 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:33.021319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a95b0e-b7df-45f0-82ea-bb5797272133 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:33.034392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 473/948] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:02:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:33.040229 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3e4ea-f892-4557-a984-fcb0d881ff43 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:33.106383 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:33.122521 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbd7dd-e661-40a1-b9ac-4db4bc9a945f None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:33.122859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbd7dd-e661-40a1-b9ac-4db4bc9a945f None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:33.123085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbd7dd-e661-40a1-b9ac-4db4bc9a945f None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:33.124745 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 474/949] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:33.130098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c6192-2daf-4c39-9a33-c140a8185383 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:33.137598 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c6192-2daf-4c39-9a33-c140a8185383 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:33.137598 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c6192-2daf-4c39-9a33-c140a8185383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:33.147844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-ba6c6192-2daf-4c39-9a33-c140a8185383 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:33.149191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ba6c6192-2daf-4c39-9a33-c140a8185383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:33.150441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3e4ea-f892-4557-a984-fcb0d881ff43 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:33.160962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:33.191707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155a00-b8f0-4964-baf9-4906d7e3d265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:33.192798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155a00-b8f0-4964-baf9-4906d7e3d265 None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:33.193084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155a00-b8f0-4964-baf9-4906d7e3d265 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:33.193359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155a00-b8f0-4964-baf9-4906d7e3d265 None admin] PATH_INFO: `/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/5890e1e70ffd4e33a812691e9c43b6d2/roles/1a67a38c7559419081284aa53b1fdfaa` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:33.196499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11155a00-b8f0-4964-baf9-4906d7e3d265 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3db24bf0708446e9b05197fafeb00e4, user_id=5890e1e70ffd4e33a812691e9c43b6d2, role_id=1a67a38c7559419081284aa53b1fdfaa)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:33.198002 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11155a00-b8f0-4964-baf9-4906d7e3d265 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:33.235206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 475/950] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:33.262305 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c6192-2daf-4c39-9a33-c140a8185383 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:33.267888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 476/951] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:02:33 2022] PUT /identity/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/5890e1e70ffd4e33a812691e9c43b6d2/roles/1a67a38c7559419081284aa53b1fdfaa => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:02:33.385855 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c6192-2daf-4c39-9a33-c140a8185383 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:33.426433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107d0e9-e35c-447d-9aca-528013ca9357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:33.427375 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107d0e9-e35c-447d-9aca-528013ca9357 None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:33.427806 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107d0e9-e35c-447d-9aca-528013ca9357 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:33.428226 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107d0e9-e35c-447d-9aca-528013ca9357 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:33.429237 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107d0e9-e35c-447d-9aca-528013ca9357 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:33.431015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107d0e9-e35c-447d-9aca-528013ca9357 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:33.433014 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: WARNING keystone.server.flask.common [None req-f107d0e9-e35c-447d-9aca-528013ca9357 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 21:02:33.470712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.sql.core [None req-f107d0e9-e35c-447d-9aca-528013ca9357 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 21:02:33.470712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 21:02:33.470712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [parameters: {'user_id': '41b301f338fe439a81b70271b25bd18f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 21:02:33.470712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80748) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 21:02:33.489746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-f107d0e9-e35c-447d-9aca-528013ca9357 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 21:02:33.489746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:33.489746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 21:02:33.489746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 21:02:33.489746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 21:02:33.489746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 21:02:33.489746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 21:02:33.489746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application result = self._query(query) May 26 21:02:33.489746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 21:02:33.489746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application conn.query(q) May 26 21:02:33.489746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 21:02:33.489746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 21:02:33.489746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 21:02:33.489746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application result.read() May 26 21:02:33.489746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 21:02:33.490854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 21:02:33.490854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 21:02:33.490854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 21:02:33.490854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 21:02:33.490854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 21:02:33.490854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 21:02:33.490854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 21:02:33.490854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 21:02:33.490854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:33.490854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 21:02:33.490854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:33.490854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:33.490854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 21:02:33.490854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 21:02:33.490854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 21:02:33.490854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 21:02:33.490854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 21:02:33.490854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application next(self.gen) May 26 21:02:33.492115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 21:02:33.492115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application yield resource May 26 21:02:33.492115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 21:02:33.492115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application next(self.gen) May 26 21:02:33.492115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 21:02:33.492115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self.session.rollback() May 26 21:02:33.492115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 21:02:33.492115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self.force_reraise() May 26 21:02:33.492115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 21:02:33.492115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise self.value May 26 21:02:33.492115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 21:02:33.492115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 21:02:33.492115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 21:02:33.492115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application session.commit() May 26 21:02:33.492115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 21:02:33.492115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 21:02:33.492115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 21:02:33.493205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._prepare_impl() May 26 21:02:33.493205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 21:02:33.493205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self.session.flush() May 26 21:02:33.493205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 21:02:33.493205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._flush(objects) May 26 21:02:33.493205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 21:02:33.493205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 21:02:33.493205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 21:02:33.493205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application compat.raise_( May 26 21:02:33.493205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 21:02:33.493205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception May 26 21:02:33.493205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 21:02:33.493205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application flush_context.execute() May 26 21:02:33.493205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 21:02:33.493205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rec.execute(self) May 26 21:02:33.493205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 21:02:33.493205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 21:02:33.494148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 21:02:33.494148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 21:02:33.494148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 21:02:33.494148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 21:02:33.494148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 21:02:33.494148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 21:02:33.494148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 21:02:33.494148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 21:02:33.494148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 21:02:33.494148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 21:02:33.494148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 21:02:33.494148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 21:02:33.494148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 21:02:33.494148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 21:02:33.494148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 21:02:33.494148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception May 26 21:02:33.495105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 21:02:33.495105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 21:02:33.495105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 21:02:33.495105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 21:02:33.495105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 21:02:33.495105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application result = self._query(query) May 26 21:02:33.495105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 21:02:33.495105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application conn.query(q) May 26 21:02:33.495105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 21:02:33.495105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 21:02:33.495105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 21:02:33.495105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application result.read() May 26 21:02:33.495105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 21:02:33.495105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 21:02:33.495105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 21:02:33.495105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 21:02:33.496075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 21:02:33.496075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 21:02:33.496075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 21:02:33.496075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 21:02:33.496075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 21:02:33.496075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 21:02:33.496075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [parameters: {'user_id': '41b301f338fe439a81b70271b25bd18f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 21:02:33.496075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 21:02:33.496075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:33.496075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:33.496075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:33.496075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:33.496075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:33.496075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:33.496075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:33.497050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:33.497050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:33.497050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:33.497050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:33.497050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:33.497050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:33.497050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:33.497050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 21:02:33.497050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 21:02:33.497050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:33.497050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:33.497050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:02:33.497050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:33.497050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:02:33.497050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:33.497050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 21:02:33.497050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 21:02:33.498414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 21:02:33.498414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 21:02:33.498414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 21:02:33.498414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 21:02:33.498414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 21:02:33.498414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:33.503090 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 476/952] 10.222.0.66 () {60 vars in 1131 bytes} [Thu May 26 21:02:33 2022] POST /identity/v3/users => generated 160 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:33.505623 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155a00-b8f0-4964-baf9-4906d7e3d265 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:33.619811 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155a00-b8f0-4964-baf9-4906d7e3d265 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:33.645776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:33.658608 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76766663-12f6-4821-8a3c-962a45b8ebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:33.659447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766663-12f6-4821-8a3c-962a45b8ebab None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:33.659731 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766663-12f6-4821-8a3c-962a45b8ebab None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:33.660003 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766663-12f6-4821-8a3c-962a45b8ebab None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:33.670455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76766663-12f6-4821-8a3c-962a45b8ebab None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:33.670455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76766663-12f6-4821-8a3c-962a45b8ebab None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:33.687250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-76766663-12f6-4821-8a3c-962a45b8ebab None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 21:02:33.687250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:33.687250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:33.687250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:33.687250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:33.687250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:33.687250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:33.687250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:33.687250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:33.687250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:33.687250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:33.687250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:33.687250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:02:33.687250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:02:33.687250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:02:33.687250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:02:33.688266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:33.688266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:33.688266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:02:33.688266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:33.688266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:02:33.688266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:33.688266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:33.688266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:33.688266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:33.688266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:33.688266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:33.688266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:33.688266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:33.688266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:33.688266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:33.688266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:33.688266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:33.688266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:33.689282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:33.689282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:33.689282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:02:33.689282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:02:33.689282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:02:33.689282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:02:33.689282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:02:33.689282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:02:33.689282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 21:02:33.689282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:33.689282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 477/953] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:02:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:33.695018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107d0e9-e35c-447d-9aca-528013ca9357 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:33.707440 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:33.805370 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107d0e9-e35c-447d-9aca-528013ca9357 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:33.841863 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2eb5e-94de-4be1-8936-8c94d4e0ed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:33.842903 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2eb5e-94de-4be1-8936-8c94d4e0ed58 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:33.843409 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2eb5e-94de-4be1-8936-8c94d4e0ed58 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:33.843883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2eb5e-94de-4be1-8936-8c94d4e0ed58 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:33.844929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2eb5e-94de-4be1-8936-8c94d4e0ed58 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:33.845436 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2eb5e-94de-4be1-8936-8c94d4e0ed58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:33.847247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2eb5e-94de-4be1-8936-8c94d4e0ed58 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:33.853186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca76762-fc40-44a6-87fd-c34b1f928322 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:33.853470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca76762-fc40-44a6-87fd-c34b1f928322 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:33.853746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca76762-fc40-44a6-87fd-c34b1f928322 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:33.856451 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 478/954] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:33.860497 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ffab7-c30d-4f45-bd4b-b846e5fe6dea None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:33.860810 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ffab7-c30d-4f45-bd4b-b846e5fe6dea None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:33.861090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ffab7-c30d-4f45-bd4b-b846e5fe6dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:33.879160 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-8b7ffab7-c30d-4f45-bd4b-b846e5fe6dea None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:33.880354 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8b7ffab7-c30d-4f45-bd4b-b846e5fe6dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:33.892281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 477/955] 10.222.0.66 () {56 vars in 1101 bytes} [Thu May 26 21:02:33 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:33.958342 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 479/956] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:33.981630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2eb5e-94de-4be1-8936-8c94d4e0ed58 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:34.052434 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:34.095731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2eb5e-94de-4be1-8936-8c94d4e0ed58 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:34.131745 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34336a1-2eb0-4d1a-b89b-c3e8917b8ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:34.132553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34336a1-2eb0-4d1a-b89b-c3e8917b8ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:34.132862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34336a1-2eb0-4d1a-b89b-c3e8917b8ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:34.133181 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34336a1-2eb0-4d1a-b89b-c3e8917b8ed4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:34.133906 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34336a1-2eb0-4d1a-b89b-c3e8917b8ed4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:34.135267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34336a1-2eb0-4d1a-b89b-c3e8917b8ed4 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:34.148435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-b34336a1-2eb0-4d1a-b89b-c3e8917b8ed4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 21:02:34.148435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:34.148435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:34.148435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:34.148435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:34.148435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:34.148435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:34.148435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:34.148435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 21:02:34.148435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:34.148435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:34.148435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:34.148435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:34.148435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:34.148435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:34.148435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:34.148435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:34.149617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:34.149617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:34.149617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:34.149617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:34.149617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:34.149617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:34.149617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:34.149617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:34.149617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:34.149617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:34.149617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:34.149617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:34.149617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:34.149617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:34.149617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:34.149617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:34.150651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:34.150651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:34.150651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:34.150651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:34.150651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:34.150651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:34.150651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:34.150651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:34.150651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:34.150651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:34.150651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:34.150651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:34.150651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 21:02:34.150651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:34.150651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 478/957] 10.222.0.66 () {56 vars in 1126 bytes} [Thu May 26 21:02:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:34.158513 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ffab7-c30d-4f45-bd4b-b846e5fe6dea None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:34.262443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ffab7-c30d-4f45-bd4b-b846e5fe6dea None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:34.284485 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:34.305984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051f2bc-2b09-4d94-b785-56b71c3cdc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:34.306655 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051f2bc-2b09-4d94-b785-56b71c3cdc9f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:34.306935 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051f2bc-2b09-4d94-b785-56b71c3cdc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:34.307207 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051f2bc-2b09-4d94-b785-56b71c3cdc9f None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:34.308745 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051f2bc-2b09-4d94-b785-56b71c3cdc9f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:34.309052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051f2bc-2b09-4d94-b785-56b71c3cdc9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:34.310404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051f2bc-2b09-4d94-b785-56b71c3cdc9f None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:34.319618 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 480/958] 10.222.0.66 () {56 vars in 1122 bytes} [Thu May 26 21:02:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:34.321021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34336a1-2eb0-4d1a-b89b-c3e8917b8ed4 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:34.425896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34336a1-2eb0-4d1a-b89b-c3e8917b8ed4 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:34.454612 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:34.462689 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d40c17-cf71-43eb-afd8-f4134a5b33a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:34.463352 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d40c17-cf71-43eb-afd8-f4134a5b33a1 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:34.463628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d40c17-cf71-43eb-afd8-f4134a5b33a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:34.465799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d40c17-cf71-43eb-afd8-f4134a5b33a1 None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:34.465799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d40c17-cf71-43eb-afd8-f4134a5b33a1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:34.465799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d40c17-cf71-43eb-afd8-f4134a5b33a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:34.466301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d40c17-cf71-43eb-afd8-f4134a5b33a1 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:34.471482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 479/959] 10.222.0.66 () {56 vars in 1122 bytes} [Thu May 26 21:02:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:34.476842 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051f2bc-2b09-4d94-b785-56b71c3cdc9f None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:34.588025 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051f2bc-2b09-4d94-b785-56b71c3cdc9f None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:34.623084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945086f-f0c6-49c8-80bb-aed7e3068d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:34.623746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945086f-f0c6-49c8-80bb-aed7e3068d0c None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:34.624027 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945086f-f0c6-49c8-80bb-aed7e3068d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:34.624300 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945086f-f0c6-49c8-80bb-aed7e3068d0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:34.625084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945086f-f0c6-49c8-80bb-aed7e3068d0c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:34.626528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945086f-f0c6-49c8-80bb-aed7e3068d0c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:34.729097 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 481/960] 10.222.0.66 () {60 vars in 1144 bytes} [Thu May 26 21:02:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:02:35.000156 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a355b-5427-464d-b5f6-617ad6e0f9c1 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:35.000497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a355b-5427-464d-b5f6-617ad6e0f9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:35.000811 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a355b-5427-464d-b5f6-617ad6e0f9c1 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:35.002336 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 480/961] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:35.007473 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e38a7f-b0b1-4936-99a5-98cec71cb65d None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:35.007760 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e38a7f-b0b1-4936-99a5-98cec71cb65d None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:35.008039 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e38a7f-b0b1-4936-99a5-98cec71cb65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:35.024745 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-b4e38a7f-b0b1-4936-99a5-98cec71cb65d None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:35.025930 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-b4e38a7f-b0b1-4936-99a5-98cec71cb65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:35.053676 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:35.101164 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 482/962] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:35.123531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a355b-5427-464d-b5f6-617ad6e0f9c1 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:35.235365 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a355b-5427-464d-b5f6-617ad6e0f9c1 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:35.275656 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656ec77-2e7e-4c08-ac04-b49629c0b3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:35.277400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656ec77-2e7e-4c08-ac04-b49629c0b3db None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:35.277897 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656ec77-2e7e-4c08-ac04-b49629c0b3db None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:35.278403 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656ec77-2e7e-4c08-ac04-b49629c0b3db None admin] PATH_INFO: `/v3/services/compute` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:35.279407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656ec77-2e7e-4c08-ac04-b49629c0b3db None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:35.281072 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656ec77-2e7e-4c08-ac04-b49629c0b3db None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:35.294940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-7656ec77-2e7e-4c08-ac04-b49629c0b3db None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 21:02:35.294940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:35.294940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:35.294940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:35.294940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:35.294940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:35.294940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:35.294940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:35.294940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 21:02:35.294940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:35.294940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:35.294940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:35.294940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:35.294940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:35.294940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:35.294940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:35.294940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:35.296061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:35.296061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:35.296061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:35.296061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:35.296061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:35.296061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:35.296061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:35.296061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:35.296061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:35.296061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:35.296061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:35.296061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:35.296061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:35.296061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:35.296061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:35.296061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:35.296927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:35.296927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:35.296927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:35.296927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:35.296927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:35.296927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:35.296927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:35.296927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:35.296927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:35.296927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:35.296927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:35.296927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:35.296927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 21:02:35.296927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:35.299389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 481/963] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:35.307699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e38a7f-b0b1-4936-99a5-98cec71cb65d None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:35.432211 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e38a7f-b0b1-4936-99a5-98cec71cb65d None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:35.467717 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7ee95-c5d6-4ece-be6b-3148588d5eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:35.468386 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7ee95-c5d6-4ece-be6b-3148588d5eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:35.468743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7ee95-c5d6-4ece-be6b-3148588d5eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:35.468982 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7ee95-c5d6-4ece-be6b-3148588d5eb4 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:35.469693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7ee95-c5d6-4ece-be6b-3148588d5eb4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:35.470004 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7ee95-c5d6-4ece-be6b-3148588d5eb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:35.471378 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7ee95-c5d6-4ece-be6b-3148588d5eb4 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:35.476447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 483/964] 10.222.0.66 () {56 vars in 1112 bytes} [Thu May 26 21:02:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:35.482030 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656ec77-2e7e-4c08-ac04-b49629c0b3db None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:35.540801 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:35.550839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f403e2f-a0a4-489b-8bfa-377ef5273145 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:35.551137 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f403e2f-a0a4-489b-8bfa-377ef5273145 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:35.551412 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f403e2f-a0a4-489b-8bfa-377ef5273145 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:35.553216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 484/965] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:35.560951 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf4eab-c494-41bd-9592-82dfd6bc8484 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:35.561239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf4eab-c494-41bd-9592-82dfd6bc8484 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:35.561524 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf4eab-c494-41bd-9592-82dfd6bc8484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:35.579806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-b5bf4eab-c494-41bd-9592-82dfd6bc8484 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:35.581032 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-b5bf4eab-c494-41bd-9592-82dfd6bc8484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:35.590839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656ec77-2e7e-4c08-ac04-b49629c0b3db None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:35.598933 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:35.626521 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af804d74-c5fb-4773-90b8-4124c9d69f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:35.627199 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af804d74-c5fb-4773-90b8-4124c9d69f5d None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:35.627478 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af804d74-c5fb-4773-90b8-4124c9d69f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:35.627756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af804d74-c5fb-4773-90b8-4124c9d69f5d None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:35.628465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af804d74-c5fb-4773-90b8-4124c9d69f5d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:35.628797 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af804d74-c5fb-4773-90b8-4124c9d69f5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:35.630189 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af804d74-c5fb-4773-90b8-4124c9d69f5d None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:35.634944 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 482/966] 10.222.0.66 () {56 vars in 1112 bytes} [Thu May 26 21:02:35 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:35.652543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 485/967] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:35.675969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af804d74-c5fb-4773-90b8-4124c9d69f5d None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:35.787545 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af804d74-c5fb-4773-90b8-4124c9d69f5d None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:35.810737 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:35.832250 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e166435-ec65-4384-a38a-2ccce1560743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:35.833213 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e166435-ec65-4384-a38a-2ccce1560743 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:35.833505 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e166435-ec65-4384-a38a-2ccce1560743 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:35.833785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e166435-ec65-4384-a38a-2ccce1560743 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:35.844742 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e166435-ec65-4384-a38a-2ccce1560743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:35.852984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-4e166435-ec65-4384-a38a-2ccce1560743 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 21:02:35.852984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:35.852984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:35.852984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:35.852984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:35.852984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:35.852984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:35.852984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:35.852984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:35.852984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:35.852984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:35.852984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:35.852984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:35.852984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:35.852984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:35.852984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:35.853987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:35.853987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:35.853987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:35.853987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:35.853987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:35.853987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:35.853987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:35.853987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:35.853987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:35.853987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:35.853987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:35.853987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:35.853987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:35.853987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:35.853987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:35.853987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:35.855400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:35.855400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:35.855400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:35.855400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:35.855400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:35.855400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:35.855400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:35.855400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:35.855400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:35.855400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:35.855400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 21:02:35.855400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:35.855400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 483/968] 10.222.0.66 () {56 vars in 1120 bytes} [Thu May 26 21:02:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:35.861167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf4eab-c494-41bd-9592-82dfd6bc8484 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:35.960767 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf4eab-c494-41bd-9592-82dfd6bc8484 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:35.994905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8d327-b26f-44f2-b6c5-3c63360c9503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:35.996148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8d327-b26f-44f2-b6c5-3c63360c9503 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:35.996431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8d327-b26f-44f2-b6c5-3c63360c9503 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:35.996740 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8d327-b26f-44f2-b6c5-3c63360c9503 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:35.997489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8d327-b26f-44f2-b6c5-3c63360c9503 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:35.997798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8d327-b26f-44f2-b6c5-3c63360c9503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:35.999169 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8d327-b26f-44f2-b6c5-3c63360c9503 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:36.011874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 486/969] 10.222.0.66 () {56 vars in 1115 bytes} [Thu May 26 21:02:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:36.013071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e166435-ec65-4384-a38a-2ccce1560743 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:36.114149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e166435-ec65-4384-a38a-2ccce1560743 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:36.148502 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb2620-a616-4225-8358-f126b025df30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:36.149322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb2620-a616-4225-8358-f126b025df30 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:36.149606 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb2620-a616-4225-8358-f126b025df30 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:36.149884 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb2620-a616-4225-8358-f126b025df30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:36.160628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb2620-a616-4225-8358-f126b025df30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:36.162092 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb2620-a616-4225-8358-f126b025df30 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:36.179460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-a1bb2620-a616-4225-8358-f126b025df30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:36.179460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:36.179460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:36.179460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:36.179460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:36.179460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:36.179460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:36.179460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:36.179460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:36.179460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:36.179460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:36.179460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:36.179460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:36.179460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:36.179460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:36.180358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:36.180358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:36.180358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:36.180358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:36.180358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:36.180358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:36.180358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:36.180358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:36.180358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:36.180358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:36.180358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:36.180358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:36.180358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:36.180358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:36.180358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:36.180358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:36.180358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:36.181301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:36.181301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:36.181301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:36.181301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:36.184933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 484/970] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:36.187070 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8d327-b26f-44f2-b6c5-3c63360c9503 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:36.206838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:36.287533 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8d327-b26f-44f2-b6c5-3c63360c9503 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:36.322803 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9ddd6-9bb3-4629-b1f8-5f472ce58b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:36.323599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9ddd6-9bb3-4629-b1f8-5f472ce58b2c None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:36.323769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9ddd6-9bb3-4629-b1f8-5f472ce58b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:36.324046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9ddd6-9bb3-4629-b1f8-5f472ce58b2c None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:36.324795 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9ddd6-9bb3-4629-b1f8-5f472ce58b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:36.325104 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9ddd6-9bb3-4629-b1f8-5f472ce58b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:36.326509 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9ddd6-9bb3-4629-b1f8-5f472ce58b2c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:36.338051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 487/971] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:36.343883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb2620-a616-4225-8358-f126b025df30 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:36.376487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:36.445569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb2620-a616-4225-8358-f126b025df30 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:36.479169 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667eefb-8fa5-4d59-9a51-b6acf31af0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:36.480528 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667eefb-8fa5-4d59-9a51-b6acf31af0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:36.480833 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667eefb-8fa5-4d59-9a51-b6acf31af0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:36.481109 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667eefb-8fa5-4d59-9a51-b6acf31af0a3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:36.488264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667eefb-8fa5-4d59-9a51-b6acf31af0a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:36.489769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667eefb-8fa5-4d59-9a51-b6acf31af0a3 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:36.504423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-f667eefb-8fa5-4d59-9a51-b6acf31af0a3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 21:02:36.504423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:36.504423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:36.504423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:36.504423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:36.504423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:36.504423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:36.504423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:36.504423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:36.504423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:36.504423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:36.504423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:36.504423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:02:36.504423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:02:36.504423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:02:36.504423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:02:36.505453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:36.505453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:36.505453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:02:36.505453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:36.505453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:02:36.505453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:36.505453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:36.505453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:36.505453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:36.505453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:36.505453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:36.505453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:36.505453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:36.505453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:36.505453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:36.505453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:36.505453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:36.505453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:36.506473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:36.506473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:36.506473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:02:36.506473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:02:36.506473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:02:36.506473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:02:36.506473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:02:36.506473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:02:36.506473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 21:02:36.506473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:36.508956 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 485/972] 10.222.0.66 () {56 vars in 1117 bytes} [Thu May 26 21:02:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:36.511322 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9ddd6-9bb3-4629-b1f8-5f472ce58b2c None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:36.598550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:36.621061 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9ddd6-9bb3-4629-b1f8-5f472ce58b2c None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:36.656367 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee1180-b65d-4bf2-8134-6506e68d3834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:36.657009 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee1180-b65d-4bf2-8134-6506e68d3834 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:36.657295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee1180-b65d-4bf2-8134-6506e68d3834 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:36.657571 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee1180-b65d-4bf2-8134-6506e68d3834 None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:36.658415 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee1180-b65d-4bf2-8134-6506e68d3834 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:36.658726 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee1180-b65d-4bf2-8134-6506e68d3834 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:36.660153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee1180-b65d-4bf2-8134-6506e68d3834 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:36.682590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 488/973] 10.222.0.66 () {56 vars in 1149 bytes} [Thu May 26 21:02:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:36.683671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667eefb-8fa5-4d59-9a51-b6acf31af0a3 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:36.780609 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:36.791043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667eefb-8fa5-4d59-9a51-b6acf31af0a3 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:36.826129 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a92029-c7b3-4a2f-903b-ccaf7698bb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:36.826785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a92029-c7b3-4a2f-903b-ccaf7698bb70 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:36.827069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a92029-c7b3-4a2f-903b-ccaf7698bb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:36.827346 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a92029-c7b3-4a2f-903b-ccaf7698bb70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:36.894299 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a92029-c7b3-4a2f-903b-ccaf7698bb70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:36.895742 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a92029-c7b3-4a2f-903b-ccaf7698bb70 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:36.950272 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8e047-a534-41a1-b82f-64971755a853 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:36.950464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8e047-a534-41a1-b82f-64971755a853 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:36.950741 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8e047-a534-41a1-b82f-64971755a853 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:36.952105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 489/974] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:36.957011 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c253b48-40fa-49b8-899b-89f25c8082c3 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:36.957491 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c253b48-40fa-49b8-899b-89f25c8082c3 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:36.957974 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c253b48-40fa-49b8-899b-89f25c8082c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:36.974585 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-8c253b48-40fa-49b8-899b-89f25c8082c3 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:36.975759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8c253b48-40fa-49b8-899b-89f25c8082c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:36.986930 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:36.997150 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 486/975] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:02:36 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:02:37.002594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a92029-c7b3-4a2f-903b-ccaf7698bb70 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:37.058579 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 490/976] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:37.080917 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c253b48-40fa-49b8-899b-89f25c8082c3 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:37.101474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a92029-c7b3-4a2f-903b-ccaf7698bb70 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:37.138091 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ee5f9-1da4-42bd-8f59-9bdd61ce4427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:37.138881 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ee5f9-1da4-42bd-8f59-9bdd61ce4427 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:37.139161 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ee5f9-1da4-42bd-8f59-9bdd61ce4427 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:37.139432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ee5f9-1da4-42bd-8f59-9bdd61ce4427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:37.149881 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:37.151146 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ee5f9-1da4-42bd-8f59-9bdd61ce4427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:37.152651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ee5f9-1da4-42bd-8f59-9bdd61ce4427 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:37.170692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-321ee5f9-1da4-42bd-8f59-9bdd61ce4427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:37.170692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:37.170692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:37.170692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:37.170692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:37.170692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:37.170692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:37.170692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:37.170692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:37.170692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:37.170692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:37.170692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:37.170692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:37.170692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:37.170692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:37.171615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:37.171615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:37.171615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:37.171615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:37.171615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:37.171615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:37.171615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:37.171615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:37.171615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:37.171615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:37.171615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:37.171615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:37.171615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:37.171615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:37.171615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:37.171615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:37.171615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:37.172503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:37.172503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:37.172503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:37.172503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:37.172503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 487/977] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:37.177344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ee5f9-1da4-42bd-8f59-9bdd61ce4427 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:37.189918 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c253b48-40fa-49b8-899b-89f25c8082c3 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:37.226813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:37.228140 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b08cd-67e9-478b-a97a-860001725da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:37.228982 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b08cd-67e9-478b-a97a-860001725da2 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:37.229326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b08cd-67e9-478b-a97a-860001725da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:37.229736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b08cd-67e9-478b-a97a-860001725da2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:37.230367 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b08cd-67e9-478b-a97a-860001725da2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:37.231728 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b08cd-67e9-478b-a97a-860001725da2 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:37.244359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-783b08cd-67e9-478b-a97a-860001725da2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 21:02:37.244359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:37.244359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:37.244359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:37.244359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:37.244359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:37.244359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:37.244359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:37.244359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 21:02:37.244359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:37.244359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:37.244359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:37.244359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:37.244359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:37.244359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:37.244359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:37.244359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:37.246542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:37.246542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:37.246542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:37.246542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:37.246542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:37.246542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:37.246542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:37.246542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:37.246542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:37.246542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:37.246542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:37.246542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:37.246542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:37.246542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:37.246542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:37.246542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:37.247552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:37.247552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:37.247552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:37.247552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:37.247552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:37.247552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:37.247552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:37.247552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:37.247552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:37.247552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:37.247552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:37.247552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:37.247552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 21:02:37.247552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:37.251354 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 491/978] 10.222.0.66 () {56 vars in 1126 bytes} [Thu May 26 21:02:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:37.252193 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b08cd-67e9-478b-a97a-860001725da2 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:37.392094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ee5f9-1da4-42bd-8f59-9bdd61ce4427 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:37.426733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60f85b-8b83-4e95-add8-ad1eff2c6e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:37.427390 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60f85b-8b83-4e95-add8-ad1eff2c6e09 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:37.427667 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60f85b-8b83-4e95-add8-ad1eff2c6e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:37.427937 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60f85b-8b83-4e95-add8-ad1eff2c6e09 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:37.428674 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60f85b-8b83-4e95-add8-ad1eff2c6e09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:37.428974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60f85b-8b83-4e95-add8-ad1eff2c6e09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:37.430336 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60f85b-8b83-4e95-add8-ad1eff2c6e09 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:37.444626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 488/979] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:37.447728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60f85b-8b83-4e95-add8-ad1eff2c6e09 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:37.466892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b08cd-67e9-478b-a97a-860001725da2 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:37.496123 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:37.504482 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab070a2-c1e5-4903-b8c3-f778f9303794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:37.505175 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab070a2-c1e5-4903-b8c3-f778f9303794 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:37.505456 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab070a2-c1e5-4903-b8c3-f778f9303794 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:37.505731 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab070a2-c1e5-4903-b8c3-f778f9303794 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:37.506425 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab070a2-c1e5-4903-b8c3-f778f9303794 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:37.506728 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab070a2-c1e5-4903-b8c3-f778f9303794 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:37.508083 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab070a2-c1e5-4903-b8c3-f778f9303794 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:37.514410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 492/980] 10.222.0.66 () {56 vars in 1122 bytes} [Thu May 26 21:02:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:37.519838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab070a2-c1e5-4903-b8c3-f778f9303794 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:37.549571 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60f85b-8b83-4e95-add8-ad1eff2c6e09 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:37.552335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:37.594808 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b6a2e-09f1-49aa-8f36-776c22b5540b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:37.595608 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b6a2e-09f1-49aa-8f36-776c22b5540b None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:37.595948 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b6a2e-09f1-49aa-8f36-776c22b5540b None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:37.596229 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b6a2e-09f1-49aa-8f36-776c22b5540b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:37.603551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b6a2e-09f1-49aa-8f36-776c22b5540b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:37.605573 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b6a2e-09f1-49aa-8f36-776c22b5540b None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:37.619379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-4a1b6a2e-09f1-49aa-8f36-776c22b5540b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:37.619379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:37.619379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:37.619379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:37.619379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:37.619379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:37.619379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:37.619379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:37.619379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:37.619379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:37.619379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:37.619379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:37.619379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:37.619379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:37.619379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:37.620925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:37.620925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:37.620925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:37.620925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:37.620925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:37.620925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:37.620925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:37.620925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:37.620925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:37.620925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:37.620925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:37.620925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:37.620925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:37.620925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:37.620925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:37.620925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:37.620925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:37.621844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:37.621844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:37.621844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:37.621844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:37.621844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:37.621844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:37.621844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:37.621844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:37.626289 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 489/981] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:37.626694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b6a2e-09f1-49aa-8f36-776c22b5540b None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:37.636417 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab070a2-c1e5-4903-b8c3-f778f9303794 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:37.677528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5badab-f88e-4643-b068-e1de44a449ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:37.678203 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5badab-f88e-4643-b068-e1de44a449ce None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:37.678484 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5badab-f88e-4643-b068-e1de44a449ce None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:37.678760 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5badab-f88e-4643-b068-e1de44a449ce None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:37.679476 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5badab-f88e-4643-b068-e1de44a449ce None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:37.679786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5badab-f88e-4643-b068-e1de44a449ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:37.681444 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5badab-f88e-4643-b068-e1de44a449ce None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:37.687798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 493/982] 10.222.0.66 () {56 vars in 1122 bytes} [Thu May 26 21:02:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:37.693123 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5badab-f88e-4643-b068-e1de44a449ce None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:37.737318 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b6a2e-09f1-49aa-8f36-776c22b5540b None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:37.752549 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:37.770952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e48d83-f3c0-42af-b86e-e024fdea13e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:37.771630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e48d83-f3c0-42af-b86e-e024fdea13e7 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:37.771910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e48d83-f3c0-42af-b86e-e024fdea13e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:37.772288 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e48d83-f3c0-42af-b86e-e024fdea13e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:37.773105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e48d83-f3c0-42af-b86e-e024fdea13e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:37.773418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e48d83-f3c0-42af-b86e-e024fdea13e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:37.774842 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e48d83-f3c0-42af-b86e-e024fdea13e7 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:37.789049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 490/983] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:02:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:37.796202 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e48d83-f3c0-42af-b86e-e024fdea13e7 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:37.799605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5badab-f88e-4643-b068-e1de44a449ce None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:37.822039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:37.834334 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe288e-ac88-4fa2-9a36-528450141e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:37.835029 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe288e-ac88-4fa2-9a36-528450141e1a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:37.835312 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe288e-ac88-4fa2-9a36-528450141e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:37.835590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe288e-ac88-4fa2-9a36-528450141e1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:37.836498 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe288e-ac88-4fa2-9a36-528450141e1a None admin] RBAC: Adding query filter params (interface=admin, service_id=b59d41f2d14a47d4b4555e1ac9cf04c8, region_id=RegionOne) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:37.836846 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe288e-ac88-4fa2-9a36-528450141e1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:37.838225 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe288e-ac88-4fa2-9a36-528450141e1a None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:37.848798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 494/984] 10.222.0.66 () {56 vars in 1249 bytes} [Thu May 26 21:02:37 2022] GET /identity/v3/endpoints?service_id=b59d41f2d14a47d4b4555e1ac9cf04c8&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:37.848798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d09a87-4268-45ca-8715-9b013fa6fd4a None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:37.848798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d09a87-4268-45ca-8715-9b013fa6fd4a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:37.848798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d09a87-4268-45ca-8715-9b013fa6fd4a None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:37.848798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 495/985] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:37.851940 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d09a87-4268-45ca-8715-9b013fa6fd4a None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:37.898082 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e48d83-f3c0-42af-b86e-e024fdea13e7 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:37.932108 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ba88e-9ebb-4f97-b898-dba1ecbf091b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:37.933043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ba88e-9ebb-4f97-b898-dba1ecbf091b None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:37.933329 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ba88e-9ebb-4f97-b898-dba1ecbf091b None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:37.933603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ba88e-9ebb-4f97-b898-dba1ecbf091b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:37.934495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ba88e-9ebb-4f97-b898-dba1ecbf091b None admin] RBAC: Adding query filter params (role.id=1a67a38c7559419081284aa53b1fdfaa, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=5890e1e70ffd4e33a812691e9c43b6d2) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:37.934809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ba88e-9ebb-4f97-b898-dba1ecbf091b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:37.936228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ba88e-9ebb-4f97-b898-dba1ecbf091b None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:37.941918 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 491/986] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:02:37 2022] GET /identity/v3/role_assignments?user.id=5890e1e70ffd4e33a812691e9c43b6d2&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=1a67a38c7559419081284aa53b1fdfaa => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:37.943079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787dbe30-bb51-4b41-897a-e218e6fcbd23 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:37.943365 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787dbe30-bb51-4b41-897a-e218e6fcbd23 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:37.943640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787dbe30-bb51-4b41-897a-e218e6fcbd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:37.962186 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-787dbe30-bb51-4b41-897a-e218e6fcbd23 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:37.964300 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-787dbe30-bb51-4b41-897a-e218e6fcbd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:37.966778 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d09a87-4268-45ca-8715-9b013fa6fd4a None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:37.990017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:38.009106 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3023e0-93de-421e-a6f0-658b22300970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:38.009106 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3023e0-93de-421e-a6f0-658b22300970 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:38.009106 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3023e0-93de-421e-a6f0-658b22300970 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:38.009106 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3023e0-93de-421e-a6f0-658b22300970 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:38.009547 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3023e0-93de-421e-a6f0-658b22300970 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:38.009547 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3023e0-93de-421e-a6f0-658b22300970 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:38.015479 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 496/987] 10.222.0.66 () {56 vars in 1087 bytes} [Thu May 26 21:02:37 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:02:38.049147 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 492/988] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:38.074476 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3023e0-93de-421e-a6f0-658b22300970 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:38.205360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3023e0-93de-421e-a6f0-658b22300970 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:38.242341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6164e23-8899-4543-a473-e4373c59a53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:38.243014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6164e23-8899-4543-a473-e4373c59a53b None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:38.243301 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6164e23-8899-4543-a473-e4373c59a53b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:38.243580 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6164e23-8899-4543-a473-e4373c59a53b None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:38.244305 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6164e23-8899-4543-a473-e4373c59a53b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:38.245746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6164e23-8899-4543-a473-e4373c59a53b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:38.311948 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 497/989] 10.222.0.66 () {60 vars in 1141 bytes} [Thu May 26 21:02:38 2022] POST /identity/v3/services => generated 242 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:02:40.192394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a398f-23d4-4a27-8421-aae8322f34cf None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:40.192966 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a398f-23d4-4a27-8421-aae8322f34cf None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:40.192966 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a398f-23d4-4a27-8421-aae8322f34cf None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:40.194372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 493/990] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:40.199929 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7d7fe-765a-4f80-beda-28296d22c240 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:40.200340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7d7fe-765a-4f80-beda-28296d22c240 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:40.200507 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7d7fe-765a-4f80-beda-28296d22c240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:40.218100 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-fea7d7fe-765a-4f80-beda-28296d22c240 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:40.219285 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-fea7d7fe-765a-4f80-beda-28296d22c240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:40.253547 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762727db-755a-4826-86d4-58f427101e13 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:40.253829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762727db-755a-4826-86d4-58f427101e13 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:40.254112 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762727db-755a-4826-86d4-58f427101e13 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:40.255486 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 494/991] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:02:40.260566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0219ed-6194-47ca-8128-01b92d85b9ff None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:40.261395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0219ed-6194-47ca-8128-01b92d85b9ff None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:40.261677 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0219ed-6194-47ca-8128-01b92d85b9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:40.262326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:40.279172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-fb0219ed-6194-47ca-8128-01b92d85b9ff None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:40.280360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-fb0219ed-6194-47ca-8128-01b92d85b9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:40.294102 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:40.298286 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 498/992] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:40.320811 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7d7fe-765a-4f80-beda-28296d22c240 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:40.360954 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 495/993] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:40.384384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0219ed-6194-47ca-8128-01b92d85b9ff None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:40.440020 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7d7fe-765a-4f80-beda-28296d22c240 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:40.474016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad8801-867a-406a-83fb-5c8e49c70c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:40.475124 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad8801-867a-406a-83fb-5c8e49c70c9b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:40.475410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad8801-867a-406a-83fb-5c8e49c70c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:40.475686 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad8801-867a-406a-83fb-5c8e49c70c9b None admin] PATH_INFO: `/v3/services/image` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:40.476348 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad8801-867a-406a-83fb-5c8e49c70c9b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:40.477755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad8801-867a-406a-83fb-5c8e49c70c9b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:40.489460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0219ed-6194-47ca-8128-01b92d85b9ff None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:40.490611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-98ad8801-867a-406a-83fb-5c8e49c70c9b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 21:02:40.490611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:40.490611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:40.490611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:40.490611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:40.490611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:40.490611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:40.490611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:40.490611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 21:02:40.490611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:40.490611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:40.490611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:40.490611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:40.490611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:40.490611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:40.490611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:40.490611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:40.491562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:40.491562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:40.491562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:40.491562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:40.491562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:40.491562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:40.491562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:40.491562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:40.491562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:40.491562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:40.491562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:40.491562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:40.491562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:40.491562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:40.491562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:40.491562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:40.492391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:40.492391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:40.492391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:40.492391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:40.492391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:40.492391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:40.492391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:40.492391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:40.492391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:40.492391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:40.492391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:40.492391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:40.492391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 21:02:40.492391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:40.492391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 499/994] 10.222.0.66 () {56 vars in 1105 bytes} [Thu May 26 21:02:40 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:40.498334 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad8801-867a-406a-83fb-5c8e49c70c9b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:40.527188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8fd64-5282-41b5-b69c-39c238c10918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:40.527989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8fd64-5282-41b5-b69c-39c238c10918 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:40.528272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8fd64-5282-41b5-b69c-39c238c10918 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:40.528561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8fd64-5282-41b5-b69c-39c238c10918 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:40.529223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8fd64-5282-41b5-b69c-39c238c10918 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:40.530598 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8fd64-5282-41b5-b69c-39c238c10918 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:40.532147 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:40.543212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-39c8fd64-5282-41b5-b69c-39c238c10918 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 21:02:40.543212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:40.543212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:40.543212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:40.543212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:40.543212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:40.543212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:40.543212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:40.543212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 21:02:40.543212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:40.543212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:40.543212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:40.543212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:40.543212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:40.543212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:40.543212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:40.543212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:40.544366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:40.544366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:40.544366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:40.544366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:40.544366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:40.544366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:40.544366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:40.544366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:40.544366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:40.544366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:40.544366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:40.544366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:40.544366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:40.544366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:40.544366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:40.544366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:40.545267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:40.545267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:40.545267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:40.545267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:40.545267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:40.545267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:40.545267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:40.545267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:40.545267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:40.545267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:40.545267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:40.545267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:40.545267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 21:02:40.545267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:40.546440 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 496/995] 10.222.0.66 () {56 vars in 1126 bytes} [Thu May 26 21:02:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:40.547885 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa002d2-d936-4f19-98db-09ffdf350d2c None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:40.548182 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa002d2-d936-4f19-98db-09ffdf350d2c None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:40.548466 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa002d2-d936-4f19-98db-09ffdf350d2c None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:40.549845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 497/996] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:40.550560 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa002d2-d936-4f19-98db-09ffdf350d2c None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:40.566498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:40.601976 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad8801-867a-406a-83fb-5c8e49c70c9b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:40.635401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba34f3-1f18-4cfb-88c2-167b70911c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:40.636957 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba34f3-1f18-4cfb-88c2-167b70911c4e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:40.637454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba34f3-1f18-4cfb-88c2-167b70911c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:40.637570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba34f3-1f18-4cfb-88c2-167b70911c4e None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:40.638214 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba34f3-1f18-4cfb-88c2-167b70911c4e None admin] RBAC: Adding query filter params (name=image) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:40.638515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba34f3-1f18-4cfb-88c2-167b70911c4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:40.640183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba34f3-1f18-4cfb-88c2-167b70911c4e None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:40.644499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 500/997] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:40.645680 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5399-a6dd-449d-b408-62f1dfeb81be None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:40.646109 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5399-a6dd-449d-b408-62f1dfeb81be None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:40.646216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5399-a6dd-449d-b408-62f1dfeb81be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:40.652947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa002d2-d936-4f19-98db-09ffdf350d2c None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:40.662147 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-4ded5399-a6dd-449d-b408-62f1dfeb81be None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:40.663401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4ded5399-a6dd-449d-b408-62f1dfeb81be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:40.687393 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dede11-a617-4435-8ce8-28966523e9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:40.688059 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dede11-a617-4435-8ce8-28966523e9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:40.688346 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dede11-a617-4435-8ce8-28966523e9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:40.688652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dede11-a617-4435-8ce8-28966523e9e1 None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:40.689364 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dede11-a617-4435-8ce8-28966523e9e1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:40.689675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dede11-a617-4435-8ce8-28966523e9e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:40.691083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dede11-a617-4435-8ce8-28966523e9e1 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:40.695943 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 498/998] 10.222.0.66 () {56 vars in 1122 bytes} [Thu May 26 21:02:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:40.696747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dede11-a617-4435-8ce8-28966523e9e1 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:40.733439 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 501/999] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:40.735224 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded5399-a6dd-449d-b408-62f1dfeb81be None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:40.763097 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:40.772992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:40.795908 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dede11-a617-4435-8ce8-28966523e9e1 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:40.829207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4106a-4799-439f-8561-804341f30e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:40.829876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4106a-4799-439f-8561-804341f30e22 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:40.830165 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4106a-4799-439f-8561-804341f30e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:40.830442 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4106a-4799-439f-8561-804341f30e22 None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:40.831145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4106a-4799-439f-8561-804341f30e22 None admin] RBAC: Adding query filter params (type=image) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:40.831455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4106a-4799-439f-8561-804341f30e22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:40.832855 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4106a-4799-439f-8561-804341f30e22 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:40.833815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded5399-a6dd-449d-b408-62f1dfeb81be None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:40.837259 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 499/1000] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:40.838037 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4106a-4799-439f-8561-804341f30e22 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:40.877414 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2873f-47f6-4919-8bff-592f9891f329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:40.878106 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2873f-47f6-4919-8bff-592f9891f329 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:40.878391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2873f-47f6-4919-8bff-592f9891f329 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:40.878671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2873f-47f6-4919-8bff-592f9891f329 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:40.879404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2873f-47f6-4919-8bff-592f9891f329 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:40.879705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2873f-47f6-4919-8bff-592f9891f329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:40.881169 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2873f-47f6-4919-8bff-592f9891f329 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:40.887448 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 502/1001] 10.222.0.66 () {56 vars in 1122 bytes} [Thu May 26 21:02:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:40.893028 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2873f-47f6-4919-8bff-592f9891f329 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:40.962660 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4106a-4799-439f-8561-804341f30e22 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:40.996348 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:41.003172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a28b78-d4f5-4bfb-bc05-0edec5b7d019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:41.004292 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a28b78-d4f5-4bfb-bc05-0edec5b7d019 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:41.004776 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a28b78-d4f5-4bfb-bc05-0edec5b7d019 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:41.004883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2873f-47f6-4919-8bff-592f9891f329 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:41.015883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a28b78-d4f5-4bfb-bc05-0edec5b7d019 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:41.015883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a28b78-d4f5-4bfb-bc05-0edec5b7d019 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:41.015883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a28b78-d4f5-4bfb-bc05-0edec5b7d019 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:41.020716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-30a28b78-d4f5-4bfb-bc05-0edec5b7d019 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 21:02:41.020716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:41.020716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:41.020716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:41.020716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:41.020716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:41.020716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:41.020716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:41.020716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 21:02:41.020716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:41.020716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:41.020716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:41.020716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:41.020716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:41.020716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:41.020716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:41.020716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:41.021675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:41.021675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:41.021675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:41.021675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:41.021675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:41.021675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:41.021675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:41.021675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:41.021675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:41.021675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:41.021675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:41.021675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:41.021675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:41.021675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:41.021675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:41.021675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:41.022500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:41.022500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:41.022500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:41.022500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:41.022500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:41.022500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:41.022500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:41.022500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:41.022500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:41.022500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:41.022500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:41.022500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:41.022500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 21:02:41.022500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:41.024671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 500/1002] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:41.031449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a28b78-d4f5-4bfb-bc05-0edec5b7d019 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:41.037084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:41.047329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f61803-0e27-4df5-aca6-393872e5081a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:41.048522 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f61803-0e27-4df5-aca6-393872e5081a None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:41.048522 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f61803-0e27-4df5-aca6-393872e5081a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:41.048727 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f61803-0e27-4df5-aca6-393872e5081a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:41.049358 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f61803-0e27-4df5-aca6-393872e5081a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:41.050724 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f61803-0e27-4df5-aca6-393872e5081a None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:41.114407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 503/1003] 10.222.0.66 () {60 vars in 1144 bytes} [Thu May 26 21:02:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:02:41.141558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a28b78-d4f5-4bfb-bc05-0edec5b7d019 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:41.185441 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a4da9-742d-44d2-8fe4-fbbf6ac0cf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:41.186130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a4da9-742d-44d2-8fe4-fbbf6ac0cf1e None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:41.186413 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a4da9-742d-44d2-8fe4-fbbf6ac0cf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:41.186688 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a4da9-742d-44d2-8fe4-fbbf6ac0cf1e None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:41.187407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a4da9-742d-44d2-8fe4-fbbf6ac0cf1e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:41.187716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a4da9-742d-44d2-8fe4-fbbf6ac0cf1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:41.189207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a4da9-742d-44d2-8fe4-fbbf6ac0cf1e None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:41.200231 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 501/1004] 10.222.0.66 () {56 vars in 1112 bytes} [Thu May 26 21:02:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:41.201359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f61803-0e27-4df5-aca6-393872e5081a None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:41.311922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f61803-0e27-4df5-aca6-393872e5081a None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:41.346423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ba76f-1a6d-42f6-b07e-ebf67050b515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:41.347097 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ba76f-1a6d-42f6-b07e-ebf67050b515 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:41.347382 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ba76f-1a6d-42f6-b07e-ebf67050b515 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:41.347661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ba76f-1a6d-42f6-b07e-ebf67050b515 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:41.348374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ba76f-1a6d-42f6-b07e-ebf67050b515 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:41.348741 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ba76f-1a6d-42f6-b07e-ebf67050b515 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:41.350112 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ba76f-1a6d-42f6-b07e-ebf67050b515 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:41.355269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 504/1005] 10.222.0.66 () {56 vars in 1112 bytes} [Thu May 26 21:02:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:41.360896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a4da9-742d-44d2-8fe4-fbbf6ac0cf1e None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:41.425153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:41.462874 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a4da9-742d-44d2-8fe4-fbbf6ac0cf1e None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:41.498517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2107f1-0ad4-4102-9118-00c83c85061e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:41.499187 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2107f1-0ad4-4102-9118-00c83c85061e None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:41.499471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2107f1-0ad4-4102-9118-00c83c85061e None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:41.499750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2107f1-0ad4-4102-9118-00c83c85061e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:41.500542 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2107f1-0ad4-4102-9118-00c83c85061e None admin] RBAC: Adding query filter params (interface=public, service_id=e6d1b6170fe6457e8d93deeb4f75b306, region_id=RegionOne) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:41.500899 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2107f1-0ad4-4102-9118-00c83c85061e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:41.502283 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2107f1-0ad4-4102-9118-00c83c85061e None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:41.509860 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 502/1006] 10.222.0.66 () {56 vars in 1251 bytes} [Thu May 26 21:02:41 2022] GET /identity/v3/endpoints?service_id=e6d1b6170fe6457e8d93deeb4f75b306&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:41.516147 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ba76f-1a6d-42f6-b07e-ebf67050b515 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:41.538362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:41.631699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ba76f-1a6d-42f6-b07e-ebf67050b515 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:41.665673 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194318b7-59ba-4bdf-8c25-08dfd021aa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:41.666348 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194318b7-59ba-4bdf-8c25-08dfd021aa62 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:41.666654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194318b7-59ba-4bdf-8c25-08dfd021aa62 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:41.666938 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194318b7-59ba-4bdf-8c25-08dfd021aa62 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:41.667628 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194318b7-59ba-4bdf-8c25-08dfd021aa62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:41.669026 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194318b7-59ba-4bdf-8c25-08dfd021aa62 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:41.675706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 505/1007] 10.222.0.66 () {56 vars in 1087 bytes} [Thu May 26 21:02:41 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:02:43.059573 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489f78a-3b1d-4763-992e-a134a848fc55 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:43.060098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489f78a-3b1d-4763-992e-a134a848fc55 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:43.060098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489f78a-3b1d-4763-992e-a134a848fc55 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:43.061644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 503/1008] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:43.066773 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c09e56-3205-4402-b2d4-e39695ffe780 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:43.067194 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c09e56-3205-4402-b2d4-e39695ffe780 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:43.067337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c09e56-3205-4402-b2d4-e39695ffe780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:43.084527 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-13c09e56-3205-4402-b2d4-e39695ffe780 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:43.085717 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-13c09e56-3205-4402-b2d4-e39695ffe780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:43.155121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 506/1009] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:43 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:43.177563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489f78a-3b1d-4763-992e-a134a848fc55 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:43.280147 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489f78a-3b1d-4763-992e-a134a848fc55 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:43.305805 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:43.314653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6c552-aad3-478e-9e10-8a080e62900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:43.315248 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6c552-aad3-478e-9e10-8a080e62900a None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:43.315527 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6c552-aad3-478e-9e10-8a080e62900a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:43.315799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6c552-aad3-478e-9e10-8a080e62900a None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:43.316697 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6c552-aad3-478e-9e10-8a080e62900a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:43.318089 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6c552-aad3-478e-9e10-8a080e62900a None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:43.322197 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c146e5-86da-4180-8b27-a627de6c60a0 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:43.322483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c146e5-86da-4180-8b27-a627de6c60a0 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:43.323390 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c146e5-86da-4180-8b27-a627de6c60a0 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:43.324876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 507/1010] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:02:43.329705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df0da3-ed91-4591-b8bd-cf42c937e7b5 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:43.329994 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df0da3-ed91-4591-b8bd-cf42c937e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:43.330273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df0da3-ed91-4591-b8bd-cf42c937e7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:43.346721 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-c8df0da3-ed91-4591-b8bd-cf42c937e7b5 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:43.347889 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-c8df0da3-ed91-4591-b8bd-cf42c937e7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:43.350768 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:43.404613 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 504/1011] 10.222.0.66 () {60 vars in 1141 bytes} [Thu May 26 21:02:43 2022] POST /identity/v3/services => generated 242 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:02:43.425267 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 508/1012] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:43 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:43.450236 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6c552-aad3-478e-9e10-8a080e62900a None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:43.567917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6c552-aad3-478e-9e10-8a080e62900a None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:43.604976 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dc58f-b886-4fda-8d95-bcdb64216532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:43.605771 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dc58f-b886-4fda-8d95-bcdb64216532 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:43.606053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dc58f-b886-4fda-8d95-bcdb64216532 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:43.606330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dc58f-b886-4fda-8d95-bcdb64216532 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:43.607506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dc58f-b886-4fda-8d95-bcdb64216532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:43.608983 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dc58f-b886-4fda-8d95-bcdb64216532 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:43.610954 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 505/1013] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:43.616449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df0da3-ed91-4591-b8bd-cf42c937e7b5 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:43.722734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df0da3-ed91-4591-b8bd-cf42c937e7b5 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:43.757515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966faec-1088-4012-a9e1-67774c772ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:43.758180 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966faec-1088-4012-a9e1-67774c772ad9 None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:43.758460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966faec-1088-4012-a9e1-67774c772ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:43.758743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966faec-1088-4012-a9e1-67774c772ad9 None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:43.759467 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966faec-1088-4012-a9e1-67774c772ad9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:43.760955 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966faec-1088-4012-a9e1-67774c772ad9 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:43.765166 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:43.866183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 509/1014] 10.222.0.66 () {60 vars in 1141 bytes} [Thu May 26 21:02:43 2022] POST /identity/v3/projects => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:02:43.877696 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a9cb8-cb9e-45ea-aa21-b50d8a9c048c None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:43.877987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a9cb8-cb9e-45ea-aa21-b50d8a9c048c None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:43.878408 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a9cb8-cb9e-45ea-aa21-b50d8a9c048c None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:43.880142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 506/1015] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:43.886116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70962dfc-1e68-4235-b0f6-bbecd07318a7 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:43.886454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70962dfc-1e68-4235-b0f6-bbecd07318a7 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:43.886680 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70962dfc-1e68-4235-b0f6-bbecd07318a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:43.905084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-70962dfc-1e68-4235-b0f6-bbecd07318a7 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:43.906313 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-70962dfc-1e68-4235-b0f6-bbecd07318a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:43.988929 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 510/1016] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:43 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:44.007568 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a9cb8-cb9e-45ea-aa21-b50d8a9c048c None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:44.071290 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:44.119370 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a9cb8-cb9e-45ea-aa21-b50d8a9c048c None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:44.154650 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3087a-3208-440c-ad23-3a08661bfd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:44.155450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3087a-3208-440c-ad23-3a08661bfd73 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:44.155733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3087a-3208-440c-ad23-3a08661bfd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:44.156007 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3087a-3208-440c-ad23-3a08661bfd73 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:44.156692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3087a-3208-440c-ad23-3a08661bfd73 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:44.158083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3087a-3208-440c-ad23-3a08661bfd73 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:44.169784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-2ad3087a-3208-440c-ad23-3a08661bfd73 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 21:02:44.169784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:44.169784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:44.169784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:44.169784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:44.169784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:44.169784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:44.169784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:44.169784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 21:02:44.169784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:44.169784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:44.169784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:44.169784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:44.169784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:44.169784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:44.169784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:44.169784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:44.171149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:44.171149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:44.171149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:44.171149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:44.171149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:44.171149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:44.171149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:44.171149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:44.171149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:44.171149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:44.171149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:44.171149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:44.171149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:44.171149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:44.171149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:44.171149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:44.172135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:44.172135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:44.172135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:44.172135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:44.172135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:44.172135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:44.172135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:44.172135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:44.172135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:44.172135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:44.172135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:44.172135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:44.172135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 21:02:44.172135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:44.175969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 507/1017] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:44.177382 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70962dfc-1e68-4235-b0f6-bbecd07318a7 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:44.278111 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70962dfc-1e68-4235-b0f6-bbecd07318a7 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:44.295621 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:44.312614 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ef5aa-8cbb-4c30-a7a7-a9724f7ff490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:44.313283 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ef5aa-8cbb-4c30-a7a7-a9724f7ff490 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:44.313565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ef5aa-8cbb-4c30-a7a7-a9724f7ff490 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:44.313841 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ef5aa-8cbb-4c30-a7a7-a9724f7ff490 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:44.314550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ef5aa-8cbb-4c30-a7a7-a9724f7ff490 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:44.314853 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ef5aa-8cbb-4c30-a7a7-a9724f7ff490 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:44.316220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ef5aa-8cbb-4c30-a7a7-a9724f7ff490 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:44.326309 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 511/1018] 10.222.0.66 () {56 vars in 1112 bytes} [Thu May 26 21:02:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:44.327690 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3087a-3208-440c-ad23-3a08661bfd73 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:44.429798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3087a-3208-440c-ad23-3a08661bfd73 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:44.450540 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:44.464240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993631a-0ba9-4cda-b582-c728ae7d31e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:44.464968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993631a-0ba9-4cda-b582-c728ae7d31e7 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:44.465251 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993631a-0ba9-4cda-b582-c728ae7d31e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:44.467800 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993631a-0ba9-4cda-b582-c728ae7d31e7 None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:44.467800 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993631a-0ba9-4cda-b582-c728ae7d31e7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:44.467800 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993631a-0ba9-4cda-b582-c728ae7d31e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:44.468037 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993631a-0ba9-4cda-b582-c728ae7d31e7 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:44.477273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 508/1019] 10.222.0.66 () {56 vars in 1112 bytes} [Thu May 26 21:02:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:44.478505 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ef5aa-8cbb-4c30-a7a7-a9724f7ff490 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:44.588696 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ef5aa-8cbb-4c30-a7a7-a9724f7ff490 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:44.623793 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50de75-40e8-45ef-b6c0-29d7754979f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:44.624462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50de75-40e8-45ef-b6c0-29d7754979f8 None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:44.624776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50de75-40e8-45ef-b6c0-29d7754979f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:44.625061 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50de75-40e8-45ef-b6c0-29d7754979f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:44.625820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50de75-40e8-45ef-b6c0-29d7754979f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:44.627191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50de75-40e8-45ef-b6c0-29d7754979f8 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:44.699812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 512/1020] 10.222.0.66 () {60 vars in 1144 bytes} [Thu May 26 21:02:44 2022] POST /identity/v3/endpoints => generated 334 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:02:45.626110 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab985f-0844-4650-9ddd-264cf4e65392 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:45.626656 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab985f-0844-4650-9ddd-264cf4e65392 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:45.626656 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab985f-0844-4650-9ddd-264cf4e65392 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:45.628294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 509/1021] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:45.633315 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb57ab-b554-4974-9b33-14d201f9b68a None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:45.633742 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb57ab-b554-4974-9b33-14d201f9b68a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:45.633874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb57ab-b554-4974-9b33-14d201f9b68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:45.651619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-84fb57ab-b554-4974-9b33-14d201f9b68a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:45.652848 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-84fb57ab-b554-4974-9b33-14d201f9b68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:45.683800 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:45.728531 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 513/1022] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:45.752130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab985f-0844-4650-9ddd-264cf4e65392 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:45.865676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab985f-0844-4650-9ddd-264cf4e65392 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:45.899800 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab8d12-5d6f-482a-a1e2-dfc8e04cad40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:45.900650 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8d12-5d6f-482a-a1e2-dfc8e04cad40 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:45.901514 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8d12-5d6f-482a-a1e2-dfc8e04cad40 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:45.901768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8d12-5d6f-482a-a1e2-dfc8e04cad40 None admin] PATH_INFO: `/v3/services/image` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:45.902434 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab8d12-5d6f-482a-a1e2-dfc8e04cad40 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:45.903850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab8d12-5d6f-482a-a1e2-dfc8e04cad40 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:45.916145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-ebab8d12-5d6f-482a-a1e2-dfc8e04cad40 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 21:02:45.916145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:45.916145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:45.916145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:45.916145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:45.916145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:45.916145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:45.916145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:45.916145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 21:02:45.916145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:45.916145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:45.916145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:45.916145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:45.916145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:45.916145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:45.916145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:45.916145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:45.917247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:45.917247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:45.917247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:45.917247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:45.917247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:45.917247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:45.917247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:45.917247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:45.917247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:45.917247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:45.917247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:45.917247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:45.917247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:45.917247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:45.917247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:45.917247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:45.918084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:45.918084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:45.918084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:45.918084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:45.918084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:45.918084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:45.918084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:45.918084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:45.918084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:45.918084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:45.918084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:45.918084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:45.918084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 21:02:45.918084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:45.919545 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 510/1023] 10.222.0.66 () {56 vars in 1105 bytes} [Thu May 26 21:02:45 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:45.923874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb57ab-b554-4974-9b33-14d201f9b68a None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:46.028904 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb57ab-b554-4974-9b33-14d201f9b68a None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:46.062644 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf9486-e96e-4065-9d67-86ea86176f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:46.063306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf9486-e96e-4065-9d67-86ea86176f4e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:46.063583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf9486-e96e-4065-9d67-86ea86176f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:46.063854 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf9486-e96e-4065-9d67-86ea86176f4e None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:46.064554 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf9486-e96e-4065-9d67-86ea86176f4e None admin] RBAC: Adding query filter params (name=image) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:46.064889 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf9486-e96e-4065-9d67-86ea86176f4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:46.066242 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf9486-e96e-4065-9d67-86ea86176f4e None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:46.076475 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 514/1024] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:46.077298 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab8d12-5d6f-482a-a1e2-dfc8e04cad40 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:46.115373 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08b0dd-3d1e-42c1-9063-482dc7f52a72 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:46.115751 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08b0dd-3d1e-42c1-9063-482dc7f52a72 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:46.115937 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08b0dd-3d1e-42c1-9063-482dc7f52a72 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:46.117462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 515/1025] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:02:46.122878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac5cd5-aea1-40d4-875c-ed6ea2c694e9 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:46.123164 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac5cd5-aea1-40d4-875c-ed6ea2c694e9 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:46.123447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac5cd5-aea1-40d4-875c-ed6ea2c694e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:46.126331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:46.140274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-39ac5cd5-aea1-40d4-875c-ed6ea2c694e9 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:46.141486 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-39ac5cd5-aea1-40d4-875c-ed6ea2c694e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:46.165158 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:46.181679 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab8d12-5d6f-482a-a1e2-dfc8e04cad40 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:46.211775 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 516/1026] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:46.215937 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dad72-ebe6-4321-ae76-e3d2713c0c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:46.216804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dad72-ebe6-4321-ae76-e3d2713c0c2a None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:46.217085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dad72-ebe6-4321-ae76-e3d2713c0c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:46.217356 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dad72-ebe6-4321-ae76-e3d2713c0c2a None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:46.219507 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dad72-ebe6-4321-ae76-e3d2713c0c2a None admin] RBAC: Adding query filter params (type=image) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:46.219507 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dad72-ebe6-4321-ae76-e3d2713c0c2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:46.219745 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dad72-ebe6-4321-ae76-e3d2713c0c2a None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:46.229356 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 511/1027] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:46.230534 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac5cd5-aea1-40d4-875c-ed6ea2c694e9 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:46.237778 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dad72-ebe6-4321-ae76-e3d2713c0c2a None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:46.339819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dad72-ebe6-4321-ae76-e3d2713c0c2a None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:46.340024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac5cd5-aea1-40d4-875c-ed6ea2c694e9 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:46.354978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:46.377080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb7c2f-6bf3-415c-beb3-323749f152fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:46.377793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb7c2f-6bf3-415c-beb3-323749f152fd None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:46.378071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb7c2f-6bf3-415c-beb3-323749f152fd None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:46.378238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e6da1-d362-40e8-a90a-c810fac9aeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:46.378351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb7c2f-6bf3-415c-beb3-323749f152fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:46.378888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e6da1-d362-40e8-a90a-c810fac9aeef None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:46.379220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e6da1-d362-40e8-a90a-c810fac9aeef None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:46.379491 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb7c2f-6bf3-415c-beb3-323749f152fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:46.379589 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e6da1-d362-40e8-a90a-c810fac9aeef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:46.380338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e6da1-d362-40e8-a90a-c810fac9aeef None admin] RBAC: Adding query filter params (interface=public, service_id=ea3f177463a64ad493d91c7b5bd71a63, region_id=RegionOne) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:46.380682 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e6da1-d362-40e8-a90a-c810fac9aeef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:46.381420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb7c2f-6bf3-415c-beb3-323749f152fd None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:46.382094 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e6da1-d362-40e8-a90a-c810fac9aeef None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:46.383198 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 512/1028] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:46.392249 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 517/1029] 10.222.0.66 () {56 vars in 1251 bytes} [Thu May 26 21:02:46 2022] GET /identity/v3/endpoints?service_id=ea3f177463a64ad493d91c7b5bd71a63&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:46.392399 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb7c2f-6bf3-415c-beb3-323749f152fd None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:46.393454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e6da1-d362-40e8-a90a-c810fac9aeef None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:46.419120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:46.495809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb7c2f-6bf3-415c-beb3-323749f152fd None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:46.507795 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e6da1-d362-40e8-a90a-c810fac9aeef None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:46.534546 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953e601-9c86-4ac2-9ee6-5281b8ed31e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:46.535226 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953e601-9c86-4ac2-9ee6-5281b8ed31e8 None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:46.535760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953e601-9c86-4ac2-9ee6-5281b8ed31e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:46.535760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953e601-9c86-4ac2-9ee6-5281b8ed31e8 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:46.536481 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953e601-9c86-4ac2-9ee6-5281b8ed31e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:46.537946 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953e601-9c86-4ac2-9ee6-5281b8ed31e8 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:46.543852 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199f52f-3697-4544-b0aa-452d0e58dc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:46.544547 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199f52f-3697-4544-b0aa-452d0e58dc6b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:46.544874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199f52f-3697-4544-b0aa-452d0e58dc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:46.545322 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199f52f-3697-4544-b0aa-452d0e58dc6b None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:46.546631 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199f52f-3697-4544-b0aa-452d0e58dc6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:46.548534 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199f52f-3697-4544-b0aa-452d0e58dc6b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:46.555455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 518/1030] 10.222.0.66 () {56 vars in 1087 bytes} [Thu May 26 21:02:46 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:02:46.653967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 513/1031] 10.222.0.66 () {60 vars in 1132 bytes} [Thu May 26 21:02:46 2022] POST /identity/v3/users => generated 285 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:02:47.028478 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cd0a5-532f-4f06-8a5d-8454e65b2508 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:47.029027 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cd0a5-532f-4f06-8a5d-8454e65b2508 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:47.029138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cd0a5-532f-4f06-8a5d-8454e65b2508 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:47.030452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 519/1032] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:47.035741 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f583850-7c42-40ae-8cc6-2630172aa955 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:47.036039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f583850-7c42-40ae-8cc6-2630172aa955 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:47.036324 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f583850-7c42-40ae-8cc6-2630172aa955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:47.053758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-4f583850-7c42-40ae-8cc6-2630172aa955 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:47.054951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-4f583850-7c42-40ae-8cc6-2630172aa955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:47.085799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:47.124141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 514/1033] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:47.148160 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cd0a5-532f-4f06-8a5d-8454e65b2508 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:47.235760 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:47.252068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cd0a5-532f-4f06-8a5d-8454e65b2508 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:47.287061 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c739b3d-c7f5-483e-bb02-f0804c7d066a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:47.287794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c739b3d-c7f5-483e-bb02-f0804c7d066a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:47.288080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c739b3d-c7f5-483e-bb02-f0804c7d066a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:47.288355 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c739b3d-c7f5-483e-bb02-f0804c7d066a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:47.298883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c739b3d-c7f5-483e-bb02-f0804c7d066a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:47.307328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-7c739b3d-c7f5-483e-bb02-f0804c7d066a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 21:02:47.307328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:47.307328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:47.307328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:47.307328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:47.307328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:47.307328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:47.307328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:47.307328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:47.307328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:47.307328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:47.307328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:47.307328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:47.307328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:47.307328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:47.307328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:47.308370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:47.308370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:47.308370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:47.308370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:47.308370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:47.308370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:47.308370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:47.308370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:47.308370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:47.308370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:47.308370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:47.308370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:47.308370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:47.308370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:47.308370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:47.308370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:47.309294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:47.309294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:47.309294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:47.309294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:47.309294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:47.309294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:47.309294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:47.309294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:47.309294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:47.309294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:47.309294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 21:02:47.309294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:47.309294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 520/1034] 10.222.0.66 () {56 vars in 1120 bytes} [Thu May 26 21:02:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:47.316224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f583850-7c42-40ae-8cc6-2630172aa955 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:47.414971 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f583850-7c42-40ae-8cc6-2630172aa955 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:47.450056 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177127c-a514-4960-b8d4-f0b500c308d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:47.450725 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177127c-a514-4960-b8d4-f0b500c308d6 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:47.451008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177127c-a514-4960-b8d4-f0b500c308d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:47.451284 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177127c-a514-4960-b8d4-f0b500c308d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:47.452029 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177127c-a514-4960-b8d4-f0b500c308d6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:47.452336 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177127c-a514-4960-b8d4-f0b500c308d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:47.453747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177127c-a514-4960-b8d4-f0b500c308d6 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:47.466281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 515/1035] 10.222.0.66 () {56 vars in 1115 bytes} [Thu May 26 21:02:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:47.467744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c739b3d-c7f5-483e-bb02-f0804c7d066a None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:47.573653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c739b3d-c7f5-483e-bb02-f0804c7d066a None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:47.610928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb7124-9380-43b3-a4f9-8b9f09c67572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:47.611719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb7124-9380-43b3-a4f9-8b9f09c67572 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:47.612137 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb7124-9380-43b3-a4f9-8b9f09c67572 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:47.612419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb7124-9380-43b3-a4f9-8b9f09c67572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:47.623456 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb7124-9380-43b3-a4f9-8b9f09c67572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:47.624925 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb7124-9380-43b3-a4f9-8b9f09c67572 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:47.631201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:47.643251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-b3cb7124-9380-43b3-a4f9-8b9f09c67572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:47.643251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:47.643251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:47.643251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:47.643251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:47.643251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:47.643251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:47.643251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:47.643251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:47.643251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:47.643251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:47.643251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:47.643251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:47.643251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:47.643251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:47.644464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:47.644464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:47.644464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:47.644464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:47.644464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:47.644464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:47.644464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:47.644464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:47.644464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:47.644464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:47.644464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:47.644464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:47.644464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:47.644464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:47.644464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:47.644464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:47.644464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:47.645798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:47.645798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:47.645798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:47.645798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:47.646258 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 521/1036] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:47.650338 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177127c-a514-4960-b8d4-f0b500c308d6 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:47.681575 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:47.755309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177127c-a514-4960-b8d4-f0b500c308d6 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:47.790074 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7868e-ee05-4ff1-b67d-6af8257c494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:47.790737 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7868e-ee05-4ff1-b67d-6af8257c494a None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:47.791019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7868e-ee05-4ff1-b67d-6af8257c494a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:47.791322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7868e-ee05-4ff1-b67d-6af8257c494a None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:47.792049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7868e-ee05-4ff1-b67d-6af8257c494a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:47.792354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7868e-ee05-4ff1-b67d-6af8257c494a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:47.793756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7868e-ee05-4ff1-b67d-6af8257c494a None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:47.805786 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 516/1037] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:47.812454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb7124-9380-43b3-a4f9-8b9f09c67572 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:47.915603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb7124-9380-43b3-a4f9-8b9f09c67572 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:47.949729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23466ebf-683b-4651-8129-13c06b214908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:47.950515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23466ebf-683b-4651-8129-13c06b214908 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:47.950798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23466ebf-683b-4651-8129-13c06b214908 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:47.951074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23466ebf-683b-4651-8129-13c06b214908 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:47.958513 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23466ebf-683b-4651-8129-13c06b214908 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:47.959945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23466ebf-683b-4651-8129-13c06b214908 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:47.973517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-23466ebf-683b-4651-8129-13c06b214908 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 21:02:47.973517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:47.973517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:47.973517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:47.973517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:47.973517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:47.973517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:47.973517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:47.973517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:47.973517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:47.973517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:47.973517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:47.973517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:02:47.973517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:02:47.973517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:02:47.973517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:02:47.974544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:47.974544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:47.974544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:02:47.974544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:47.974544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:02:47.974544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:47.974544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:47.974544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:47.974544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:47.974544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:47.974544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:47.974544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:47.974544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:47.974544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:47.974544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:47.974544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:47.974544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:47.974544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:47.976132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:47.976132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:47.976132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:02:47.976132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:02:47.976132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:02:47.976132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:02:47.976132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:02:47.976132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:02:47.976132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 21:02:47.976132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:47.976132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 522/1038] 10.222.0.66 () {56 vars in 1093 bytes} [Thu May 26 21:02:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:47.980951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7868e-ee05-4ff1-b67d-6af8257c494a None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:48.068821 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:48.080599 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7868e-ee05-4ff1-b67d-6af8257c494a None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:48.112968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020af40-ed61-4de8-ac4d-ca9db718af99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:48.113638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020af40-ed61-4de8-ac4d-ca9db718af99 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:48.113935 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020af40-ed61-4de8-ac4d-ca9db718af99 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:48.114214 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020af40-ed61-4de8-ac4d-ca9db718af99 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:48.115047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020af40-ed61-4de8-ac4d-ca9db718af99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:48.115749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020af40-ed61-4de8-ac4d-ca9db718af99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:48.117663 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020af40-ed61-4de8-ac4d-ca9db718af99 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:48.136152 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 517/1039] 10.222.0.66 () {56 vars in 1133 bytes} [Thu May 26 21:02:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:48.141661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23466ebf-683b-4651-8129-13c06b214908 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:48.200729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:48.243575 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23466ebf-683b-4651-8129-13c06b214908 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:48.277556 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb7b4a-9af0-4487-9024-88499310c59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:48.278211 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb7b4a-9af0-4487-9024-88499310c59e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:48.278492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb7b4a-9af0-4487-9024-88499310c59e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:48.278778 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb7b4a-9af0-4487-9024-88499310c59e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:48.346107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb7b4a-9af0-4487-9024-88499310c59e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:48.347462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb7b4a-9af0-4487-9024-88499310c59e None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:48.403884 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:48.447542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 523/1040] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:02:48 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:02:48.453486 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020af40-ed61-4de8-ac4d-ca9db718af99 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:48.551584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020af40-ed61-4de8-ac4d-ca9db718af99 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:48.595073 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf392e-32b9-4dec-a099-3fe5b80ab8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:48.595886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf392e-32b9-4dec-a099-3fe5b80ab8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:48.596221 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf392e-32b9-4dec-a099-3fe5b80ab8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:48.596438 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf392e-32b9-4dec-a099-3fe5b80ab8a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:48.607899 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf392e-32b9-4dec-a099-3fe5b80ab8a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:48.609425 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf392e-32b9-4dec-a099-3fe5b80ab8a3 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:48.617342 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:48.629728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-9cbf392e-32b9-4dec-a099-3fe5b80ab8a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:48.629728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:48.629728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:48.629728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:48.629728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:48.629728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:48.629728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:48.629728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:48.629728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:48.629728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:48.629728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:48.629728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:48.629728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:48.629728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:48.629728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:48.630714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:48.630714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:48.630714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:48.630714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:48.630714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:48.630714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:48.630714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:48.630714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:48.630714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:48.630714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:48.630714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:48.630714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:48.630714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:48.630714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:48.630714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:48.630714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:48.630714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:48.631611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:48.631611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:48.631611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:48.631611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:48.632497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 518/1041] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:48.637306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb7b4a-9af0-4487-9024-88499310c59e None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:48.740533 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb7b4a-9af0-4487-9024-88499310c59e None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:48.777683 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b1858-b10c-425b-8d79-c8ef9415ebf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:48.778351 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b1858-b10c-425b-8d79-c8ef9415ebf8 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:48.778636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b1858-b10c-425b-8d79-c8ef9415ebf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:48.778915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b1858-b10c-425b-8d79-c8ef9415ebf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:48.779644 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b1858-b10c-425b-8d79-c8ef9415ebf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:48.779955 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b1858-b10c-425b-8d79-c8ef9415ebf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:48.781349 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b1858-b10c-425b-8d79-c8ef9415ebf8 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:48.792859 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 524/1042] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:48.798250 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf392e-32b9-4dec-a099-3fe5b80ab8a3 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:48.800290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c351df9-4054-4ca6-a865-a1c23e4ed037 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:48.800596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c351df9-4054-4ca6-a865-a1c23e4ed037 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:48.800882 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c351df9-4054-4ca6-a865-a1c23e4ed037 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:48.802933 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 525/1043] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:02:48.807585 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab37e49-7926-409f-af2d-1f60049366f1 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:48.807871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab37e49-7926-409f-af2d-1f60049366f1 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:48.808198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab37e49-7926-409f-af2d-1f60049366f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:48.825310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-3ab37e49-7926-409f-af2d-1f60049366f1 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:48.826474 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3ab37e49-7926-409f-af2d-1f60049366f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:48.840147 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:48.897234 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 526/1044] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:48.905055 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf392e-32b9-4dec-a099-3fe5b80ab8a3 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:48.920610 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab37e49-7926-409f-af2d-1f60049366f1 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:48.941680 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97489b-022f-4031-b833-2408ede25f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:48.942466 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97489b-022f-4031-b833-2408ede25f30 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:48.942741 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97489b-022f-4031-b833-2408ede25f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:48.943010 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97489b-022f-4031-b833-2408ede25f30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:48.950253 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97489b-022f-4031-b833-2408ede25f30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:48.951706 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97489b-022f-4031-b833-2408ede25f30 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:48.964875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-5e97489b-022f-4031-b833-2408ede25f30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:48.964875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:48.964875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:48.964875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:48.964875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:48.964875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:48.964875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:48.964875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:48.964875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:48.964875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:48.964875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:48.964875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:48.964875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:48.964875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:48.964875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:48.965876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:48.965876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:48.965876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:48.965876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:48.965876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:48.965876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:48.965876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:48.965876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:48.965876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:48.965876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:48.965876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:48.965876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:48.965876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:48.965876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:48.965876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:48.965876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:48.965876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:48.966773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:48.966773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:48.966773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:48.966773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:48.966773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:48.966773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:48.966773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:48.966773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:48.966773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 519/1045] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:48.967259 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c489e4-9e5b-455d-8151-91fcce4dc6f2 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:48.967492 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c489e4-9e5b-455d-8151-91fcce4dc6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:48.967748 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c489e4-9e5b-455d-8151-91fcce4dc6f2 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:48.969009 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 520/1046] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:48.971735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c489e4-9e5b-455d-8151-91fcce4dc6f2 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:49.025390 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab37e49-7926-409f-af2d-1f60049366f1 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:49.029837 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:49.060719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cfe1a1-d78a-4f9a-af4e-de7b8107e0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:49.061515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfe1a1-d78a-4f9a-af4e-de7b8107e0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:49.061798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfe1a1-d78a-4f9a-af4e-de7b8107e0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:49.062074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfe1a1-d78a-4f9a-af4e-de7b8107e0a0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:49.062731 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cfe1a1-d78a-4f9a-af4e-de7b8107e0a0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:49.064092 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cfe1a1-d78a-4f9a-af4e-de7b8107e0a0 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:49.073892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c489e4-9e5b-455d-8151-91fcce4dc6f2 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:49.077407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-e0cfe1a1-d78a-4f9a-af4e-de7b8107e0a0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 21:02:49.077407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:49.077407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:02:49.077407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:02:49.077407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:02:49.077407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:02:49.077407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:02:49.077407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:49.077407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 21:02:49.077407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:49.077407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:02:49.077407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:49.077407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:49.077407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:49.077407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:49.077407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:49.077407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:49.078460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:49.078460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:49.078460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:49.078460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:49.078460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:49.078460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:49.078460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:02:49.078460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:02:49.078460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:02:49.078460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:02:49.078460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:49.078460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:49.078460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:49.078460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:49.078460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:49.078460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:49.079310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:49.079310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:49.079310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:49.079310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:49.079310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:49.079310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:49.079310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:49.079310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:49.079310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:49.079310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:49.079310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:02:49.079310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:02:49.079310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 21:02:49.079310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:49.079310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 527/1047] 10.222.0.66 () {56 vars in 1105 bytes} [Thu May 26 21:02:48 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:49.080128 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bd0c3-d035-45e0-8458-553833c9960b None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:49.080195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bd0c3-d035-45e0-8458-553833c9960b None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:49.080835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bd0c3-d035-45e0-8458-553833c9960b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:49.097438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-f54bd0c3-d035-45e0-8458-553833c9960b None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:49.098642 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f54bd0c3-d035-45e0-8458-553833c9960b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:49.106302 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:49.111390 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99004d-fbfa-4ace-ad4d-fb5281a1040b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:49.112057 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99004d-fbfa-4ace-ad4d-fb5281a1040b None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:49.112349 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99004d-fbfa-4ace-ad4d-fb5281a1040b None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:49.118281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99004d-fbfa-4ace-ad4d-fb5281a1040b None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:49.118281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99004d-fbfa-4ace-ad4d-fb5281a1040b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:49.118281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99004d-fbfa-4ace-ad4d-fb5281a1040b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:49.118281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99004d-fbfa-4ace-ad4d-fb5281a1040b None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:49.132341 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 521/1048] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:02:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:49.133264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99004d-fbfa-4ace-ad4d-fb5281a1040b None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:49.166987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 528/1049] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:49.167837 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bd0c3-d035-45e0-8458-553833c9960b None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:49.243924 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99004d-fbfa-4ace-ad4d-fb5281a1040b None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:49.262621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:49.274561 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bd0c3-d035-45e0-8458-553833c9960b None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:49.280639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe14c5-17aa-46fb-88e1-9c4a239411d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:49.281511 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe14c5-17aa-46fb-88e1-9c4a239411d6 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:49.282067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe14c5-17aa-46fb-88e1-9c4a239411d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:49.282851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe14c5-17aa-46fb-88e1-9c4a239411d6 None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:49.283575 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe14c5-17aa-46fb-88e1-9c4a239411d6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:49.283884 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe14c5-17aa-46fb-88e1-9c4a239411d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:49.285999 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe14c5-17aa-46fb-88e1-9c4a239411d6 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:49.291033 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 522/1050] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:49.291820 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe14c5-17aa-46fb-88e1-9c4a239411d6 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:49.309836 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df85b71-056f-4bd6-95c7-74e95c7beb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:49.310497 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df85b71-056f-4bd6-95c7-74e95c7beb3b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:49.310781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df85b71-056f-4bd6-95c7-74e95c7beb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:49.311120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df85b71-056f-4bd6-95c7-74e95c7beb3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:49.311994 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df85b71-056f-4bd6-95c7-74e95c7beb3b None admin] RBAC: Adding query filter params (role.id=1a67a38c7559419081284aa53b1fdfaa, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=df008eed25464be387741ee7a1e5ce80) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:49.312311 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df85b71-056f-4bd6-95c7-74e95c7beb3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:49.313790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df85b71-056f-4bd6-95c7-74e95c7beb3b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:49.320043 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 529/1051] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:02:49 2022] GET /identity/v3/role_assignments?user.id=df008eed25464be387741ee7a1e5ce80&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=1a67a38c7559419081284aa53b1fdfaa => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:49.320956 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df85b71-056f-4bd6-95c7-74e95c7beb3b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:49.330713 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:49.423442 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe14c5-17aa-46fb-88e1-9c4a239411d6 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:49.437529 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df85b71-056f-4bd6-95c7-74e95c7beb3b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:49.460610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9e282-34af-4232-a3bf-4de5b28cdeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:49.461429 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9e282-34af-4232-a3bf-4de5b28cdeb3 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:49.461713 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9e282-34af-4232-a3bf-4de5b28cdeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:49.461989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9e282-34af-4232-a3bf-4de5b28cdeb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:49.473377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9e282-34af-4232-a3bf-4de5b28cdeb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:49.477457 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ff990-f3d4-4ce6-b833-9a88f1ec6834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:49.478413 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ff990-f3d4-4ce6-b833-9a88f1ec6834 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:49.479437 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ff990-f3d4-4ce6-b833-9a88f1ec6834 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:49.479939 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ff990-f3d4-4ce6-b833-9a88f1ec6834 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:49.480916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ff990-f3d4-4ce6-b833-9a88f1ec6834 None admin] RBAC: Adding query filter params (type=image) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:49.481415 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ff990-f3d4-4ce6-b833-9a88f1ec6834 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:49.481814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-f1e9e282-34af-4232-a3bf-4de5b28cdeb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:02:49.481814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:49.481814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:49.481814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:49.481814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:49.481814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:49.481814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:49.481814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:49.481814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:49.481814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:49.481814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:49.481814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:49.481814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:49.481814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:49.481814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:49.481814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:49.482747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:49.482747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:49.482747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:49.482747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:49.482747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:49.482747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:49.482747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:49.482747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:49.482747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:49.482747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:49.482747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:49.482747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:49.482747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:49.482747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:49.482747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:49.482747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:49.483991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:49.483991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:49.483991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:49.483991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:49.483991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:49.483991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:49.483991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:49.483991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:49.483991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:49.483991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:49.483991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:02:49.483991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:49.483991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 523/1052] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:02:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:49.484959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ff990-f3d4-4ce6-b833-9a88f1ec6834 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:49.491508 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9e282-34af-4232-a3bf-4de5b28cdeb3 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:49.491853 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 530/1053] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:49.497788 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ff990-f3d4-4ce6-b833-9a88f1ec6834 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:49.542677 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:49.580852 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:49.608494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9e282-34af-4232-a3bf-4de5b28cdeb3 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:49.615346 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ff990-f3d4-4ce6-b833-9a88f1ec6834 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:49.645585 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab68c16-a725-4cc8-9453-adda3c92a49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:49.646502 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab68c16-a725-4cc8-9453-adda3c92a49a None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:49.646811 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab68c16-a725-4cc8-9453-adda3c92a49a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:49.647173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab68c16-a725-4cc8-9453-adda3c92a49a None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:49.647922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab68c16-a725-4cc8-9453-adda3c92a49a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:49.648227 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab68c16-a725-4cc8-9453-adda3c92a49a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:49.649634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab68c16-a725-4cc8-9453-adda3c92a49a None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:49.655968 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49676c7e-07e0-4842-a82e-7c6cca487ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:49.656665 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49676c7e-07e0-4842-a82e-7c6cca487ff8 None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:49.656955 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49676c7e-07e0-4842-a82e-7c6cca487ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:49.657233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49676c7e-07e0-4842-a82e-7c6cca487ff8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:49.657980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49676c7e-07e0-4842-a82e-7c6cca487ff8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:49.658509 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 524/1054] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:02:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:49.659420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49676c7e-07e0-4842-a82e-7c6cca487ff8 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:49.664203 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab68c16-a725-4cc8-9453-adda3c92a49a None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:49.739537 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 531/1055] 10.222.0.66 () {60 vars in 1144 bytes} [Thu May 26 21:02:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:02:49.772781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab68c16-a725-4cc8-9453-adda3c92a49a None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:49.777023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:49.820705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd835c1-feed-48ff-be4f-794603492fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:49.821607 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd835c1-feed-48ff-be4f-794603492fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:49.821889 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd835c1-feed-48ff-be4f-794603492fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:49.822165 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd835c1-feed-48ff-be4f-794603492fa9 None admin] PATH_INFO: `/v3/users/6ca87714b2264b0ab989dea8ae8ae45b` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:49.837449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd835c1-feed-48ff-be4f-794603492fa9 None admin] RBAC: Authorizing `identity:get_user(user_id=6ca87714b2264b0ab989dea8ae8ae45b)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:49.839516 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd835c1-feed-48ff-be4f-794603492fa9 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:49.846350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 525/1056] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:02:49 2022] GET /identity/v3/users/6ca87714b2264b0ab989dea8ae8ae45b => generated 285 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:49.847298 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49676c7e-07e0-4842-a82e-7c6cca487ff8 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:49.956456 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49676c7e-07e0-4842-a82e-7c6cca487ff8 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:49.983794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:49.998058 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884e3a8-2fce-4432-890f-6a3158258156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:49.998058 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884e3a8-2fce-4432-890f-6a3158258156 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:49.998058 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884e3a8-2fce-4432-890f-6a3158258156 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:49.998058 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884e3a8-2fce-4432-890f-6a3158258156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:50.062849 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884e3a8-2fce-4432-890f-6a3158258156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:50.064301 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884e3a8-2fce-4432-890f-6a3158258156 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:50.170438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 532/1057] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:02:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 21:02:50.172401 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd835c1-feed-48ff-be4f-794603492fa9 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:50.273237 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd835c1-feed-48ff-be4f-794603492fa9 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:50.306347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461ff18-a35d-42f1-8cfb-aa62a9ee53e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:50.307483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461ff18-a35d-42f1-8cfb-aa62a9ee53e1 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:50.307756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461ff18-a35d-42f1-8cfb-aa62a9ee53e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:50.308022 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461ff18-a35d-42f1-8cfb-aa62a9ee53e1 None admin] PATH_INFO: `/v3/projects/5a41b1be0f284d1caff356180fdcac76` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:50.309199 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461ff18-a35d-42f1-8cfb-aa62a9ee53e1 None admin] RBAC: Authorizing `identity:get_project(project_id=5a41b1be0f284d1caff356180fdcac76)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:50.310615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461ff18-a35d-42f1-8cfb-aa62a9ee53e1 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:50.312492 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 526/1058] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:02:50 2022] GET /identity/v3/projects/5a41b1be0f284d1caff356180fdcac76 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:50.318210 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884e3a8-2fce-4432-890f-6a3158258156 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:50.347064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:50.419361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884e3a8-2fce-4432-890f-6a3158258156 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:50.457822 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee9a0a-5111-4fe5-876a-fb689a826845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:50.458489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee9a0a-5111-4fe5-876a-fb689a826845 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:50.458773 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee9a0a-5111-4fe5-876a-fb689a826845 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:50.459050 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee9a0a-5111-4fe5-876a-fb689a826845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:50.459879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee9a0a-5111-4fe5-876a-fb689a826845 None admin] RBAC: Adding query filter params (role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.project.id=5a41b1be0f284d1caff356180fdcac76, user.id=6ca87714b2264b0ab989dea8ae8ae45b) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:50.460194 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee9a0a-5111-4fe5-876a-fb689a826845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:50.461650 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee9a0a-5111-4fe5-876a-fb689a826845 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:50.472609 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 533/1059] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:02:50 2022] GET /identity/v3/role_assignments?user.id=6ca87714b2264b0ab989dea8ae8ae45b&scope.project.id=5a41b1be0f284d1caff356180fdcac76&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:51.514777 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ae080-2358-459e-9de2-132226e392d3 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:51.515345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ae080-2358-459e-9de2-132226e392d3 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:51.515345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ae080-2358-459e-9de2-132226e392d3 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:51.516708 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 527/1060] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:51.521851 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4b7fc-0f7b-45e6-ba3a-8716493de6c2 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:51.522262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4b7fc-0f7b-45e6-ba3a-8716493de6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:51.522398 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4b7fc-0f7b-45e6-ba3a-8716493de6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:51.539671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-d0d4b7fc-0f7b-45e6-ba3a-8716493de6c2 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:51.541489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d0d4b7fc-0f7b-45e6-ba3a-8716493de6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:51.621923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 534/1061] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:51.644526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ae080-2358-459e-9de2-132226e392d3 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:51.673205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:51.749604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ae080-2358-459e-9de2-132226e392d3 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:51.782590 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e66af3-6bee-440a-923c-7d360ebe74fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:51.783323 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e66af3-6bee-440a-923c-7d360ebe74fb None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:51.783608 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e66af3-6bee-440a-923c-7d360ebe74fb None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:51.783885 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e66af3-6bee-440a-923c-7d360ebe74fb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:51.795625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e66af3-6bee-440a-923c-7d360ebe74fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:51.804062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-67e66af3-6bee-440a-923c-7d360ebe74fb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 21:02:51.804062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:51.804062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:51.804062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:51.804062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:51.804062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:51.804062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:51.804062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:51.804062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:51.804062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:51.804062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:51.804062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:51.804062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:51.804062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:51.804062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:51.804062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:51.805423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:51.805423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:51.805423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:51.805423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:51.805423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:51.805423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:51.805423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:51.805423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:51.805423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:51.805423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:51.805423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:51.805423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:51.805423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:51.805423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:51.805423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:51.805423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:51.806291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:51.806291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:51.806291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:51.806291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:51.806291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:51.806291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:51.806291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:51.806291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:51.806291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:51.806291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:51.806291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 21:02:51.806291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:51.809005 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 528/1062] 10.222.0.66 () {56 vars in 1120 bytes} [Thu May 26 21:02:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:51.812441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4b7fc-0f7b-45e6-ba3a-8716493de6c2 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:51.837140 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:51.914542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4b7fc-0f7b-45e6-ba3a-8716493de6c2 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:51.949815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4003b-32fe-44e5-a885-2e391f4b877d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:51.950514 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4003b-32fe-44e5-a885-2e391f4b877d None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:51.950800 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4003b-32fe-44e5-a885-2e391f4b877d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:51.951074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4003b-32fe-44e5-a885-2e391f4b877d None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:51.951814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4003b-32fe-44e5-a885-2e391f4b877d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:51.952121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4003b-32fe-44e5-a885-2e391f4b877d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:51.953506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4003b-32fe-44e5-a885-2e391f4b877d None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:51.966739 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 535/1063] 10.222.0.66 () {56 vars in 1115 bytes} [Thu May 26 21:02:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:51.968117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e66af3-6bee-440a-923c-7d360ebe74fb None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:51.992102 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9970e73-01da-42bf-9caa-dc85984b3160 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:51.992390 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9970e73-01da-42bf-9caa-dc85984b3160 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:51.992706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9970e73-01da-42bf-9caa-dc85984b3160 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:51.994199 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 536/1064] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:02:51.998942 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248ea3c-3ed7-4825-a676-0f184bf10b06 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:51.999236 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248ea3c-3ed7-4825-a676-0f184bf10b06 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:51.999519 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248ea3c-3ed7-4825-a676-0f184bf10b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:52.018096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-6248ea3c-3ed7-4825-a676-0f184bf10b06 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:52.019285 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6248ea3c-3ed7-4825-a676-0f184bf10b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:52.061728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:52.078040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e66af3-6bee-440a-923c-7d360ebe74fb None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:52.095001 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 537/1065] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:52.117802 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248ea3c-3ed7-4825-a676-0f184bf10b06 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:52.120267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af9660-d12c-40fc-bacb-7455567d242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:52.121920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af9660-d12c-40fc-bacb-7455567d242f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:52.122205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af9660-d12c-40fc-bacb-7455567d242f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:52.122485 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af9660-d12c-40fc-bacb-7455567d242f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:52.133461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:52.134216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af9660-d12c-40fc-bacb-7455567d242f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:52.135817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af9660-d12c-40fc-bacb-7455567d242f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:52.154266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-18af9660-d12c-40fc-bacb-7455567d242f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:52.154266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:52.154266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:52.154266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:52.154266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:52.154266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:52.154266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:52.154266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:52.154266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:52.154266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:52.154266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:52.154266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:52.154266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:52.154266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:52.154266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:52.155209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:52.155209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:52.155209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:52.155209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:52.155209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:52.155209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:52.155209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:52.155209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:52.155209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:52.155209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:52.155209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:52.155209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:52.155209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:52.155209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:52.155209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:52.155209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:52.155209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:52.156127 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:52.156127 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:52.156127 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:52.156127 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:52.156127 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 529/1066] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:52.161374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af9660-d12c-40fc-bacb-7455567d242f None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:52.230780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248ea3c-3ed7-4825-a676-0f184bf10b06 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:52.265550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af9660-d12c-40fc-bacb-7455567d242f None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:52.267902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a29c25-5b5b-4d10-8624-8d55bd8c59c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:52.268565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a29c25-5b5b-4d10-8624-8d55bd8c59c9 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:52.268878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a29c25-5b5b-4d10-8624-8d55bd8c59c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:52.269157 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a29c25-5b5b-4d10-8624-8d55bd8c59c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:52.305111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528ccae-8d30-44ed-9763-53cc5b86e235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:52.306892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528ccae-8d30-44ed-9763-53cc5b86e235 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:52.307184 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528ccae-8d30-44ed-9763-53cc5b86e235 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:52.307466 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528ccae-8d30-44ed-9763-53cc5b86e235 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:52.308212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528ccae-8d30-44ed-9763-53cc5b86e235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:52.308505 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528ccae-8d30-44ed-9763-53cc5b86e235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:52.309980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528ccae-8d30-44ed-9763-53cc5b86e235 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:52.319833 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:52.330112 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 530/1067] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:52.331055 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528ccae-8d30-44ed-9763-53cc5b86e235 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:52.342211 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a29c25-5b5b-4d10-8624-8d55bd8c59c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:52.343673 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a29c25-5b5b-4d10-8624-8d55bd8c59c9 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:52.358395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:52.436239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528ccae-8d30-44ed-9763-53cc5b86e235 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:52.448071 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 538/1068] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:02:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:02:52.454656 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a29c25-5b5b-4d10-8624-8d55bd8c59c9 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:52.479996 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c56c8f-c824-4a70-a3fd-0c657996f865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:52.480839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c56c8f-c824-4a70-a3fd-0c657996f865 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:52.481130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c56c8f-c824-4a70-a3fd-0c657996f865 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:52.481410 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c56c8f-c824-4a70-a3fd-0c657996f865 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:52.490333 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c56c8f-c824-4a70-a3fd-0c657996f865 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:52.491790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c56c8f-c824-4a70-a3fd-0c657996f865 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:52.505853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-27c56c8f-c824-4a70-a3fd-0c657996f865 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 21:02:52.505853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:52.505853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:52.505853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:52.505853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:52.505853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:52.505853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:52.505853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:52.505853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:52.505853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:52.505853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:52.505853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:52.505853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:02:52.505853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:02:52.505853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:02:52.505853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:02:52.506840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:52.506840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:52.506840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:02:52.506840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:52.506840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:02:52.506840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:52.506840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:52.506840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:52.506840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:52.506840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:52.506840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:52.506840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:52.506840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:52.506840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:52.506840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:52.506840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:52.506840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:52.506840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:52.508463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:52.508463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:52.508463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:02:52.508463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:02:52.508463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:02:52.508463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:02:52.508463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:02:52.508463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:02:52.508463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 21:02:52.508463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:52.508463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 531/1069] 10.222.0.66 () {56 vars in 1093 bytes} [Thu May 26 21:02:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:52.513692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c56c8f-c824-4a70-a3fd-0c657996f865 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:52.563596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a29c25-5b5b-4d10-8624-8d55bd8c59c9 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:52.577432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:52.583574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:52.602810 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9a839-426d-4c39-8583-bce7066f5f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:52.603632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9a839-426d-4c39-8583-bce7066f5f98 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:52.604099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9a839-426d-4c39-8583-bce7066f5f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:52.604213 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9a839-426d-4c39-8583-bce7066f5f98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:52.615268 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9a839-426d-4c39-8583-bce7066f5f98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:52.616797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9a839-426d-4c39-8583-bce7066f5f98 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:52.628180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c56c8f-c824-4a70-a3fd-0c657996f865 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:52.636988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-38d9a839-426d-4c39-8583-bce7066f5f98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:52.636988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:52.636988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:52.636988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:52.636988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:52.636988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:52.636988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:52.636988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:52.636988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:52.636988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:52.636988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:52.636988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:52.636988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:52.636988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:52.636988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:52.637896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:52.637896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:52.637896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:52.637896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:52.637896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:52.637896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:52.637896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:52.637896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:52.637896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:52.637896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:52.637896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:52.637896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:52.637896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:52.637896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:52.637896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:52.637896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:52.637896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:52.638785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:52.638785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:52.638785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:52.638785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:52.638785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 539/1070] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:52.639933 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db1669-5acc-41c4-beca-0de68e4fc98f None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:52.640221 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db1669-5acc-41c4-beca-0de68e4fc98f None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:52.640498 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db1669-5acc-41c4-beca-0de68e4fc98f None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:52.642076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 540/1071] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:52.644054 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db1669-5acc-41c4-beca-0de68e4fc98f None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:52.667395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237228e2-af2e-4168-82bf-f9dcaaf7224d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:52.668064 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237228e2-af2e-4168-82bf-f9dcaaf7224d None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:52.668345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237228e2-af2e-4168-82bf-f9dcaaf7224d None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:52.668652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237228e2-af2e-4168-82bf-f9dcaaf7224d None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:52.669497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237228e2-af2e-4168-82bf-f9dcaaf7224d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:52.669811 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237228e2-af2e-4168-82bf-f9dcaaf7224d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:52.671227 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237228e2-af2e-4168-82bf-f9dcaaf7224d None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:52.688928 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 532/1072] 10.222.0.66 () {56 vars in 1133 bytes} [Thu May 26 21:02:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:52.690173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da708a-1e36-4cac-8263-fea2437f582c None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:52.690490 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da708a-1e36-4cac-8263-fea2437f582c None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:52.690753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da708a-1e36-4cac-8263-fea2437f582c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:52.706799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-a8da708a-1e36-4cac-8263-fea2437f582c None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:52.707987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a8da708a-1e36-4cac-8263-fea2437f582c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:52.748666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db1669-5acc-41c4-beca-0de68e4fc98f None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:52.772801 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 533/1073] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:52.773638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da708a-1e36-4cac-8263-fea2437f582c None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:52.785163 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f83471-9340-430d-8c62-9b4f944ed0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:52.785829 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f83471-9340-430d-8c62-9b4f944ed0db None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:52.786114 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f83471-9340-430d-8c62-9b4f944ed0db None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:52.786392 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f83471-9340-430d-8c62-9b4f944ed0db None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:52.787122 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f83471-9340-430d-8c62-9b4f944ed0db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:52.787420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f83471-9340-430d-8c62-9b4f944ed0db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:52.788806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f83471-9340-430d-8c62-9b4f944ed0db None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:52.800452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 541/1074] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:52.801274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f83471-9340-430d-8c62-9b4f944ed0db None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:52.824860 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:52.836853 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:52.886825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da708a-1e36-4cac-8263-fea2437f582c None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:52.919621 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f83471-9340-430d-8c62-9b4f944ed0db None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:52.925289 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2436731-464f-471a-b33d-99a07aa2cf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:52.926495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2436731-464f-471a-b33d-99a07aa2cf6d None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:52.927014 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2436731-464f-471a-b33d-99a07aa2cf6d None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:52.927558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2436731-464f-471a-b33d-99a07aa2cf6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:52.940202 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2436731-464f-471a-b33d-99a07aa2cf6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:52.941800 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2436731-464f-471a-b33d-99a07aa2cf6d None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:52.959323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3179adb-ef70-45fe-a459-9cc47677e0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:52.960131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3179adb-ef70-45fe-a459-9cc47677e0fd None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:52.960416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3179adb-ef70-45fe-a459-9cc47677e0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:52.960723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3179adb-ef70-45fe-a459-9cc47677e0fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:52.962497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-f2436731-464f-471a-b33d-99a07aa2cf6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:52.962497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:52.962497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:52.962497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:52.962497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:52.962497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:52.962497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:52.962497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:52.962497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:52.962497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:52.962497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:52.962497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:52.962497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:52.962497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:52.962497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:52.963467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:52.963467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:52.963467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:52.963467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:52.963467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:52.963467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:52.963467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:52.963467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:52.963467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:52.963467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:52.963467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:52.963467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:52.963467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:52.963467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:52.963467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:52.963467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:52.963467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:52.964421 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:52.964421 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:52.964421 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:52.964421 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:52.964421 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 534/1075] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:52.969774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2436731-464f-471a-b33d-99a07aa2cf6d None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:52.976001 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3179adb-ef70-45fe-a459-9cc47677e0fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:52.985780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-f3179adb-ef70-45fe-a459-9cc47677e0fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:02:52.985780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:52.985780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:52.985780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:52.985780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:52.985780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:52.985780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:52.985780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:52.985780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:52.985780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:52.985780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:52.985780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:52.985780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:52.985780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:52.985780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:52.985780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:52.986746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:52.986746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:52.986746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:52.986746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:52.986746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:52.986746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:52.986746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:52.986746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:52.986746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:52.986746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:52.986746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:52.986746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:52.986746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:52.986746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:52.986746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:52.986746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:52.987590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:52.987590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:52.987590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:52.987590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:52.987590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:52.987590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:52.987590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:52.987590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:52.987590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:52.987590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:52.987590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:02:52.987590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:52.987590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 542/1076] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:02:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:52.993188 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3179adb-ef70-45fe-a459-9cc47677e0fd None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:53.089981 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:53.093951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2436731-464f-471a-b33d-99a07aa2cf6d None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:53.101061 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:53.118518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3179adb-ef70-45fe-a459-9cc47677e0fd None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:53.132094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2a2d9-9207-4d00-9396-9f1d1935e77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:53.132946 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2a2d9-9207-4d00-9396-9f1d1935e77c None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:53.133618 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2a2d9-9207-4d00-9396-9f1d1935e77c None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:53.133951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2a2d9-9207-4d00-9396-9f1d1935e77c None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:53.134851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2a2d9-9207-4d00-9396-9f1d1935e77c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:53.135167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2a2d9-9207-4d00-9396-9f1d1935e77c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:53.136552 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2a2d9-9207-4d00-9396-9f1d1935e77c None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:53.148101 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 535/1077] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:53.153530 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2a2d9-9207-4d00-9396-9f1d1935e77c None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:53.153761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfb6f8-b9bb-46b5-98e2-9c0b9c595535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:53.154431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfb6f8-b9bb-46b5-98e2-9c0b9c595535 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:53.154713 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfb6f8-b9bb-46b5-98e2-9c0b9c595535 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:53.155049 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfb6f8-b9bb-46b5-98e2-9c0b9c595535 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:53.155797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bfb6f8-b9bb-46b5-98e2-9c0b9c595535 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:53.156156 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bfb6f8-b9bb-46b5-98e2-9c0b9c595535 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:53.157547 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bfb6f8-b9bb-46b5-98e2-9c0b9c595535 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:53.171026 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 543/1078] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:02:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:53.171972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfb6f8-b9bb-46b5-98e2-9c0b9c595535 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:53.250864 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2a2d9-9207-4d00-9396-9f1d1935e77c None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:53.270926 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfb6f8-b9bb-46b5-98e2-9c0b9c595535 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:53.283873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331833b5-5f31-4f91-bea5-0e1d5b6d234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:53.284693 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331833b5-5f31-4f91-bea5-0e1d5b6d234f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:53.284981 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331833b5-5f31-4f91-bea5-0e1d5b6d234f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:53.285260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331833b5-5f31-4f91-bea5-0e1d5b6d234f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:53.292299 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331833b5-5f31-4f91-bea5-0e1d5b6d234f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:53.293784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331833b5-5f31-4f91-bea5-0e1d5b6d234f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:53.303641 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54da61-ded2-4e23-98f6-ae9a2858baac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:53.304509 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54da61-ded2-4e23-98f6-ae9a2858baac None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:53.304819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54da61-ded2-4e23-98f6-ae9a2858baac None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:53.305096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54da61-ded2-4e23-98f6-ae9a2858baac None admin] PATH_INFO: `/v3/users/6ca87714b2264b0ab989dea8ae8ae45b` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:53.306279 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54da61-ded2-4e23-98f6-ae9a2858baac None admin] RBAC: Authorizing `identity:get_user(user_id=6ca87714b2264b0ab989dea8ae8ae45b)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:53.308644 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54da61-ded2-4e23-98f6-ae9a2858baac None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:53.308843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-331833b5-5f31-4f91-bea5-0e1d5b6d234f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:53.308843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:53.308843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:53.308843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:53.308843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:53.308843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:53.308843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:53.308843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:53.308843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:53.308843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:53.308843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:53.308843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:53.308843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:53.308843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:53.308843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:53.309712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:53.309712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:53.309712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:53.309712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:53.309712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:53.309712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:53.309712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:53.309712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:53.309712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:53.309712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:53.309712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:53.309712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:53.309712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:53.309712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:53.309712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:53.309712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:53.309712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:53.310589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:53.310589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:53.310589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:53.310589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:53.310589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:53.310589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:53.310589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:53.310589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:53.310589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 536/1079] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:53.311073 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 544/1080] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:02:53 2022] GET /identity/v3/users/6ca87714b2264b0ab989dea8ae8ae45b => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:53.315639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331833b5-5f31-4f91-bea5-0e1d5b6d234f None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:53.315760 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54da61-ded2-4e23-98f6-ae9a2858baac None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:53.331232 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:53.334287 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:53.412173 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54da61-ded2-4e23-98f6-ae9a2858baac None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:53.412383 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331833b5-5f31-4f91-bea5-0e1d5b6d234f None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:53.445971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b832c-af3d-4329-8051-7e08b3135bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:53.446627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b832c-af3d-4329-8051-7e08b3135bcd None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:53.446914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b832c-af3d-4329-8051-7e08b3135bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:53.447191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b832c-af3d-4329-8051-7e08b3135bcd None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:53.448004 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b832c-af3d-4329-8051-7e08b3135bcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:53.448317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b832c-af3d-4329-8051-7e08b3135bcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:53.448516 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c43943-6bf0-4502-bc2e-22cd0d5357b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:53.449403 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c43943-6bf0-4502-bc2e-22cd0d5357b9 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:53.449684 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c43943-6bf0-4502-bc2e-22cd0d5357b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:53.449778 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b832c-af3d-4329-8051-7e08b3135bcd None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:53.449964 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c43943-6bf0-4502-bc2e-22cd0d5357b9 None admin] PATH_INFO: `/v3/projects/5a41b1be0f284d1caff356180fdcac76` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:53.451246 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c43943-6bf0-4502-bc2e-22cd0d5357b9 None admin] RBAC: Authorizing `identity:get_project(project_id=5a41b1be0f284d1caff356180fdcac76)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:53.452535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c43943-6bf0-4502-bc2e-22cd0d5357b9 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:53.454239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 537/1081] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:02:53 2022] GET /identity/v3/projects/5a41b1be0f284d1caff356180fdcac76 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:53.459972 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c43943-6bf0-4502-bc2e-22cd0d5357b9 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:53.467018 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 545/1082] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:02:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:53.468021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b832c-af3d-4329-8051-7e08b3135bcd None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:53.539683 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:53.542539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:53.559884 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c43943-6bf0-4502-bc2e-22cd0d5357b9 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:53.565532 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b832c-af3d-4329-8051-7e08b3135bcd None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:53.594111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e2d62-9269-4c51-816e-755c1e2ac5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:53.594996 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2d62-9269-4c51-816e-755c1e2ac5c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:53.595274 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2d62-9269-4c51-816e-755c1e2ac5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:53.595547 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2d62-9269-4c51-816e-755c1e2ac5c4 None admin] PATH_INFO: `/v3/projects/5a41b1be0f284d1caff356180fdcac76/users/6ca87714b2264b0ab989dea8ae8ae45b/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:53.597537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e2d62-9269-4c51-816e-755c1e2ac5c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a41b1be0f284d1caff356180fdcac76, user_id=6ca87714b2264b0ab989dea8ae8ae45b, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:53.598964 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e2d62-9269-4c51-816e-755c1e2ac5c4 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:53.600343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eed715-e302-4b5b-9796-b6db3d0d7d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:53.601271 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eed715-e302-4b5b-9796-b6db3d0d7d6e None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:53.601556 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eed715-e302-4b5b-9796-b6db3d0d7d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:53.601840 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eed715-e302-4b5b-9796-b6db3d0d7d6e None admin] PATH_INFO: `/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/df008eed25464be387741ee7a1e5ce80/roles/1a67a38c7559419081284aa53b1fdfaa` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:53.604929 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eed715-e302-4b5b-9796-b6db3d0d7d6e None admin] RBAC: Authorizing `identity:create_grant(project_id=a3db24bf0708446e9b05197fafeb00e4, user_id=df008eed25464be387741ee7a1e5ce80, role_id=1a67a38c7559419081284aa53b1fdfaa)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:53.606383 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eed715-e302-4b5b-9796-b6db3d0d7d6e None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:53.675492 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 538/1083] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:02:53 2022] PUT /identity/v3/projects/5a41b1be0f284d1caff356180fdcac76/users/6ca87714b2264b0ab989dea8ae8ae45b/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:02:53.699211 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 546/1084] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:02:53 2022] PUT /identity/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/df008eed25464be387741ee7a1e5ce80/roles/1a67a38c7559419081284aa53b1fdfaa => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:02:55.861578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c296da5-6351-4797-96df-ba44b57c9158 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:55.862129 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c296da5-6351-4797-96df-ba44b57c9158 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:55.862129 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c296da5-6351-4797-96df-ba44b57c9158 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:55.863399 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 539/1085] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:55.868602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5dac0-7e93-4dca-ab48-69c1e028809e None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:55.869530 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5dac0-7e93-4dca-ab48-69c1e028809e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:55.869674 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5dac0-7e93-4dca-ab48-69c1e028809e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:55.883598 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1373413-3c0b-43ac-999e-871cbee79663 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:55.883886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1373413-3c0b-43ac-999e-871cbee79663 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:55.884166 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1373413-3c0b-43ac-999e-871cbee79663 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:55.886093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 540/1086] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:02:55.886619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-1fe5dac0-7e93-4dca-ab48-69c1e028809e None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:55.887800 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1fe5dac0-7e93-4dca-ab48-69c1e028809e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:55.891084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a28ba-73d7-43a2-a5bd-5004ab566f48 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:55.891446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a28ba-73d7-43a2-a5bd-5004ab566f48 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:55.891735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a28ba-73d7-43a2-a5bd-5004ab566f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:55.907925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-941a28ba-73d7-43a2-a5bd-5004ab566f48 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:55.909208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-941a28ba-73d7-43a2-a5bd-5004ab566f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:55.954336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 547/1087] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:55.974532 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 541/1088] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:02:55.977361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5dac0-7e93-4dca-ab48-69c1e028809e None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:55.997796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a28ba-73d7-43a2-a5bd-5004ab566f48 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:56.039231 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:56.072100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:56.077935 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5dac0-7e93-4dca-ab48-69c1e028809e None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:56.094884 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a28ba-73d7-43a2-a5bd-5004ab566f48 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:56.111415 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5cc2d-7117-46d8-8abd-fcd8f2da2a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:56.127594 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5cc2d-7117-46d8-8abd-fcd8f2da2a83 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:56.127594 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5cc2d-7117-46d8-8abd-fcd8f2da2a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:56.127594 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5cc2d-7117-46d8-8abd-fcd8f2da2a83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:56.127594 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5cc2d-7117-46d8-8abd-fcd8f2da2a83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:56.128203 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47756223-b641-431e-9267-0417987fb5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:56.129037 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47756223-b641-431e-9267-0417987fb5bc None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:56.129324 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47756223-b641-431e-9267-0417987fb5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:56.129599 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47756223-b641-431e-9267-0417987fb5bc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:56.131000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-a2b5cc2d-7117-46d8-8abd-fcd8f2da2a83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:02:56.131000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:56.131000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:56.131000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:56.131000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:56.131000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:56.131000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:56.131000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:56.131000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:56.131000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:56.131000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:56.131000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:56.131000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:56.131000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:56.131000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:56.131000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:56.132031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:56.132031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:56.132031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:56.132031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:56.132031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:56.132031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:56.132031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:56.132031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:56.132031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:56.132031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:56.132031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:56.132031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:56.132031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:56.132031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:56.132031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:56.132031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:56.133295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:56.133295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:56.133295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:56.133295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:56.133295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:56.133295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:56.133295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:56.133295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:56.133295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:56.133295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:56.133295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:02:56.133295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:56.133295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 548/1089] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:02:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:56.138030 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5cc2d-7117-46d8-8abd-fcd8f2da2a83 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:56.143575 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47756223-b641-431e-9267-0417987fb5bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:02:56.152752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-47756223-b641-431e-9267-0417987fb5bc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 21:02:56.152752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:56.152752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:56.152752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:56.152752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:56.152752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:56.152752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:56.152752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:56.152752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:56.152752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:56.152752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:56.152752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:56.152752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:02:56.152752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:02:56.152752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:02:56.152752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:02:56.153788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:02:56.153788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:02:56.153788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:02:56.153788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:02:56.153788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:56.153788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:56.153788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:56.153788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:56.153788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:56.153788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:56.153788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:56.153788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:56.153788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:56.153788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:56.153788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:56.153788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:56.154634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:56.154634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:56.154634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:56.154634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:56.154634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:02:56.154634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:02:56.154634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:02:56.154634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:02:56.154634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:02:56.154634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:02:56.154634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 21:02:56.154634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:56.154634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 542/1090] 10.222.0.66 () {56 vars in 1120 bytes} [Thu May 26 21:02:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:56.159621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47756223-b641-431e-9267-0417987fb5bc None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:56.236750 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5cc2d-7117-46d8-8abd-fcd8f2da2a83 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:56.258115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47756223-b641-431e-9267-0417987fb5bc None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:56.259668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:56.270288 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e71a7-cfcd-47a2-a32d-af12a0af3b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:56.270972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e71a7-cfcd-47a2-a32d-af12a0af3b9f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:56.271243 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e71a7-cfcd-47a2-a32d-af12a0af3b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:56.271514 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e71a7-cfcd-47a2-a32d-af12a0af3b9f None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:56.272263 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e71a7-cfcd-47a2-a32d-af12a0af3b9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:56.272573 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e71a7-cfcd-47a2-a32d-af12a0af3b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:56.273998 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e71a7-cfcd-47a2-a32d-af12a0af3b9f None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:56.283297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 549/1091] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:02:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:56.289141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e71a7-cfcd-47a2-a32d-af12a0af3b9f None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:56.292355 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14323da6-d4a1-46f2-baf8-8bcb6c50fbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:56.293078 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14323da6-d4a1-46f2-baf8-8bcb6c50fbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:56.293365 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14323da6-d4a1-46f2-baf8-8bcb6c50fbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:56.293644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14323da6-d4a1-46f2-baf8-8bcb6c50fbc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:56.294394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14323da6-d4a1-46f2-baf8-8bcb6c50fbc9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:56.294702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14323da6-d4a1-46f2-baf8-8bcb6c50fbc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:56.296085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14323da6-d4a1-46f2-baf8-8bcb6c50fbc9 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:56.299990 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:56.307632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 543/1092] 10.222.0.66 () {56 vars in 1115 bytes} [Thu May 26 21:02:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:56.313240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14323da6-d4a1-46f2-baf8-8bcb6c50fbc9 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:56.389782 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e71a7-cfcd-47a2-a32d-af12a0af3b9f None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:56.410549 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14323da6-d4a1-46f2-baf8-8bcb6c50fbc9 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:56.424032 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a08627-6ee5-4d01-bb5d-1ca714766670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:56.424931 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a08627-6ee5-4d01-bb5d-1ca714766670 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:56.425209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a08627-6ee5-4d01-bb5d-1ca714766670 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:56.425479 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a08627-6ee5-4d01-bb5d-1ca714766670 None admin] PATH_INFO: `/v3/users/6ca87714b2264b0ab989dea8ae8ae45b` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:56.426673 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a08627-6ee5-4d01-bb5d-1ca714766670 None admin] RBAC: Authorizing `identity:get_user(user_id=6ca87714b2264b0ab989dea8ae8ae45b)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:56.428094 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a08627-6ee5-4d01-bb5d-1ca714766670 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:56.429742 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 550/1093] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:02:56 2022] GET /identity/v3/users/6ca87714b2264b0ab989dea8ae8ae45b => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:56.436228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a08627-6ee5-4d01-bb5d-1ca714766670 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:56.447790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249ff58-6559-4d27-80a8-8ec37a0586cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:56.448572 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249ff58-6559-4d27-80a8-8ec37a0586cf None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:56.448880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249ff58-6559-4d27-80a8-8ec37a0586cf None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:56.449156 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249ff58-6559-4d27-80a8-8ec37a0586cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:56.459092 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249ff58-6559-4d27-80a8-8ec37a0586cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:56.461878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249ff58-6559-4d27-80a8-8ec37a0586cf None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:56.478232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-9249ff58-6559-4d27-80a8-8ec37a0586cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:56.478232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:56.478232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:56.478232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:56.478232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:56.478232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:56.478232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:56.478232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:56.478232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:56.478232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:56.478232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:56.478232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:56.478232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:56.478232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:56.478232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:56.479939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:56.479939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:56.479939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:56.479939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:56.479939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:56.479939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:56.479939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:56.479939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:56.479939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:56.479939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:56.479939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:56.479939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:56.479939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:56.479939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:56.479939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:56.479939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:56.479939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:56.481080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:56.481080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:56.481080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:56.481080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:56.481080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 544/1094] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:56.485940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249ff58-6559-4d27-80a8-8ec37a0586cf None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:56.492763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:56.535610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:56.537071 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a08627-6ee5-4d01-bb5d-1ca714766670 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:56.571686 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630ec8f-4806-4eb8-92b5-5c5534d05726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:56.572409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630ec8f-4806-4eb8-92b5-5c5534d05726 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:56.572724 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630ec8f-4806-4eb8-92b5-5c5534d05726 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:56.573155 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630ec8f-4806-4eb8-92b5-5c5534d05726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:56.589872 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249ff58-6559-4d27-80a8-8ec37a0586cf None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:56.623031 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ecf87-d2fc-4d3f-bd8b-b9342dd82214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:56.623692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ecf87-d2fc-4d3f-bd8b-b9342dd82214 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:56.623975 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ecf87-d2fc-4d3f-bd8b-b9342dd82214 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:56.624251 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ecf87-d2fc-4d3f-bd8b-b9342dd82214 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:56.625008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ecf87-d2fc-4d3f-bd8b-b9342dd82214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:56.625322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ecf87-d2fc-4d3f-bd8b-b9342dd82214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:56.626691 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ecf87-d2fc-4d3f-bd8b-b9342dd82214 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:56.638635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 545/1095] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:56.641646 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630ec8f-4806-4eb8-92b5-5c5534d05726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:56.643102 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630ec8f-4806-4eb8-92b5-5c5534d05726 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:56.645704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ecf87-d2fc-4d3f-bd8b-b9342dd82214 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:56.697355 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:56.741830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 551/1096] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:02:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 21:02:56.744102 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ecf87-d2fc-4d3f-bd8b-b9342dd82214 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:56.747823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630ec8f-4806-4eb8-92b5-5c5534d05726 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:56.754757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:56.777978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e7ae9-83a9-4618-b56e-b3581ec5da46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:56.780087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e7ae9-83a9-4618-b56e-b3581ec5da46 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:56.780087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e7ae9-83a9-4618-b56e-b3581ec5da46 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:56.780087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e7ae9-83a9-4618-b56e-b3581ec5da46 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:56.786325 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e7ae9-83a9-4618-b56e-b3581ec5da46 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:56.787788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e7ae9-83a9-4618-b56e-b3581ec5da46 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:56.802896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-166e7ae9-83a9-4618-b56e-b3581ec5da46 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 21:02:56.802896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:56.802896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:56.802896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:56.802896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:56.802896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:56.802896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:56.802896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:56.802896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:56.802896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:56.802896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:56.802896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:56.802896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:02:56.802896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:02:56.802896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:02:56.802896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:02:56.803876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:56.803876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:56.803876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:02:56.803876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:56.803876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:02:56.803876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:02:56.803876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:56.803876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:56.803876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:56.803876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:56.803876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:56.803876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:02:56.803876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:56.803876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:56.803876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:56.803876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:56.803876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:56.803876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:56.804967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:56.804967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:56.804967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:02:56.804967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:02:56.804967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:02:56.804967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:02:56.804967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:02:56.804967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:02:56.804967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 21:02:56.804967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:02:56.804967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 546/1097] 10.222.0.66 () {56 vars in 1093 bytes} [Thu May 26 21:02:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:02:56.810109 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e7ae9-83a9-4618-b56e-b3581ec5da46 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:56.846789 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630ec8f-4806-4eb8-92b5-5c5534d05726 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:56.879180 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe65480-080b-4845-809f-b22229c8ead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:56.880041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe65480-080b-4845-809f-b22229c8ead1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:56.880325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe65480-080b-4845-809f-b22229c8ead1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:56.880621 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe65480-080b-4845-809f-b22229c8ead1 None admin] PATH_INFO: `/v3/projects/5a41b1be0f284d1caff356180fdcac76` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:56.881804 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe65480-080b-4845-809f-b22229c8ead1 None admin] RBAC: Authorizing `identity:get_project(project_id=5a41b1be0f284d1caff356180fdcac76)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:56.883247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe65480-080b-4845-809f-b22229c8ead1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:56.885510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 552/1098] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:02:56 2022] GET /identity/v3/projects/5a41b1be0f284d1caff356180fdcac76 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:56.891348 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe65480-080b-4845-809f-b22229c8ead1 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:56.907854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e7ae9-83a9-4618-b56e-b3581ec5da46 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:56.915020 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:56.941273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c0f00-8a83-4208-a51d-b55263cda421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:56.941943 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c0f00-8a83-4208-a51d-b55263cda421 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:56.942229 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c0f00-8a83-4208-a51d-b55263cda421 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:56.942512 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c0f00-8a83-4208-a51d-b55263cda421 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:56.943351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c0f00-8a83-4208-a51d-b55263cda421 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:56.943664 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c0f00-8a83-4208-a51d-b55263cda421 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:56.945142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c0f00-8a83-4208-a51d-b55263cda421 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:56.962211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 547/1099] 10.222.0.66 () {56 vars in 1133 bytes} [Thu May 26 21:02:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:56.968470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c0f00-8a83-4208-a51d-b55263cda421 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:56.992516 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe65480-080b-4845-809f-b22229c8ead1 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:56.995704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:57.027929 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64b140-f9cd-49fc-b2ad-e4184c109f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:57.028598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64b140-f9cd-49fc-b2ad-e4184c109f56 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:57.028891 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64b140-f9cd-49fc-b2ad-e4184c109f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:57.029167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64b140-f9cd-49fc-b2ad-e4184c109f56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:57.029993 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64b140-f9cd-49fc-b2ad-e4184c109f56 None admin] RBAC: Adding query filter params (role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.project.id=5a41b1be0f284d1caff356180fdcac76, user.id=6ca87714b2264b0ab989dea8ae8ae45b) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:57.030308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64b140-f9cd-49fc-b2ad-e4184c109f56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:57.031722 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64b140-f9cd-49fc-b2ad-e4184c109f56 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:57.037759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 553/1100] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:02:56 2022] GET /identity/v3/role_assignments?user.id=6ca87714b2264b0ab989dea8ae8ae45b&scope.project.id=5a41b1be0f284d1caff356180fdcac76&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:02:57.069091 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c0f00-8a83-4208-a51d-b55263cda421 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:57.105738 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25ebec-df1e-4d80-b4b8-80c973b31ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:57.106405 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25ebec-df1e-4d80-b4b8-80c973b31ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:57.106691 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25ebec-df1e-4d80-b4b8-80c973b31ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:57.106966 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25ebec-df1e-4d80-b4b8-80c973b31ab6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:57.176481 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25ebec-df1e-4d80-b4b8-80c973b31ab6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:57.177890 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25ebec-df1e-4d80-b4b8-80c973b31ab6 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:57.207756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:57.280147 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 548/1101] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:02:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:02:57.286199 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64b140-f9cd-49fc-b2ad-e4184c109f56 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:57.369943 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:57.384863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64b140-f9cd-49fc-b2ad-e4184c109f56 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:57.418700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4f6ec-d08f-456d-b5ed-cacecfcf3a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:57.419487 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4f6ec-d08f-456d-b5ed-cacecfcf3a7b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:57.419768 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4f6ec-d08f-456d-b5ed-cacecfcf3a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:57.420040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4f6ec-d08f-456d-b5ed-cacecfcf3a7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:57.430515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4f6ec-d08f-456d-b5ed-cacecfcf3a7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:57.432196 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4f6ec-d08f-456d-b5ed-cacecfcf3a7b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:57.448995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-42a4f6ec-d08f-456d-b5ed-cacecfcf3a7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:57.448995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:57.448995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:57.448995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:57.448995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:57.448995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:57.448995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:57.448995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:57.448995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:57.448995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:57.448995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:57.448995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:57.448995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:02:57.448995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:02:57.448995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:02:57.449923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:02:57.449923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:57.449923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:57.449923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:57.449923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:57.449923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:57.449923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:57.449923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:57.449923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:57.449923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:57.449923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:57.449923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:57.449923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:57.449923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:57.449923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:57.449923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:57.449923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:57.450991 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:02:57.450991 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:02:57.450991 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:02:57.450991 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:57.450991 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 554/1102] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:57.455756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25ebec-df1e-4d80-b4b8-80c973b31ab6 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:57.551387 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25ebec-df1e-4d80-b4b8-80c973b31ab6 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:57.582296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:57.590642 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c4480-7a38-4abd-88f7-5de873e24f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:57.591308 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c4480-7a38-4abd-88f7-5de873e24f96 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:57.591591 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c4480-7a38-4abd-88f7-5de873e24f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:57.591865 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c4480-7a38-4abd-88f7-5de873e24f96 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:57.592609 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c4480-7a38-4abd-88f7-5de873e24f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:57.592921 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c4480-7a38-4abd-88f7-5de873e24f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:57.594297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c4480-7a38-4abd-88f7-5de873e24f96 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:57.606850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 549/1103] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:57.612434 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4f6ec-d08f-456d-b5ed-cacecfcf3a7b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:57.710817 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4f6ec-d08f-456d-b5ed-cacecfcf3a7b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:57.743823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6614e-471a-4c11-a231-59ce9b3f6ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:57.744707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6614e-471a-4c11-a231-59ce9b3f6ccc None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:57.744996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6614e-471a-4c11-a231-59ce9b3f6ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:57.745274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6614e-471a-4c11-a231-59ce9b3f6ccc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:57.751833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6614e-471a-4c11-a231-59ce9b3f6ccc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:57.753303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6614e-471a-4c11-a231-59ce9b3f6ccc None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:57.754975 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:57.768146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-c7e6614e-471a-4c11-a231-59ce9b3f6ccc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:57.768146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:02:57.768146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:02:57.768146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:02:57.768146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:02:57.768146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:02:57.768146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:02:57.768146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:02:57.768146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:02:57.768146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:02:57.768146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:02:57.768146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:02:57.768146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:02:57.768146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:02:57.768146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:02:57.769069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:02:57.769069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:02:57.769069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:02:57.769069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:02:57.769069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:02:57.769069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:02:57.769069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:02:57.769069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:02:57.769069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:02:57.769069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:02:57.769069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:02:57.769069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:02:57.769069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:02:57.769069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:02:57.769069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:02:57.769069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:02:57.769069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:02:57.769953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:02:57.769953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:02:57.769953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:02:57.769953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:02:57.769953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:02:57.769953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:02:57.769953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:02:57.769953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:02:57.769953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 555/1104] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:02:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:02:57.775135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c4480-7a38-4abd-88f7-5de873e24f96 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:57.871537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c4480-7a38-4abd-88f7-5de873e24f96 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:57.905761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763c863-cbc2-41c5-ab57-37e2c0f655c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:57.906412 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763c863-cbc2-41c5-ab57-37e2c0f655c4 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:57.906694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763c863-cbc2-41c5-ab57-37e2c0f655c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:57.906968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763c863-cbc2-41c5-ab57-37e2c0f655c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:57.907746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763c863-cbc2-41c5-ab57-37e2c0f655c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:57.908059 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763c863-cbc2-41c5-ab57-37e2c0f655c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:57.909506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763c863-cbc2-41c5-ab57-37e2c0f655c4 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:57.920709 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 550/1105] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:02:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:57.926750 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6614e-471a-4c11-a231-59ce9b3f6ccc None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:58.023729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6614e-471a-4c11-a231-59ce9b3f6ccc None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:58.055580 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b1cf0-fbe3-49b3-8b00-179ccc727776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:58.056221 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b1cf0-fbe3-49b3-8b00-179ccc727776 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:58.057299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b1cf0-fbe3-49b3-8b00-179ccc727776 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:58.057576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b1cf0-fbe3-49b3-8b00-179ccc727776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:58.058399 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b1cf0-fbe3-49b3-8b00-179ccc727776 None admin] RBAC: Adding query filter params (role.id=1a67a38c7559419081284aa53b1fdfaa, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=df008eed25464be387741ee7a1e5ce80) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:02:58.058707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b1cf0-fbe3-49b3-8b00-179ccc727776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:58.060120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b1cf0-fbe3-49b3-8b00-179ccc727776 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:58.065944 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 556/1106] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:02:57 2022] GET /identity/v3/role_assignments?user.id=df008eed25464be387741ee7a1e5ce80&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=1a67a38c7559419081284aa53b1fdfaa => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:59.249527 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aaea6-b8da-4375-8e8c-d2d5343c0fc3 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:59.249527 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aaea6-b8da-4375-8e8c-d2d5343c0fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:59.250188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aaea6-b8da-4375-8e8c-d2d5343c0fc3 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:59.250975 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 551/1107] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:59.256079 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1247f-9ac4-428a-8768-dd2ac5c9049e None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:59.256487 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1247f-9ac4-428a-8768-dd2ac5c9049e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:59.256656 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1247f-9ac4-428a-8768-dd2ac5c9049e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:59.273575 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-3ac1247f-9ac4-428a-8768-dd2ac5c9049e None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:59.274751 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3ac1247f-9ac4-428a-8768-dd2ac5c9049e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:59.329089 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:59.339539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 557/1108] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:02:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:02:59.363925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aaea6-b8da-4375-8e8c-d2d5343c0fc3 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:59.412453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:59.461677 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aaea6-b8da-4375-8e8c-d2d5343c0fc3 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:59.492667 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b9ca7-8009-4181-b754-2bf964f8de77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:59.493391 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b9ca7-8009-4181-b754-2bf964f8de77 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:59.493667 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b9ca7-8009-4181-b754-2bf964f8de77 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:59.494443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b9ca7-8009-4181-b754-2bf964f8de77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:59.495591 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b9ca7-8009-4181-b754-2bf964f8de77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:59.497042 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b9ca7-8009-4181-b754-2bf964f8de77 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:59.498614 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 552/1109] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:02:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:02:59.504395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1247f-9ac4-428a-8768-dd2ac5c9049e None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:59.601328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1247f-9ac4-428a-8768-dd2ac5c9049e None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:59.633943 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd2c60-ce52-4489-8cd2-4867947da1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:59.635212 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd2c60-ce52-4489-8cd2-4867947da1af None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:59.635497 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd2c60-ce52-4489-8cd2-4867947da1af None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:59.635772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd2c60-ce52-4489-8cd2-4867947da1af None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:59.636479 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd2c60-ce52-4489-8cd2-4867947da1af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:59.637942 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd2c60-ce52-4489-8cd2-4867947da1af None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:59.731564 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 558/1110] 10.222.0.66 () {60 vars in 1132 bytes} [Thu May 26 21:02:59 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:03:01.944638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ae155-4a06-4e97-b307-0c047954c9d6 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:01.945161 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ae155-4a06-4e97-b307-0c047954c9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:01.945161 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ae155-4a06-4e97-b307-0c047954c9d6 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:01.946481 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 553/1111] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:03:01.951964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569a0b5-cbb3-4058-9aca-bca95683837d None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:01.952343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569a0b5-cbb3-4058-9aca-bca95683837d None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:01.952519 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569a0b5-cbb3-4058-9aca-bca95683837d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:01.970044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-8569a0b5-cbb3-4058-9aca-bca95683837d None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:03:01.971217 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8569a0b5-cbb3-4058-9aca-bca95683837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:03:02.012738 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:02.034944 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 559/1112] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:03:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:03:02.059038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ae155-4a06-4e97-b307-0c047954c9d6 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:02.156499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ae155-4a06-4e97-b307-0c047954c9d6 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:02.171996 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:02.188967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6849e4-f989-4eda-a3e9-6a342f991fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:02.189811 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6849e4-f989-4eda-a3e9-6a342f991fda None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:02.190100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6849e4-f989-4eda-a3e9-6a342f991fda None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:02.190374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6849e4-f989-4eda-a3e9-6a342f991fda None admin] PATH_INFO: `/v3/roles/d45da92733d441d7bfeeb10c762c6138` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:02.191826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6849e4-f989-4eda-a3e9-6a342f991fda None admin] RBAC: Authorizing `identity:get_role(role_id=d45da92733d441d7bfeeb10c762c6138)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:02.193223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6849e4-f989-4eda-a3e9-6a342f991fda None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:02.195039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 554/1113] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:03:02 2022] GET /identity/v3/roles/d45da92733d441d7bfeeb10c762c6138 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:02.200984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569a0b5-cbb3-4058-9aca-bca95683837d None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:02.295781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569a0b5-cbb3-4058-9aca-bca95683837d None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:02.328100 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a6711-1dd7-4ce3-b2f0-2701db10909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:02.328986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a6711-1dd7-4ce3-b2f0-2701db10909b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:02.329268 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a6711-1dd7-4ce3-b2f0-2701db10909b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:02.329539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a6711-1dd7-4ce3-b2f0-2701db10909b None admin] PATH_INFO: `/v3/users/a7158379789343b1b8a282c71396c1c8` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:02.342617 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a6711-1dd7-4ce3-b2f0-2701db10909b None admin] RBAC: Authorizing `identity:get_user(user_id=a7158379789343b1b8a282c71396c1c8)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:02.344040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a6711-1dd7-4ce3-b2f0-2701db10909b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:02.345690 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 560/1114] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:03:02 2022] GET /identity/v3/users/a7158379789343b1b8a282c71396c1c8 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:02.351435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6849e4-f989-4eda-a3e9-6a342f991fda None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:02.446546 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6849e4-f989-4eda-a3e9-6a342f991fda None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:02.478248 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe64c1-3398-417a-9b57-b1246c76c28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:02.478881 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe64c1-3398-417a-9b57-b1246c76c28a None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:02.479169 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe64c1-3398-417a-9b57-b1246c76c28a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:02.479451 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe64c1-3398-417a-9b57-b1246c76c28a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:02.528322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:02.542811 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe64c1-3398-417a-9b57-b1246c76c28a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:02.544247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe64c1-3398-417a-9b57-b1246c76c28a None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:02.639236 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 555/1115] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:03:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:03:02.645077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a6711-1dd7-4ce3-b2f0-2701db10909b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:02.677356 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:02.739024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a6711-1dd7-4ce3-b2f0-2701db10909b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:02.772148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3593a-bca1-4516-86c4-33b728a5b1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:02.773029 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3593a-bca1-4516-86c4-33b728a5b1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:02.773317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3593a-bca1-4516-86c4-33b728a5b1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:02.773595 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3593a-bca1-4516-86c4-33b728a5b1d5 None admin] PATH_INFO: `/v3/projects/5a41b1be0f284d1caff356180fdcac76` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:02.774761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3593a-bca1-4516-86c4-33b728a5b1d5 None admin] RBAC: Authorizing `identity:get_project(project_id=5a41b1be0f284d1caff356180fdcac76)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:02.776184 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3593a-bca1-4516-86c4-33b728a5b1d5 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:02.777888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 561/1116] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:03:02 2022] GET /identity/v3/projects/5a41b1be0f284d1caff356180fdcac76 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:02.783761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe64c1-3398-417a-9b57-b1246c76c28a None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:02.863632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:02.878954 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe64c1-3398-417a-9b57-b1246c76c28a None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:02.911529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1495d2-1bcf-4f42-9bf7-04820d77e4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:02.912198 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1495d2-1bcf-4f42-9bf7-04820d77e4fd None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:02.912478 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1495d2-1bcf-4f42-9bf7-04820d77e4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:02.912787 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1495d2-1bcf-4f42-9bf7-04820d77e4fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:02.913610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1495d2-1bcf-4f42-9bf7-04820d77e4fd None admin] RBAC: Adding query filter params (role.id=d45da92733d441d7bfeeb10c762c6138, scope.project.id=5a41b1be0f284d1caff356180fdcac76, user.id=a7158379789343b1b8a282c71396c1c8) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:03:02.913919 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1495d2-1bcf-4f42-9bf7-04820d77e4fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:02.915353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1495d2-1bcf-4f42-9bf7-04820d77e4fd None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:02.921196 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 556/1117] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:03:02 2022] GET /identity/v3/role_assignments?user.id=a7158379789343b1b8a282c71396c1c8&scope.project.id=5a41b1be0f284d1caff356180fdcac76&role.id=d45da92733d441d7bfeeb10c762c6138 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:05.072610 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2afd09-08ef-47dc-890a-12ed24f833e6 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:05.073167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2afd09-08ef-47dc-890a-12ed24f833e6 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:05.073167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2afd09-08ef-47dc-890a-12ed24f833e6 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:05.074535 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 562/1118] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:03:05.079670 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc880de-694b-4681-b909-59533a0e63b6 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:05.080088 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc880de-694b-4681-b909-59533a0e63b6 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:05.080235 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc880de-694b-4681-b909-59533a0e63b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:05.097053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-6bc880de-694b-4681-b909-59533a0e63b6 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:03:05.098230 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-6bc880de-694b-4681-b909-59533a0e63b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:03:05.161713 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 557/1119] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:03:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:03:05.184037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2afd09-08ef-47dc-890a-12ed24f833e6 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:05.281383 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2afd09-08ef-47dc-890a-12ed24f833e6 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:05.283656 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:05.313174 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa04a2-baf7-4083-9948-3637a1b12adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:05.314079 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa04a2-baf7-4083-9948-3637a1b12adb None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:05.314354 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa04a2-baf7-4083-9948-3637a1b12adb None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:05.314621 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa04a2-baf7-4083-9948-3637a1b12adb None admin] PATH_INFO: `/v3/roles/d45da92733d441d7bfeeb10c762c6138` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:05.316064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa04a2-baf7-4083-9948-3637a1b12adb None admin] RBAC: Authorizing `identity:get_role(role_id=d45da92733d441d7bfeeb10c762c6138)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:05.317443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa04a2-baf7-4083-9948-3637a1b12adb None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:05.318795 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 563/1120] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:03:05 2022] GET /identity/v3/roles/d45da92733d441d7bfeeb10c762c6138 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:05.325233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc880de-694b-4681-b909-59533a0e63b6 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:05.397637 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:05.418399 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc880de-694b-4681-b909-59533a0e63b6 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:05.451230 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b02d83-c695-4e6f-8f65-5b8a553ff3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:05.452081 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b02d83-c695-4e6f-8f65-5b8a553ff3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:05.452355 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b02d83-c695-4e6f-8f65-5b8a553ff3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:05.452653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b02d83-c695-4e6f-8f65-5b8a553ff3b1 None admin] PATH_INFO: `/v3/users/a7158379789343b1b8a282c71396c1c8` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:05.453932 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b02d83-c695-4e6f-8f65-5b8a553ff3b1 None admin] RBAC: Authorizing `identity:get_user(user_id=a7158379789343b1b8a282c71396c1c8)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:05.455349 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b02d83-c695-4e6f-8f65-5b8a553ff3b1 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:05.456962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 558/1121] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:03:05 2022] GET /identity/v3/users/a7158379789343b1b8a282c71396c1c8 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:05.462662 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa04a2-baf7-4083-9948-3637a1b12adb None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:05.558312 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa04a2-baf7-4083-9948-3637a1b12adb None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:05.591452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b8e7b-b195-4d9f-8336-b0f93f1a8a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:05.592246 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b8e7b-b195-4d9f-8336-b0f93f1a8a30 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:05.592531 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b8e7b-b195-4d9f-8336-b0f93f1a8a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:05.592839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b8e7b-b195-4d9f-8336-b0f93f1a8a30 None admin] PATH_INFO: `/v3/projects/5a41b1be0f284d1caff356180fdcac76` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:05.594007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b8e7b-b195-4d9f-8336-b0f93f1a8a30 None admin] RBAC: Authorizing `identity:get_project(project_id=5a41b1be0f284d1caff356180fdcac76)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:05.595430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b8e7b-b195-4d9f-8336-b0f93f1a8a30 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:05.597151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 564/1122] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:03:05 2022] GET /identity/v3/projects/5a41b1be0f284d1caff356180fdcac76 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:05.602975 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b02d83-c695-4e6f-8f65-5b8a553ff3b1 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:05.696421 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b02d83-c695-4e6f-8f65-5b8a553ff3b1 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:05.728545 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6165c8-6b2f-4450-8b50-8ac7f6047a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:05.729448 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6165c8-6b2f-4450-8b50-8ac7f6047a06 None admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:05.729724 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6165c8-6b2f-4450-8b50-8ac7f6047a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:05.729994 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6165c8-6b2f-4450-8b50-8ac7f6047a06 None admin] PATH_INFO: `/v3/projects/5a41b1be0f284d1caff356180fdcac76/users/a7158379789343b1b8a282c71396c1c8/roles/d45da92733d441d7bfeeb10c762c6138` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:05.732119 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6165c8-6b2f-4450-8b50-8ac7f6047a06 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a41b1be0f284d1caff356180fdcac76, user_id=a7158379789343b1b8a282c71396c1c8, role_id=d45da92733d441d7bfeeb10c762c6138)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:05.734953 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6165c8-6b2f-4450-8b50-8ac7f6047a06 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:05.816594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 559/1123] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:03:05 2022] PUT /identity/v3/projects/5a41b1be0f284d1caff356180fdcac76/users/a7158379789343b1b8a282c71396c1c8/roles/d45da92733d441d7bfeeb10c762c6138 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:03:07.949219 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f881556-16af-4fb6-9a2a-2b9128ed18d7 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:07.949725 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f881556-16af-4fb6-9a2a-2b9128ed18d7 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:07.949725 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f881556-16af-4fb6-9a2a-2b9128ed18d7 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:07.951063 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 565/1124] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:03:07.956393 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ec068-2a37-47d9-bf7f-ad3b8c3a602f None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:07.956834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ec068-2a37-47d9-bf7f-ad3b8c3a602f None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:07.956978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ec068-2a37-47d9-bf7f-ad3b8c3a602f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:07.968321 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:07.973878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-d06ec068-2a37-47d9-bf7f-ad3b8c3a602f None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:03:07.975041 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d06ec068-2a37-47d9-bf7f-ad3b8c3a602f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:03:08.037846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 560/1125] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:03:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:03:08.062108 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f881556-16af-4fb6-9a2a-2b9128ed18d7 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:08.104097 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:08.159849 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f881556-16af-4fb6-9a2a-2b9128ed18d7 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:08.193815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc30bf-6136-4a99-98c1-570534f240e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:08.194658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc30bf-6136-4a99-98c1-570534f240e5 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:08.194939 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc30bf-6136-4a99-98c1-570534f240e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:08.195212 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc30bf-6136-4a99-98c1-570534f240e5 None admin] PATH_INFO: `/v3/roles/d45da92733d441d7bfeeb10c762c6138` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:08.196708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc30bf-6136-4a99-98c1-570534f240e5 None admin] RBAC: Authorizing `identity:get_role(role_id=d45da92733d441d7bfeeb10c762c6138)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:08.198107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc30bf-6136-4a99-98c1-570534f240e5 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:08.199502 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 566/1126] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:03:08 2022] GET /identity/v3/roles/d45da92733d441d7bfeeb10c762c6138 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:08.205169 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ec068-2a37-47d9-bf7f-ad3b8c3a602f None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:08.299559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ec068-2a37-47d9-bf7f-ad3b8c3a602f None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:08.332361 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966616cb-067d-46c8-8ffb-d812b4adef79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:08.333240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966616cb-067d-46c8-8ffb-d812b4adef79 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:08.333525 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966616cb-067d-46c8-8ffb-d812b4adef79 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:08.333800 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966616cb-067d-46c8-8ffb-d812b4adef79 None admin] PATH_INFO: `/v3/users/a7158379789343b1b8a282c71396c1c8` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:08.334975 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966616cb-067d-46c8-8ffb-d812b4adef79 None admin] RBAC: Authorizing `identity:get_user(user_id=a7158379789343b1b8a282c71396c1c8)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:08.336407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966616cb-067d-46c8-8ffb-d812b4adef79 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:08.338064 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 561/1127] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:03:08 2022] GET /identity/v3/users/a7158379789343b1b8a282c71396c1c8 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:08.343761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc30bf-6136-4a99-98c1-570534f240e5 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:08.439656 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc30bf-6136-4a99-98c1-570534f240e5 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:08.448738 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:08.472128 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001d4b5-d48f-4980-9508-55af4ee46376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:08.472738 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001d4b5-d48f-4980-9508-55af4ee46376 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:08.473021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001d4b5-d48f-4980-9508-55af4ee46376 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:08.473294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001d4b5-d48f-4980-9508-55af4ee46376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:08.537237 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001d4b5-d48f-4980-9508-55af4ee46376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:08.538684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001d4b5-d48f-4980-9508-55af4ee46376 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:08.633035 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 567/1128] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:03:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:03:08.638886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966616cb-067d-46c8-8ffb-d812b4adef79 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:08.642605 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:08.734537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966616cb-067d-46c8-8ffb-d812b4adef79 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:08.765542 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6f9ff-6a70-4bf2-9f4e-9ac80976a5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:08.766387 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6f9ff-6a70-4bf2-9f4e-9ac80976a5fd None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:08.766669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6f9ff-6a70-4bf2-9f4e-9ac80976a5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:08.766943 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6f9ff-6a70-4bf2-9f4e-9ac80976a5fd None admin] PATH_INFO: `/v3/projects/5a41b1be0f284d1caff356180fdcac76` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:08.768105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6f9ff-6a70-4bf2-9f4e-9ac80976a5fd None admin] RBAC: Authorizing `identity:get_project(project_id=5a41b1be0f284d1caff356180fdcac76)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:08.769555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6f9ff-6a70-4bf2-9f4e-9ac80976a5fd None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:08.771208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 562/1129] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:03:08 2022] GET /identity/v3/projects/5a41b1be0f284d1caff356180fdcac76 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:08.777729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001d4b5-d48f-4980-9508-55af4ee46376 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:08.787533 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:08.873445 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001d4b5-d48f-4980-9508-55af4ee46376 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:08.906318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb79df-4f47-40a7-917a-780928b34a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:08.906964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb79df-4f47-40a7-917a-780928b34a7d None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:08.907248 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb79df-4f47-40a7-917a-780928b34a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:08.907525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb79df-4f47-40a7-917a-780928b34a7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:08.908358 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb79df-4f47-40a7-917a-780928b34a7d None admin] RBAC: Adding query filter params (role.id=d45da92733d441d7bfeeb10c762c6138, scope.project.id=5a41b1be0f284d1caff356180fdcac76, user.id=a7158379789343b1b8a282c71396c1c8) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:03:08.908702 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb79df-4f47-40a7-917a-780928b34a7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:08.910128 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb79df-4f47-40a7-917a-780928b34a7d None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:08.915869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 568/1130] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:03:08 2022] GET /identity/v3/role_assignments?user.id=a7158379789343b1b8a282c71396c1c8&scope.project.id=5a41b1be0f284d1caff356180fdcac76&role.id=d45da92733d441d7bfeeb10c762c6138 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:11.122537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dd0d6-bdb0-438c-89f4-b605b74b5adf None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:11.123096 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dd0d6-bdb0-438c-89f4-b605b74b5adf None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:11.123096 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dd0d6-bdb0-438c-89f4-b605b74b5adf None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:11.124461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 563/1131] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:03:11.129640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdc24f-ee77-47b6-8848-53a28e3b3f7e None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:11.130021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdc24f-ee77-47b6-8848-53a28e3b3f7e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:11.130205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdc24f-ee77-47b6-8848-53a28e3b3f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:11.147008 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-85fdc24f-ee77-47b6-8848-53a28e3b3f7e None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:03:11.148187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-85fdc24f-ee77-47b6-8848-53a28e3b3f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:03:11.213599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 569/1132] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:03:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:03:11.237046 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dd0d6-bdb0-438c-89f4-b605b74b5adf None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:11.306697 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:11.335470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dd0d6-bdb0-438c-89f4-b605b74b5adf None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:11.367961 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561adc8-e18f-4283-9ee8-915815dbce94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:11.368792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561adc8-e18f-4283-9ee8-915815dbce94 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:11.369078 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561adc8-e18f-4283-9ee8-915815dbce94 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:11.369355 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561adc8-e18f-4283-9ee8-915815dbce94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:11.370536 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561adc8-e18f-4283-9ee8-915815dbce94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:11.371965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561adc8-e18f-4283-9ee8-915815dbce94 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:11.373680 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 564/1133] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:03:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:11.379445 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdc24f-ee77-47b6-8848-53a28e3b3f7e None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:11.381662 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:11.475882 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdc24f-ee77-47b6-8848-53a28e3b3f7e None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:11.508198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc921491-7d9a-4b51-ab15-f365324206d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:11.509487 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc921491-7d9a-4b51-ab15-f365324206d2 None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:11.509774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc921491-7d9a-4b51-ab15-f365324206d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:11.510050 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc921491-7d9a-4b51-ab15-f365324206d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:11.510762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc921491-7d9a-4b51-ab15-f365324206d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:11.512190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc921491-7d9a-4b51-ab15-f365324206d2 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:11.624759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 570/1134] 10.222.0.66 () {60 vars in 1141 bytes} [Thu May 26 21:03:11 2022] POST /identity/v3/projects => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:03:13.814788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcabc1-9955-4fa7-bff8-1c5ce2a5e2db None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:13.815353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcabc1-9955-4fa7-bff8-1c5ce2a5e2db None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:13.815353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcabc1-9955-4fa7-bff8-1c5ce2a5e2db None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:13.816651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 565/1135] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:03:13.822403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb0826-5516-4c77-b8a8-cabf47cf0602 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:13.822807 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb0826-5516-4c77-b8a8-cabf47cf0602 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:13.822951 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb0826-5516-4c77-b8a8-cabf47cf0602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:13.839853 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-f2bb0826-5516-4c77-b8a8-cabf47cf0602 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:03:13.841054 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f2bb0826-5516-4c77-b8a8-cabf47cf0602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:03:13.887891 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:13.904025 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 571/1136] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:03:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:03:13.928182 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcabc1-9955-4fa7-bff8-1c5ce2a5e2db None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:14.026203 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcabc1-9955-4fa7-bff8-1c5ce2a5e2db None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:14.058552 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fd246-1d01-4ed2-b5f4-6baab4c4e21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:14.059328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fd246-1d01-4ed2-b5f4-6baab4c4e21c None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:14.059610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fd246-1d01-4ed2-b5f4-6baab4c4e21c None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:14.059883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fd246-1d01-4ed2-b5f4-6baab4c4e21c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:14.061077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fd246-1d01-4ed2-b5f4-6baab4c4e21c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:14.062511 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fd246-1d01-4ed2-b5f4-6baab4c4e21c None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:14.064097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 566/1137] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:03:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:14.069788 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb0826-5516-4c77-b8a8-cabf47cf0602 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:14.164647 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb0826-5516-4c77-b8a8-cabf47cf0602 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:14.197464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee5017-19c5-46cd-9932-00a1a8c4491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:14.198121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee5017-19c5-46cd-9932-00a1a8c4491d None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:14.198406 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee5017-19c5-46cd-9932-00a1a8c4491d None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:14.198681 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee5017-19c5-46cd-9932-00a1a8c4491d None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:14.199420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee5017-19c5-46cd-9932-00a1a8c4491d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:14.200828 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee5017-19c5-46cd-9932-00a1a8c4491d None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:14.280268 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 572/1138] 10.222.0.66 () {60 vars in 1132 bytes} [Thu May 26 21:03:14 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:03:16.481093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9958a-477d-46e7-945e-459dbb9f5607 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:16.481661 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9958a-477d-46e7-945e-459dbb9f5607 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:16.481661 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9958a-477d-46e7-945e-459dbb9f5607 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:16.483006 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 567/1139] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:03:16.488138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e394ce5-dd93-45f5-8bcf-de01478faa89 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:16.488526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e394ce5-dd93-45f5-8bcf-de01478faa89 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:16.488729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e394ce5-dd93-45f5-8bcf-de01478faa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:16.505885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-5e394ce5-dd93-45f5-8bcf-de01478faa89 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:03:16.507099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-5e394ce5-dd93-45f5-8bcf-de01478faa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:03:16.540737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:16.573118 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 573/1140] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:03:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 21:03:16.596439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9958a-477d-46e7-945e-459dbb9f5607 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:16.607566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:16.693746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9958a-477d-46e7-945e-459dbb9f5607 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:16.725652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034c3bb-e04c-4239-801f-3eebcf7c7b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:16.726430 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034c3bb-e04c-4239-801f-3eebcf7c7b11 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:16.726714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034c3bb-e04c-4239-801f-3eebcf7c7b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:16.726987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034c3bb-e04c-4239-801f-3eebcf7c7b11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:16.739721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034c3bb-e04c-4239-801f-3eebcf7c7b11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:03:16.745069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-8034c3bb-e04c-4239-801f-3eebcf7c7b11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:03:16.745069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:03:16.745069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:03:16.745069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:03:16.745069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:03:16.745069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:03:16.745069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:03:16.745069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:03:16.745069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:03:16.745069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:03:16.745069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:03:16.745069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:03:16.745069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:03:16.745069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:03:16.745069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:03:16.745069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:03:16.746167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:03:16.746167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:03:16.746167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:03:16.746167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:03:16.746167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:03:16.746167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:03:16.746167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:03:16.746167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:03:16.746167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:03:16.746167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:03:16.746167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:03:16.746167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:03:16.746167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:03:16.746167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:03:16.746167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:03:16.746167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:03:16.747239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:03:16.747239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:03:16.747239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:03:16.747239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:03:16.747239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:03:16.747239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:03:16.747239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:03:16.747239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:03:16.747239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:03:16.747239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:03:16.747239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:03:16.747239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:03:16.747239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 568/1141] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:03:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:03:16.752368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e394ce5-dd93-45f5-8bcf-de01478faa89 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:16.846696 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e394ce5-dd93-45f5-8bcf-de01478faa89 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:16.879060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802801e-56b9-4a93-a0bb-da223f505318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:16.879717 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802801e-56b9-4a93-a0bb-da223f505318 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:16.879998 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802801e-56b9-4a93-a0bb-da223f505318 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:16.880276 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802801e-56b9-4a93-a0bb-da223f505318 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:16.881045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802801e-56b9-4a93-a0bb-da223f505318 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:03:16.881350 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802801e-56b9-4a93-a0bb-da223f505318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:16.882704 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802801e-56b9-4a93-a0bb-da223f505318 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:16.890410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 574/1142] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:03:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:16.896085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034c3bb-e04c-4239-801f-3eebcf7c7b11 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:16.959909 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:16.991771 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034c3bb-e04c-4239-801f-3eebcf7c7b11 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:17.023133 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a03151-65b0-4d50-95ad-0eda08673469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:17.023983 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a03151-65b0-4d50-95ad-0eda08673469 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:17.024824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a03151-65b0-4d50-95ad-0eda08673469 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:17.025099 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a03151-65b0-4d50-95ad-0eda08673469 None admin] PATH_INFO: `/v3/users/4b78ab3a4dba45eca52d7ba4b7f9d801` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:17.037698 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a03151-65b0-4d50-95ad-0eda08673469 None admin] RBAC: Authorizing `identity:get_user(user_id=4b78ab3a4dba45eca52d7ba4b7f9d801)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:17.039157 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a03151-65b0-4d50-95ad-0eda08673469 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:17.041444 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 569/1143] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:03:16 2022] GET /identity/v3/users/4b78ab3a4dba45eca52d7ba4b7f9d801 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:17.047121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802801e-56b9-4a93-a0bb-da223f505318 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:17.078557 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:17.144887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802801e-56b9-4a93-a0bb-da223f505318 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:17.177680 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84297d-7d2a-44c4-b218-a4f7618a327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:17.178318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84297d-7d2a-44c4-b218-a4f7618a327f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:17.178602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84297d-7d2a-44c4-b218-a4f7618a327f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:17.178879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84297d-7d2a-44c4-b218-a4f7618a327f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:17.243507 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84297d-7d2a-44c4-b218-a4f7618a327f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:17.244904 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84297d-7d2a-44c4-b218-a4f7618a327f None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:17.274007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:17.341357 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 575/1144] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:03:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 21:03:17.347220 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a03151-65b0-4d50-95ad-0eda08673469 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:17.442036 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a03151-65b0-4d50-95ad-0eda08673469 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:17.467093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:17.474986 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5be13c-27c8-4aa2-9ed5-294106b5f79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:17.475830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5be13c-27c8-4aa2-9ed5-294106b5f79e None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:17.476112 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5be13c-27c8-4aa2-9ed5-294106b5f79e None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:17.476388 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5be13c-27c8-4aa2-9ed5-294106b5f79e None admin] PATH_INFO: `/v3/projects/f7ad9787702f4f0a8080bfe17495e772` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:17.477614 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5be13c-27c8-4aa2-9ed5-294106b5f79e None admin] RBAC: Authorizing `identity:get_project(project_id=f7ad9787702f4f0a8080bfe17495e772)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:17.479042 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5be13c-27c8-4aa2-9ed5-294106b5f79e None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:17.480728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 570/1145] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:03:17 2022] GET /identity/v3/projects/f7ad9787702f4f0a8080bfe17495e772 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:17.486709 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84297d-7d2a-44c4-b218-a4f7618a327f None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:17.582099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84297d-7d2a-44c4-b218-a4f7618a327f None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:17.610026 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:17.614780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358df792-af80-4202-84bd-4bf4bddb0756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:17.615434 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358df792-af80-4202-84bd-4bf4bddb0756 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:17.615721 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358df792-af80-4202-84bd-4bf4bddb0756 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:17.615993 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358df792-af80-4202-84bd-4bf4bddb0756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:17.616850 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358df792-af80-4202-84bd-4bf4bddb0756 None admin] RBAC: Adding query filter params (role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.project.id=f7ad9787702f4f0a8080bfe17495e772, user.id=4b78ab3a4dba45eca52d7ba4b7f9d801) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:03:17.617170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358df792-af80-4202-84bd-4bf4bddb0756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:17.619095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358df792-af80-4202-84bd-4bf4bddb0756 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:17.624355 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 576/1146] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:03:17 2022] GET /identity/v3/role_assignments?user.id=4b78ab3a4dba45eca52d7ba4b7f9d801&scope.project.id=f7ad9787702f4f0a8080bfe17495e772&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:19.774634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea8a26-0578-4129-aa25-c18f5dc6d919 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:19.775189 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea8a26-0578-4129-aa25-c18f5dc6d919 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:19.775189 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea8a26-0578-4129-aa25-c18f5dc6d919 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:19.776533 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 571/1147] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:03:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:03:19.781704 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfd8f9-0003-468a-8ebc-eeca6dd84cda None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:19.782104 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfd8f9-0003-468a-8ebc-eeca6dd84cda None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:19.782262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfd8f9-0003-468a-8ebc-eeca6dd84cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:19.799134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-79cfd8f9-0003-468a-8ebc-eeca6dd84cda None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:03:19.800319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-79cfd8f9-0003-468a-8ebc-eeca6dd84cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:03:19.866118 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 577/1148] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:03:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:03:19.888710 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea8a26-0578-4129-aa25-c18f5dc6d919 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:19.985527 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea8a26-0578-4129-aa25-c18f5dc6d919 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:20.016852 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005f218-dd0e-4a88-97c1-c18936ef5637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:20.017628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005f218-dd0e-4a88-97c1-c18936ef5637 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:20.017912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005f218-dd0e-4a88-97c1-c18936ef5637 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:20.018188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005f218-dd0e-4a88-97c1-c18936ef5637 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:20.028298 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005f218-dd0e-4a88-97c1-c18936ef5637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:03:20.035791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-8005f218-dd0e-4a88-97c1-c18936ef5637 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:03:20.035791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:03:20.035791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:03:20.035791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:03:20.035791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:03:20.035791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:03:20.035791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:03:20.035791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:03:20.035791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:03:20.035791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:03:20.035791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:03:20.035791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:03:20.035791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:03:20.035791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:03:20.035791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:03:20.035791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:03:20.036901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:03:20.036901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:03:20.036901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:03:20.036901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:03:20.036901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:03:20.036901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:03:20.036901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:03:20.036901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:03:20.036901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:03:20.036901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:03:20.036901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:03:20.036901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:03:20.036901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:03:20.036901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:03:20.036901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:03:20.036901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:03:20.037790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:03:20.037790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:03:20.037790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:03:20.037790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:03:20.037790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:03:20.037790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:03:20.037790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:03:20.037790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:03:20.037790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:03:20.037790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:03:20.037790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:03:20.037790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:03:20.037790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 572/1149] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:03:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:03:20.043427 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfd8f9-0003-468a-8ebc-eeca6dd84cda None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:20.138252 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfd8f9-0003-468a-8ebc-eeca6dd84cda None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:20.164220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:20.172513 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf2473-beff-42ed-ac2d-ebd7c3db4513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:20.173202 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf2473-beff-42ed-ac2d-ebd7c3db4513 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:20.173486 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf2473-beff-42ed-ac2d-ebd7c3db4513 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:20.173762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf2473-beff-42ed-ac2d-ebd7c3db4513 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:20.174502 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf2473-beff-42ed-ac2d-ebd7c3db4513 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:03:20.174810 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf2473-beff-42ed-ac2d-ebd7c3db4513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:20.176201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf2473-beff-42ed-ac2d-ebd7c3db4513 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:20.184164 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 578/1150] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:03:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:20.189992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005f218-dd0e-4a88-97c1-c18936ef5637 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:20.243715 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:20.287377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005f218-dd0e-4a88-97c1-c18936ef5637 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:20.319360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d548e4d-611a-45c2-878c-d8be863b67a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:20.320223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548e4d-611a-45c2-878c-d8be863b67a8 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:20.320506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548e4d-611a-45c2-878c-d8be863b67a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:20.320810 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548e4d-611a-45c2-878c-d8be863b67a8 None admin] PATH_INFO: `/v3/users/4b78ab3a4dba45eca52d7ba4b7f9d801` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:20.321987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d548e4d-611a-45c2-878c-d8be863b67a8 None admin] RBAC: Authorizing `identity:get_user(user_id=4b78ab3a4dba45eca52d7ba4b7f9d801)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:20.324111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d548e4d-611a-45c2-878c-d8be863b67a8 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:20.325782 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 573/1151] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:03:20 2022] GET /identity/v3/users/4b78ab3a4dba45eca52d7ba4b7f9d801 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:20.331470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf2473-beff-42ed-ac2d-ebd7c3db4513 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:20.428353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf2473-beff-42ed-ac2d-ebd7c3db4513 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:20.461737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21aa5c3-69f3-4e31-89eb-5c73fb25a36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:20.462579 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aa5c3-69f3-4e31-89eb-5c73fb25a36f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:20.462861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aa5c3-69f3-4e31-89eb-5c73fb25a36f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:20.463164 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aa5c3-69f3-4e31-89eb-5c73fb25a36f None admin] PATH_INFO: `/v3/projects/f7ad9787702f4f0a8080bfe17495e772` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:20.464331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21aa5c3-69f3-4e31-89eb-5c73fb25a36f None admin] RBAC: Authorizing `identity:get_project(project_id=f7ad9787702f4f0a8080bfe17495e772)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:20.465780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21aa5c3-69f3-4e31-89eb-5c73fb25a36f None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:20.467439 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 579/1152] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:03:20 2022] GET /identity/v3/projects/f7ad9787702f4f0a8080bfe17495e772 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:20.473439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d548e4d-611a-45c2-878c-d8be863b67a8 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:20.569244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d548e4d-611a-45c2-878c-d8be863b67a8 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:20.591010 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:20.601808 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f380c8d-e8de-42e1-b049-08bb3757fd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:20.610019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f380c8d-e8de-42e1-b049-08bb3757fd3b None admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:20.610019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f380c8d-e8de-42e1-b049-08bb3757fd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:20.610019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f380c8d-e8de-42e1-b049-08bb3757fd3b None admin] PATH_INFO: `/v3/projects/f7ad9787702f4f0a8080bfe17495e772/users/4b78ab3a4dba45eca52d7ba4b7f9d801/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:20.610019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f380c8d-e8de-42e1-b049-08bb3757fd3b None admin] RBAC: Authorizing `identity:create_grant(project_id=f7ad9787702f4f0a8080bfe17495e772, user_id=4b78ab3a4dba45eca52d7ba4b7f9d801, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:20.610019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f380c8d-e8de-42e1-b049-08bb3757fd3b None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:20.655761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 574/1153] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:03:20 2022] PUT /identity/v3/projects/f7ad9787702f4f0a8080bfe17495e772/users/4b78ab3a4dba45eca52d7ba4b7f9d801/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:03:22.808395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a770e9-0055-42a8-b0bc-b24ccefa1c45 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:22.809014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a770e9-0055-42a8-b0bc-b24ccefa1c45 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:22.809014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a770e9-0055-42a8-b0bc-b24ccefa1c45 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:22.810342 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 580/1154] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:03:22.815648 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56889d-f3ee-4499-8052-e3709b6e4c3c None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:22.816033 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56889d-f3ee-4499-8052-e3709b6e4c3c None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:22.816206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56889d-f3ee-4499-8052-e3709b6e4c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:22.832492 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-9f56889d-f3ee-4499-8052-e3709b6e4c3c None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:03:22.833694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-9f56889d-f3ee-4499-8052-e3709b6e4c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:03:22.897512 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 575/1155] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:03:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:03:22.922072 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a770e9-0055-42a8-b0bc-b24ccefa1c45 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:22.976882 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:23.020179 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a770e9-0055-42a8-b0bc-b24ccefa1c45 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:23.052770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc2ce8-5156-4170-bc82-2d9f22fd08f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:23.053544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc2ce8-5156-4170-bc82-2d9f22fd08f7 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:23.053824 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc2ce8-5156-4170-bc82-2d9f22fd08f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:23.054097 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc2ce8-5156-4170-bc82-2d9f22fd08f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:23.067000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc2ce8-5156-4170-bc82-2d9f22fd08f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:03:23.078222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-49bc2ce8-5156-4170-bc82-2d9f22fd08f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:03:23.078222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:03:23.078222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:03:23.078222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:03:23.078222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:03:23.078222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:03:23.078222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:03:23.078222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:03:23.078222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:03:23.078222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:03:23.078222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:03:23.078222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:03:23.078222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:03:23.078222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:03:23.078222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:03:23.078222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:03:23.079404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:03:23.079404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:03:23.079404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:03:23.079404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:03:23.079404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:03:23.079404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:03:23.079404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:03:23.079404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:03:23.079404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:03:23.079404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:03:23.079404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:03:23.079404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:03:23.079404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:03:23.079404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:03:23.079404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:03:23.079404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:03:23.080238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:03:23.080238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:03:23.080238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:03:23.080238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:03:23.080238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:03:23.080238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:03:23.080238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:03:23.080238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:03:23.080238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:03:23.080238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:03:23.080238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:03:23.080238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:03:23.080238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 581/1156] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:03:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:03:23.085558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56889d-f3ee-4499-8052-e3709b6e4c3c None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:23.179516 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56889d-f3ee-4499-8052-e3709b6e4c3c None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:23.192512 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:23.213794 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d7271-0ebf-4c9b-98c3-5007d49faebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:23.214453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d7271-0ebf-4c9b-98c3-5007d49faebe None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:23.214738 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d7271-0ebf-4c9b-98c3-5007d49faebe None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:23.215077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d7271-0ebf-4c9b-98c3-5007d49faebe None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:23.215821 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d7271-0ebf-4c9b-98c3-5007d49faebe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:03:23.216128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d7271-0ebf-4c9b-98c3-5007d49faebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:23.217535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d7271-0ebf-4c9b-98c3-5007d49faebe None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:23.225307 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 576/1157] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:03:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:23.231231 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc2ce8-5156-4170-bc82-2d9f22fd08f7 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:23.326372 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc2ce8-5156-4170-bc82-2d9f22fd08f7 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:23.342719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:23.359392 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6def0-0f2b-4f86-982c-7c3b93b56860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:23.360249 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6def0-0f2b-4f86-982c-7c3b93b56860 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:23.360529 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6def0-0f2b-4f86-982c-7c3b93b56860 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:23.360827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6def0-0f2b-4f86-982c-7c3b93b56860 None admin] PATH_INFO: `/v3/users/4b78ab3a4dba45eca52d7ba4b7f9d801` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:23.361978 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6def0-0f2b-4f86-982c-7c3b93b56860 None admin] RBAC: Authorizing `identity:get_user(user_id=4b78ab3a4dba45eca52d7ba4b7f9d801)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:23.363424 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6def0-0f2b-4f86-982c-7c3b93b56860 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:23.365049 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 582/1158] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:03:23 2022] GET /identity/v3/users/4b78ab3a4dba45eca52d7ba4b7f9d801 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:23.370920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d7271-0ebf-4c9b-98c3-5007d49faebe None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:23.468263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d7271-0ebf-4c9b-98c3-5007d49faebe None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:23.500320 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2467708-2276-475c-b492-263b2c11e497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:23.500987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2467708-2276-475c-b492-263b2c11e497 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:23.501273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2467708-2276-475c-b492-263b2c11e497 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:23.501551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2467708-2276-475c-b492-263b2c11e497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:23.541399 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:23.566363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2467708-2276-475c-b492-263b2c11e497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:23.567814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2467708-2276-475c-b492-263b2c11e497 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:23.661131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 577/1159] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:03:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:03:23.667181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6def0-0f2b-4f86-982c-7c3b93b56860 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:23.762539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6def0-0f2b-4f86-982c-7c3b93b56860 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:23.794675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f11504-2626-433e-a674-ff2bf698a5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:23.795523 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f11504-2626-433e-a674-ff2bf698a5bf None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:23.795804 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f11504-2626-433e-a674-ff2bf698a5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:23.796105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f11504-2626-433e-a674-ff2bf698a5bf None admin] PATH_INFO: `/v3/projects/f7ad9787702f4f0a8080bfe17495e772` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:23.797276 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f11504-2626-433e-a674-ff2bf698a5bf None admin] RBAC: Authorizing `identity:get_project(project_id=f7ad9787702f4f0a8080bfe17495e772)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:23.798696 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f11504-2626-433e-a674-ff2bf698a5bf None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:23.800353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 583/1160] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:03:23 2022] GET /identity/v3/projects/f7ad9787702f4f0a8080bfe17495e772 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:23.807176 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2467708-2276-475c-b492-263b2c11e497 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:23.876871 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:23.900498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2467708-2276-475c-b492-263b2c11e497 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:23.933251 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae355f-149a-4cd0-bfcc-cb158da692c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:23.933827 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae355f-149a-4cd0-bfcc-cb158da692c7 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:23.934103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae355f-149a-4cd0-bfcc-cb158da692c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:23.934385 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae355f-149a-4cd0-bfcc-cb158da692c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:23.935190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae355f-149a-4cd0-bfcc-cb158da692c7 None admin] RBAC: Adding query filter params (role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.project.id=f7ad9787702f4f0a8080bfe17495e772, user.id=4b78ab3a4dba45eca52d7ba4b7f9d801) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:03:23.935496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae355f-149a-4cd0-bfcc-cb158da692c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:23.936931 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae355f-149a-4cd0-bfcc-cb158da692c7 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:23.942665 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 578/1161] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:03:23 2022] GET /identity/v3/role_assignments?user.id=4b78ab3a4dba45eca52d7ba4b7f9d801&scope.project.id=f7ad9787702f4f0a8080bfe17495e772&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:26.126841 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9b790-353f-4d40-93e1-c8716a9b3acd None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:26.127434 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9b790-353f-4d40-93e1-c8716a9b3acd None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:26.127434 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9b790-353f-4d40-93e1-c8716a9b3acd None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:26.128888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 584/1162] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:03:26.134147 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b29d70-fb59-446e-8b4b-9c9b06ea4821 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:26.135057 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b29d70-fb59-446e-8b4b-9c9b06ea4821 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:26.135226 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b29d70-fb59-446e-8b4b-9c9b06ea4821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:26.151957 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-56b29d70-fb59-446e-8b4b-9c9b06ea4821 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:03:26.153163 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-56b29d70-fb59-446e-8b4b-9c9b06ea4821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:03:26.217046 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 579/1163] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:03:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:03:26.239166 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9b790-353f-4d40-93e1-c8716a9b3acd None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:26.291619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:26.336862 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9b790-353f-4d40-93e1-c8716a9b3acd None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:26.370067 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9a6e9-5007-496d-8878-5e8b8bb73690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:26.370698 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9a6e9-5007-496d-8878-5e8b8bb73690 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:26.370976 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9a6e9-5007-496d-8878-5e8b8bb73690 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:26.371246 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9a6e9-5007-496d-8878-5e8b8bb73690 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:26.435491 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9a6e9-5007-496d-8878-5e8b8bb73690 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:26.436884 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9a6e9-5007-496d-8878-5e8b8bb73690 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:26.484615 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:26.532937 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 585/1164] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:03:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:03:26.538970 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b29d70-fb59-446e-8b4b-9c9b06ea4821 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:26.602484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:26.635580 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b29d70-fb59-446e-8b4b-9c9b06ea4821 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:26.667270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc4bb7-0e7d-45fa-88ba-166fb506874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:26.668067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc4bb7-0e7d-45fa-88ba-166fb506874f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:26.668351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc4bb7-0e7d-45fa-88ba-166fb506874f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:26.668653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc4bb7-0e7d-45fa-88ba-166fb506874f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:26.675111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc4bb7-0e7d-45fa-88ba-166fb506874f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:26.676572 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc4bb7-0e7d-45fa-88ba-166fb506874f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:26.691669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-f8fc4bb7-0e7d-45fa-88ba-166fb506874f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 21:03:26.691669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:03:26.691669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 21:03:26.691669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 21:03:26.691669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:03:26.691669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:03:26.691669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:03:26.691669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:03:26.691669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 21:03:26.691669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:03:26.691669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:03:26.691669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:03:26.691669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:03:26.691669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:03:26.691669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:03:26.691669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:03:26.691669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:03:26.692959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:03:26.692959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:03:26.692959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:03:26.692959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:03:26.692959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:03:26.692959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:03:26.692959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:03:26.692959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:03:26.692959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:03:26.692959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:03:26.692959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:03:26.692959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:03:26.692959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:03:26.692959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:03:26.692959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:03:26.692959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:03:26.694024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:03:26.694024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:03:26.694024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:03:26.694024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:03:26.694024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:03:26.694024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:03:26.694024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:03:26.694024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:03:26.694024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:03:26.694024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:03:26.694024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 21:03:26.694024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:03:26.694024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 21:03:26.694024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:03:26.694024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 580/1165] 10.222.0.66 () {56 vars in 1117 bytes} [Thu May 26 21:03:26 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:03:26.699485 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9a6e9-5007-496d-8878-5e8b8bb73690 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:26.792833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9a6e9-5007-496d-8878-5e8b8bb73690 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:26.825828 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b141e-0c1d-4c02-bf22-cffe24cc9da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:26.826479 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b141e-0c1d-4c02-bf22-cffe24cc9da5 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:26.826762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b141e-0c1d-4c02-bf22-cffe24cc9da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:26.827040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b141e-0c1d-4c02-bf22-cffe24cc9da5 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:26.827755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b141e-0c1d-4c02-bf22-cffe24cc9da5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:03:26.828062 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b141e-0c1d-4c02-bf22-cffe24cc9da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:26.829454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b141e-0c1d-4c02-bf22-cffe24cc9da5 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:26.836290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 586/1166] 10.222.0.66 () {56 vars in 1115 bytes} [Thu May 26 21:03:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:28.997225 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc2a6a-7680-4105-b4c4-e24b3ce5b72f None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:28.997759 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc2a6a-7680-4105-b4c4-e24b3ce5b72f None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:28.997759 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc2a6a-7680-4105-b4c4-e24b3ce5b72f None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:28.999153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 581/1167] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:03:29.004693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2cbce-e665-4745-a9ef-c0b1f723db70 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:29.005101 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2cbce-e665-4745-a9ef-c0b1f723db70 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:29.005243 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2cbce-e665-4745-a9ef-c0b1f723db70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:29.022729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-e4c2cbce-e665-4745-a9ef-c0b1f723db70 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:03:29.023893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e4c2cbce-e665-4745-a9ef-c0b1f723db70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:03:29.034128 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:29.086600 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 587/1168] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:03:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:03:29.110227 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc2a6a-7680-4105-b4c4-e24b3ce5b72f None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:29.208373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc2a6a-7680-4105-b4c4-e24b3ce5b72f None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:29.234561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:29.241985 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27cf45-d591-40bb-9d14-82b27892716f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:29.243624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27cf45-d591-40bb-9d14-82b27892716f None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:29.243624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27cf45-d591-40bb-9d14-82b27892716f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:29.243624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27cf45-d591-40bb-9d14-82b27892716f None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:29.244502 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27cf45-d591-40bb-9d14-82b27892716f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:29.245848 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27cf45-d591-40bb-9d14-82b27892716f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:29.331278 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 582/1169] 10.222.0.66 () {60 vars in 1138 bytes} [Thu May 26 21:03:29 2022] POST /identity/v3/domains => generated 267 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:03:31.535432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecbdee-0961-43d2-b29c-cd3f6c58d428 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:31.535966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecbdee-0961-43d2-b29c-cd3f6c58d428 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:31.535966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecbdee-0961-43d2-b29c-cd3f6c58d428 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:31.537384 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 588/1170] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:03:31.542990 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31da9f-7d49-46fa-b3fe-487faee6b56f None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:31.543473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31da9f-7d49-46fa-b3fe-487faee6b56f None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:31.543571 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31da9f-7d49-46fa-b3fe-487faee6b56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:31.560422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-8e31da9f-7d49-46fa-b3fe-487faee6b56f None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:03:31.565658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-8e31da9f-7d49-46fa-b3fe-487faee6b56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:03:31.630380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 583/1171] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:03:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:03:31.657115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecbdee-0961-43d2-b29c-cd3f6c58d428 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:31.764593 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecbdee-0961-43d2-b29c-cd3f6c58d428 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:31.800841 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba98dfa-04ec-4c4e-98f7-748d189fcbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:31.801628 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba98dfa-04ec-4c4e-98f7-748d189fcbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:31.801910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba98dfa-04ec-4c4e-98f7-748d189fcbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:31.802184 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba98dfa-04ec-4c4e-98f7-748d189fcbe1 None admin] PATH_INFO: `/v3/domains/b71e92698f784d8ca21e5587819b6f57` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:31.813208 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba98dfa-04ec-4c4e-98f7-748d189fcbe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b71e92698f784d8ca21e5587819b6f57)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:31.814640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba98dfa-04ec-4c4e-98f7-748d189fcbe1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:31.816269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 589/1172] 10.222.0.66 () {56 vars in 1183 bytes} [Thu May 26 21:03:31 2022] GET /identity/v3/domains/b71e92698f784d8ca21e5587819b6f57 => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:31.822205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31da9f-7d49-46fa-b3fe-487faee6b56f None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:31.917449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31da9f-7d49-46fa-b3fe-487faee6b56f None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:31.934107 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:31.950498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768e288-c208-44cd-b8b9-6d7fdd51ca45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:31.951154 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768e288-c208-44cd-b8b9-6d7fdd51ca45 None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:31.951440 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768e288-c208-44cd-b8b9-6d7fdd51ca45 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:31.951771 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768e288-c208-44cd-b8b9-6d7fdd51ca45 None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:31.952488 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768e288-c208-44cd-b8b9-6d7fdd51ca45 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:31.953956 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768e288-c208-44cd-b8b9-6d7fdd51ca45 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:32.016689 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 584/1173] 10.222.0.66 () {60 vars in 1141 bytes} [Thu May 26 21:03:31 2022] POST /identity/v3/projects => generated 361 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:03:34.233281 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5afe8-0f2e-446a-bfbf-abd403e38843 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:34.233849 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5afe8-0f2e-446a-bfbf-abd403e38843 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:34.233849 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5afe8-0f2e-446a-bfbf-abd403e38843 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:34.235203 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 590/1174] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:03:34.240482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf92d1-136d-4031-904b-b4f433cf503e None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:34.240966 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf92d1-136d-4031-904b-b4f433cf503e None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:34.241092 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf92d1-136d-4031-904b-b4f433cf503e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:34.257910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-a2cf92d1-136d-4031-904b-b4f433cf503e None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:03:34.259125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a2cf92d1-136d-4031-904b-b4f433cf503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:03:34.325039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 585/1175] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:03:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:03:34.350238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5afe8-0f2e-446a-bfbf-abd403e38843 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:34.359415 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:34.449136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5afe8-0f2e-446a-bfbf-abd403e38843 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:34.481461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fa1df-e25f-47c3-a6e7-42d70845ae49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:34.482304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fa1df-e25f-47c3-a6e7-42d70845ae49 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:34.482585 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fa1df-e25f-47c3-a6e7-42d70845ae49 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:34.482856 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fa1df-e25f-47c3-a6e7-42d70845ae49 None admin] PATH_INFO: `/v3/domains/b71e92698f784d8ca21e5587819b6f57` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:34.484058 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fa1df-e25f-47c3-a6e7-42d70845ae49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b71e92698f784d8ca21e5587819b6f57)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:34.485446 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fa1df-e25f-47c3-a6e7-42d70845ae49 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:34.487026 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 591/1176] 10.222.0.66 () {56 vars in 1183 bytes} [Thu May 26 21:03:34 2022] GET /identity/v3/domains/b71e92698f784d8ca21e5587819b6f57 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:34.492618 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf92d1-136d-4031-904b-b4f433cf503e None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:34.585500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:34.588984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf92d1-136d-4031-904b-b4f433cf503e None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:34.620943 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fd7c2-39bd-4b35-93d6-f0c9838f5300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:34.621600 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fd7c2-39bd-4b35-93d6-f0c9838f5300 None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:34.621880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fd7c2-39bd-4b35-93d6-f0c9838f5300 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:34.622152 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fd7c2-39bd-4b35-93d6-f0c9838f5300 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:34.622859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fd7c2-39bd-4b35-93d6-f0c9838f5300 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:34.624304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fd7c2-39bd-4b35-93d6-f0c9838f5300 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:34.712185 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 586/1177] 10.222.0.66 () {60 vars in 1132 bytes} [Thu May 26 21:03:34 2022] POST /identity/v3/users => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:03:36.926526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02adc5f-2d07-4848-8567-1dac92fd8ddf None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:36.927078 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02adc5f-2d07-4848-8567-1dac92fd8ddf None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:36.927078 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02adc5f-2d07-4848-8567-1dac92fd8ddf None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:36.928429 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 592/1178] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:03:36.934481 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524545fe-6add-4906-b9f3-6d9858d18527 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:36.934903 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524545fe-6add-4906-b9f3-6d9858d18527 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:36.935037 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524545fe-6add-4906-b9f3-6d9858d18527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:36.952015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-524545fe-6add-4906-b9f3-6d9858d18527 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:03:36.953232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-524545fe-6add-4906-b9f3-6d9858d18527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:03:37.017047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 587/1179] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:03:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:03:37.039934 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02adc5f-2d07-4848-8567-1dac92fd8ddf None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:37.112031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:37.136949 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02adc5f-2d07-4848-8567-1dac92fd8ddf None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:37.169167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa452f3f-8231-4dd4-be56-d5916211821c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:37.169949 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa452f3f-8231-4dd4-be56-d5916211821c None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:37.170226 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa452f3f-8231-4dd4-be56-d5916211821c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:37.170495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa452f3f-8231-4dd4-be56-d5916211821c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:37.180529 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa452f3f-8231-4dd4-be56-d5916211821c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:03:37.188512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-aa452f3f-8231-4dd4-be56-d5916211821c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:03:37.188512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:03:37.188512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:03:37.188512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:03:37.188512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:03:37.188512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:03:37.188512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:03:37.188512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:03:37.188512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:03:37.188512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:03:37.188512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:03:37.188512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:03:37.188512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:03:37.188512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:03:37.188512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:03:37.188512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:03:37.189640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:03:37.189640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:03:37.189640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:03:37.189640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:03:37.189640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:03:37.189640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:03:37.189640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:03:37.189640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:03:37.189640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:03:37.189640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:03:37.189640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:03:37.189640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:03:37.189640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:03:37.189640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:03:37.189640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:03:37.189640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:03:37.190860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:03:37.190860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:03:37.190860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:03:37.190860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:03:37.190860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:03:37.190860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:03:37.190860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:03:37.190860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:03:37.190860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:03:37.190860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:03:37.190860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:03:37.190860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:03:37.190860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 593/1180] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:03:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:03:37.195607 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524545fe-6add-4906-b9f3-6d9858d18527 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:37.275099 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:37.288858 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524545fe-6add-4906-b9f3-6d9858d18527 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:37.322786 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e22a0a-6469-4088-a545-7471c4b538f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:37.323436 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e22a0a-6469-4088-a545-7471c4b538f0 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:37.323716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e22a0a-6469-4088-a545-7471c4b538f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:37.323988 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e22a0a-6469-4088-a545-7471c4b538f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:37.324745 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e22a0a-6469-4088-a545-7471c4b538f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:03:37.325051 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e22a0a-6469-4088-a545-7471c4b538f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:37.326417 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e22a0a-6469-4088-a545-7471c4b538f0 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:37.334059 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 588/1181] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:03:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:37.339890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa452f3f-8231-4dd4-be56-d5916211821c None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:37.437540 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa452f3f-8231-4dd4-be56-d5916211821c None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:37.469019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2044a-dc44-434d-bad0-f86b21c7af74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:37.469913 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2044a-dc44-434d-bad0-f86b21c7af74 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:37.470162 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2044a-dc44-434d-bad0-f86b21c7af74 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:37.470440 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2044a-dc44-434d-bad0-f86b21c7af74 None admin] PATH_INFO: `/v3/users/f660ad858e724cea9369c70c96440673` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:37.472330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:37.484044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2044a-dc44-434d-bad0-f86b21c7af74 None admin] RBAC: Authorizing `identity:get_user(user_id=f660ad858e724cea9369c70c96440673)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:37.485510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2044a-dc44-434d-bad0-f86b21c7af74 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:37.487142 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 594/1182] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:03:37 2022] GET /identity/v3/users/f660ad858e724cea9369c70c96440673 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:37.492950 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e22a0a-6469-4088-a545-7471c4b538f0 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:37.588529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e22a0a-6469-4088-a545-7471c4b538f0 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:37.620659 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed70b9-6138-41b9-b5c4-7ec3941e41c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:37.621294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed70b9-6138-41b9-b5c4-7ec3941e41c9 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:37.621574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed70b9-6138-41b9-b5c4-7ec3941e41c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:37.621846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed70b9-6138-41b9-b5c4-7ec3941e41c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:37.638165 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:37.685847 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed70b9-6138-41b9-b5c4-7ec3941e41c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:37.687269 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed70b9-6138-41b9-b5c4-7ec3941e41c9 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:37.780417 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 589/1183] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:03:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:03:37.786278 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2044a-dc44-434d-bad0-f86b21c7af74 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:37.882124 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2044a-dc44-434d-bad0-f86b21c7af74 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:37.914755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6d031-048e-49ea-9c3c-9208f53416e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:37.915647 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6d031-048e-49ea-9c3c-9208f53416e2 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:37.915932 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6d031-048e-49ea-9c3c-9208f53416e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:37.916209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6d031-048e-49ea-9c3c-9208f53416e2 None admin] PATH_INFO: `/v3/projects/fce96ab781044bd1925edc63068560ad` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:37.917400 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6d031-048e-49ea-9c3c-9208f53416e2 None admin] RBAC: Authorizing `identity:get_project(project_id=fce96ab781044bd1925edc63068560ad)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:37.918827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6d031-048e-49ea-9c3c-9208f53416e2 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:37.920495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 595/1184] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:03:37 2022] GET /identity/v3/projects/fce96ab781044bd1925edc63068560ad => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:37.926423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed70b9-6138-41b9-b5c4-7ec3941e41c9 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:37.973304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:38.022867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed70b9-6138-41b9-b5c4-7ec3941e41c9 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:38.055126 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f283774-5913-4059-a460-a0fb81d19bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:38.055710 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f283774-5913-4059-a460-a0fb81d19bad None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:38.056530 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f283774-5913-4059-a460-a0fb81d19bad None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:38.056840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f283774-5913-4059-a460-a0fb81d19bad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:38.057665 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f283774-5913-4059-a460-a0fb81d19bad None admin] RBAC: Adding query filter params (role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.project.id=fce96ab781044bd1925edc63068560ad, user.id=f660ad858e724cea9369c70c96440673) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:03:38.057979 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f283774-5913-4059-a460-a0fb81d19bad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:38.059394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f283774-5913-4059-a460-a0fb81d19bad None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:38.064651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 590/1185] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:03:37 2022] GET /identity/v3/role_assignments?user.id=f660ad858e724cea9369c70c96440673&scope.project.id=fce96ab781044bd1925edc63068560ad&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:40.194755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760e71e-5fc1-4497-b829-0a75b02a4d8a None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:40.195331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760e71e-5fc1-4497-b829-0a75b02a4d8a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:40.195331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760e71e-5fc1-4497-b829-0a75b02a4d8a None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:40.196688 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 596/1186] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:03:40.201789 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f3289-09d0-4de5-a6d6-49ddad85623a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:40.202211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f3289-09d0-4de5-a6d6-49ddad85623a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:40.202355 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f3289-09d0-4de5-a6d6-49ddad85623a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:40.219029 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-922f3289-09d0-4de5-a6d6-49ddad85623a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:03:40.220197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-922f3289-09d0-4de5-a6d6-49ddad85623a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:03:40.283181 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 591/1187] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:03:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:03:40.306051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760e71e-5fc1-4497-b829-0a75b02a4d8a None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:40.364353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:40.404743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760e71e-5fc1-4497-b829-0a75b02a4d8a None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:40.436813 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b40b3-c582-4026-986e-9823ee19107a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:40.437590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b40b3-c582-4026-986e-9823ee19107a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:40.437877 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b40b3-c582-4026-986e-9823ee19107a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:40.438154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b40b3-c582-4026-986e-9823ee19107a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:40.448461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b40b3-c582-4026-986e-9823ee19107a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:03:40.455986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-325b40b3-c582-4026-986e-9823ee19107a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:03:40.455986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:03:40.455986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:03:40.455986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:03:40.455986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:03:40.455986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:03:40.455986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:03:40.455986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:03:40.455986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:03:40.455986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:03:40.455986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:03:40.455986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:03:40.455986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:03:40.455986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:03:40.455986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:03:40.455986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:03:40.457116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:03:40.457116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:03:40.457116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:03:40.457116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:03:40.457116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:03:40.457116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:03:40.457116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:03:40.457116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:03:40.457116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:03:40.457116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:03:40.457116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:03:40.457116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:03:40.457116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:03:40.457116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:03:40.457116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:03:40.457116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:03:40.458153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:03:40.458153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:03:40.458153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:03:40.458153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:03:40.458153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:03:40.458153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:03:40.458153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:03:40.458153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:03:40.458153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:03:40.458153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:03:40.458153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:03:40.458153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:03:40.458153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 597/1188] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:03:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:03:40.463599 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f3289-09d0-4de5-a6d6-49ddad85623a None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:40.503881 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:40.558481 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f3289-09d0-4de5-a6d6-49ddad85623a None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:40.591533 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377245e1-d389-4be4-bfac-fd774791b54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:40.592217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377245e1-d389-4be4-bfac-fd774791b54b None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:40.592496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377245e1-d389-4be4-bfac-fd774791b54b None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:40.592797 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377245e1-d389-4be4-bfac-fd774791b54b None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:40.593533 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377245e1-d389-4be4-bfac-fd774791b54b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:03:40.593839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377245e1-d389-4be4-bfac-fd774791b54b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:40.595204 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377245e1-d389-4be4-bfac-fd774791b54b None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:40.602869 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 592/1189] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:03:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:40.608722 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b40b3-c582-4026-986e-9823ee19107a None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:40.704832 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b40b3-c582-4026-986e-9823ee19107a None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:40.722981 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:40.736029 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d8b70-a81d-4bbb-99c1-73bf888706c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:40.736916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d8b70-a81d-4bbb-99c1-73bf888706c1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:40.737196 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d8b70-a81d-4bbb-99c1-73bf888706c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:40.737465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d8b70-a81d-4bbb-99c1-73bf888706c1 None admin] PATH_INFO: `/v3/users/f660ad858e724cea9369c70c96440673` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:40.738626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d8b70-a81d-4bbb-99c1-73bf888706c1 None admin] RBAC: Authorizing `identity:get_user(user_id=f660ad858e724cea9369c70c96440673)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:40.740025 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d8b70-a81d-4bbb-99c1-73bf888706c1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:40.741847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 598/1190] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:03:40 2022] GET /identity/v3/users/f660ad858e724cea9369c70c96440673 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:40.747813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377245e1-d389-4be4-bfac-fd774791b54b None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:40.842739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377245e1-d389-4be4-bfac-fd774791b54b None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:40.844992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:40.876074 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d745058-4871-4fd3-9275-2526de45188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:40.876957 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d745058-4871-4fd3-9275-2526de45188f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:40.877243 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d745058-4871-4fd3-9275-2526de45188f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:40.877523 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d745058-4871-4fd3-9275-2526de45188f None admin] PATH_INFO: `/v3/projects/fce96ab781044bd1925edc63068560ad` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:40.878687 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d745058-4871-4fd3-9275-2526de45188f None admin] RBAC: Authorizing `identity:get_project(project_id=fce96ab781044bd1925edc63068560ad)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:40.880122 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d745058-4871-4fd3-9275-2526de45188f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:40.881843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 593/1191] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:03:40 2022] GET /identity/v3/projects/fce96ab781044bd1925edc63068560ad => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:40.888199 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d8b70-a81d-4bbb-99c1-73bf888706c1 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:40.983023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d8b70-a81d-4bbb-99c1-73bf888706c1 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:41.015339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28084e4-29f6-4df2-94f4-2cff865081ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:41.016208 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28084e4-29f6-4df2-94f4-2cff865081ac None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:41.016489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28084e4-29f6-4df2-94f4-2cff865081ac None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:41.016791 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28084e4-29f6-4df2-94f4-2cff865081ac None admin] PATH_INFO: `/v3/projects/fce96ab781044bd1925edc63068560ad/users/f660ad858e724cea9369c70c96440673/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:41.018727 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28084e4-29f6-4df2-94f4-2cff865081ac None admin] RBAC: Authorizing `identity:create_grant(project_id=fce96ab781044bd1925edc63068560ad, user_id=f660ad858e724cea9369c70c96440673, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:41.020138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28084e4-29f6-4df2-94f4-2cff865081ac None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:41.100707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 599/1192] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:03:40 2022] PUT /identity/v3/projects/fce96ab781044bd1925edc63068560ad/users/f660ad858e724cea9369c70c96440673/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:03:43.243493 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfa188-5e9d-43c7-9822-aac5bb90bd6d None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:43.244031 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfa188-5e9d-43c7-9822-aac5bb90bd6d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:43.244031 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfa188-5e9d-43c7-9822-aac5bb90bd6d None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:43.245425 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 594/1193] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:03:43.250512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883119b3-69c5-4845-80b5-9802a145320f None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:43.250886 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883119b3-69c5-4845-80b5-9802a145320f None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:43.251068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883119b3-69c5-4845-80b5-9802a145320f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:43.267367 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-883119b3-69c5-4845-80b5-9802a145320f None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:03:43.268542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-883119b3-69c5-4845-80b5-9802a145320f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:03:43.310926 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:43.334130 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 600/1194] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:03:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:03:43.357842 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfa188-5e9d-43c7-9822-aac5bb90bd6d None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:43.454851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfa188-5e9d-43c7-9822-aac5bb90bd6d None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:43.487000 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f04cf8-50d9-4bb5-9c04-73d45743ba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:43.487780 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f04cf8-50d9-4bb5-9c04-73d45743ba73 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:43.488064 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f04cf8-50d9-4bb5-9c04-73d45743ba73 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:43.488340 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f04cf8-50d9-4bb5-9c04-73d45743ba73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:43.498091 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f04cf8-50d9-4bb5-9c04-73d45743ba73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:03:43.505635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-31f04cf8-50d9-4bb5-9c04-73d45743ba73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:03:43.505635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:03:43.505635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:03:43.505635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:03:43.505635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:03:43.505635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:03:43.505635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:03:43.505635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:03:43.505635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:03:43.505635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:03:43.505635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:03:43.505635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:03:43.505635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:03:43.505635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:03:43.505635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:03:43.505635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:03:43.506705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:03:43.506705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:03:43.506705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:03:43.506705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:03:43.506705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:03:43.506705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:03:43.506705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:03:43.506705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:03:43.506705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:03:43.506705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:03:43.506705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:03:43.506705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:03:43.506705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:03:43.506705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:03:43.506705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:03:43.506705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:03:43.507731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:03:43.507731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:03:43.507731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:03:43.507731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:03:43.507731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:03:43.507731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:03:43.507731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:03:43.507731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:03:43.507731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:03:43.507731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:03:43.507731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:03:43.507731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:03:43.507731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 595/1195] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:03:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:03:43.513542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883119b3-69c5-4845-80b5-9802a145320f None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:43.608691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883119b3-69c5-4845-80b5-9802a145320f None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:43.641130 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ac55f-7bff-44f9-82a4-2cb38f437ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:43.641796 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ac55f-7bff-44f9-82a4-2cb38f437ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:43.642081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ac55f-7bff-44f9-82a4-2cb38f437ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:43.642358 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ac55f-7bff-44f9-82a4-2cb38f437ca3 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:43.643099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ac55f-7bff-44f9-82a4-2cb38f437ca3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:03:43.643407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ac55f-7bff-44f9-82a4-2cb38f437ca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:43.644800 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ac55f-7bff-44f9-82a4-2cb38f437ca3 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:43.653106 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 601/1196] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:03:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:43.658943 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f04cf8-50d9-4bb5-9c04-73d45743ba73 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:43.689319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:43.755101 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f04cf8-50d9-4bb5-9c04-73d45743ba73 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:43.787242 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe5f8b-c805-4796-b390-1aaaf2698c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:43.788091 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe5f8b-c805-4796-b390-1aaaf2698c5c None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:43.788367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe5f8b-c805-4796-b390-1aaaf2698c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:43.788670 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe5f8b-c805-4796-b390-1aaaf2698c5c None admin] PATH_INFO: `/v3/users/f660ad858e724cea9369c70c96440673` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:43.789853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe5f8b-c805-4796-b390-1aaaf2698c5c None admin] RBAC: Authorizing `identity:get_user(user_id=f660ad858e724cea9369c70c96440673)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:43.791839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe5f8b-c805-4796-b390-1aaaf2698c5c None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:43.793443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 596/1197] 10.222.0.66 () {56 vars in 1177 bytes} [Thu May 26 21:03:43 2022] GET /identity/v3/users/f660ad858e724cea9369c70c96440673 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:43.799273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ac55f-7bff-44f9-82a4-2cb38f437ca3 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:43.840779 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:43.896081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ac55f-7bff-44f9-82a4-2cb38f437ca3 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:43.928924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4354f10-fee5-4de1-9573-b677483b1c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:43.929818 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4354f10-fee5-4de1-9573-b677483b1c72 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:43.930102 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4354f10-fee5-4de1-9573-b677483b1c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:43.930378 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4354f10-fee5-4de1-9573-b677483b1c72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:43.994459 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4354f10-fee5-4de1-9573-b677483b1c72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:43.995888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4354f10-fee5-4de1-9573-b677483b1c72 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:44.033739 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:44.091755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 602/1198] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:03:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:03:44.097523 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe5f8b-c805-4796-b390-1aaaf2698c5c None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:44.189322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:44.192210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe5f8b-c805-4796-b390-1aaaf2698c5c None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:44.224897 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4bb38-db0b-4f4c-bb95-e8c84ad7fa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:44.225739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4bb38-db0b-4f4c-bb95-e8c84ad7fa50 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:44.226020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4bb38-db0b-4f4c-bb95-e8c84ad7fa50 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:44.226295 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4bb38-db0b-4f4c-bb95-e8c84ad7fa50 None admin] PATH_INFO: `/v3/projects/fce96ab781044bd1925edc63068560ad` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:44.227495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4bb38-db0b-4f4c-bb95-e8c84ad7fa50 None admin] RBAC: Authorizing `identity:get_project(project_id=fce96ab781044bd1925edc63068560ad)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:44.228963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4bb38-db0b-4f4c-bb95-e8c84ad7fa50 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:44.230667 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 597/1199] 10.222.0.66 () {56 vars in 1186 bytes} [Thu May 26 21:03:44 2022] GET /identity/v3/projects/fce96ab781044bd1925edc63068560ad => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:44.236631 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4354f10-fee5-4de1-9573-b677483b1c72 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:03:44.331042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4354f10-fee5-4de1-9573-b677483b1c72 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:03:44.364425 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63f536-5dc1-452a-9b55-247875dd068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:03:44.365095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63f536-5dc1-452a-9b55-247875dd068a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:03:44.365380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63f536-5dc1-452a-9b55-247875dd068a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:03:44.365656 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63f536-5dc1-452a-9b55-247875dd068a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:03:44.366482 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63f536-5dc1-452a-9b55-247875dd068a None admin] RBAC: Adding query filter params (role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.project.id=fce96ab781044bd1925edc63068560ad, user.id=f660ad858e724cea9369c70c96440673) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:03:44.366799 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63f536-5dc1-452a-9b55-247875dd068a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:03:44.368837 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63f536-5dc1-452a-9b55-247875dd068a None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:03:44.374466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 603/1200] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:03:44 2022] GET /identity/v3/role_assignments?user.id=f660ad858e724cea9369c70c96440673&scope.project.id=fce96ab781044bd1925edc63068560ad&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:03:54.232461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=16 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:03:54.371889 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=98 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:02.085804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544dfd9-bf9f-484e-9cef-955d8a696460 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:02.086436 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544dfd9-bf9f-484e-9cef-955d8a696460 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:02.086436 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544dfd9-bf9f-484e-9cef-955d8a696460 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:02.087732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 598/1201] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:05:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:05:02.093730 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c15e14-5bda-4b1b-bfa8-853fcb3a6ecf None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:02.094580 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c15e14-5bda-4b1b-bfa8-853fcb3a6ecf None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:02.094580 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c15e14-5bda-4b1b-bfa8-853fcb3a6ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:02.111899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-13c15e14-5bda-4b1b-bfa8-853fcb3a6ecf None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:05:02.114205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-13c15e14-5bda-4b1b-bfa8-853fcb3a6ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:05:02.180758 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 604/1202] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:05:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:05:02.205149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544dfd9-bf9f-484e-9cef-955d8a696460 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:02.305850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544dfd9-bf9f-484e-9cef-955d8a696460 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:02.340082 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1715823-744e-4e0c-a52c-1325df9d709d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:02.340819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1715823-744e-4e0c-a52c-1325df9d709d None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:02.341103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1715823-744e-4e0c-a52c-1325df9d709d None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:02.341379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1715823-744e-4e0c-a52c-1325df9d709d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:02.352191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1715823-744e-4e0c-a52c-1325df9d709d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:02.359098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1715823-744e-4e0c-a52c-1325df9d709d None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:02.371649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-e1715823-744e-4e0c-a52c-1325df9d709d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:02.371649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:02.371649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:02.371649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:02.371649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:02.371649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:02.371649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:02.371649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:02.371649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:02.371649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:02.371649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:02.371649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:02.371649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:05:02.371649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:05:02.371649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:05:02.372836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:05:02.372836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:02.372836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:02.372836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:02.372836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:02.372836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:02.372836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:02.372836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:02.372836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:05:02.372836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:02.372836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:02.372836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:02.372836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:02.372836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:02.372836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:02.372836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:02.372836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:02.374015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:05:02.374015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:05:02.374015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:02.374015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:05:02.374015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 599/1203] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:02.379256 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c15e14-5bda-4b1b-bfa8-853fcb3a6ecf None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:02.483382 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c15e14-5bda-4b1b-bfa8-853fcb3a6ecf None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:02.515653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:02.521903 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced6ba7-323e-4ed7-a045-2ad7aa089072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:02.522582 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced6ba7-323e-4ed7-a045-2ad7aa089072 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:02.522863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced6ba7-323e-4ed7-a045-2ad7aa089072 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:02.523139 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced6ba7-323e-4ed7-a045-2ad7aa089072 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:02.523874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced6ba7-323e-4ed7-a045-2ad7aa089072 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:02.524185 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced6ba7-323e-4ed7-a045-2ad7aa089072 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:02.525619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced6ba7-323e-4ed7-a045-2ad7aa089072 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:02.537568 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 605/1204] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:05:02.543512 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1715823-744e-4e0c-a52c-1325df9d709d None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:02.610777 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:02.658926 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1715823-744e-4e0c-a52c-1325df9d709d None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:02.695402 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b72c3-1f18-4027-8261-665a3807da36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:02.696073 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b72c3-1f18-4027-8261-665a3807da36 None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:02.696358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b72c3-1f18-4027-8261-665a3807da36 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:02.696757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b72c3-1f18-4027-8261-665a3807da36 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:02.697475 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b72c3-1f18-4027-8261-665a3807da36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:02.698956 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b72c3-1f18-4027-8261-665a3807da36 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:02.836245 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 600/1205] 10.222.0.66 () {60 vars in 1132 bytes} [Thu May 26 21:05:02 2022] POST /identity/v3/users => generated 251 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:05:05.124327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa48dde-efde-4ca8-abc7-4c13e7b69477 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:05.124936 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa48dde-efde-4ca8-abc7-4c13e7b69477 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:05.124936 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa48dde-efde-4ca8-abc7-4c13e7b69477 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:05.126271 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 606/1206] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:05:05.132045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29000a25-5c19-4adf-a1de-711f81e07e27 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:05.132547 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29000a25-5c19-4adf-a1de-711f81e07e27 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:05.132684 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29000a25-5c19-4adf-a1de-711f81e07e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:05.149864 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-29000a25-5c19-4adf-a1de-711f81e07e27 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:05:05.151063 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-29000a25-5c19-4adf-a1de-711f81e07e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:05:05.218327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 601/1207] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:05:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:05:05.243294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa48dde-efde-4ca8-abc7-4c13e7b69477 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:05.347005 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa48dde-efde-4ca8-abc7-4c13e7b69477 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:05.381352 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb724a-8ea9-4545-ab8e-0d80ddb8629b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:05.382067 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb724a-8ea9-4545-ab8e-0d80ddb8629b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:05.382369 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb724a-8ea9-4545-ab8e-0d80ddb8629b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:05.382685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb724a-8ea9-4545-ab8e-0d80ddb8629b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:05.393839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb724a-8ea9-4545-ab8e-0d80ddb8629b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:05:05.403861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-25eb724a-8ea9-4545-ab8e-0d80ddb8629b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:05:05.403861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:05.403861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:05.403861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:05.403861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:05.403861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:05.403861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:05.403861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:05.403861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:05.403861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:05.403861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:05.403861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:05.403861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:05:05.403861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:05:05.403861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:05:05.403861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:05:05.405116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:05:05.405116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:05:05.405116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:05:05.405116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:05:05.405116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:05.405116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:05.405116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:05.405116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:05.405116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:05.405116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:05.405116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:05.405116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:05:05.405116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:05.405116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:05.405116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:05.405116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:05.406254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:05.406254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:05.406254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:05.406254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:05.406254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:05:05.406254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:05:05.406254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:05:05.406254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:05:05.406254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:05:05.406254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:05:05.406254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:05:05.406254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:05.406254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 607/1208] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:05:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:05.409302 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29000a25-5c19-4adf-a1de-711f81e07e27 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:05.449684 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:05.509937 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29000a25-5c19-4adf-a1de-711f81e07e27 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:05.545100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00e3c6-96c2-4268-b513-33866fd9aee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:05.545824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00e3c6-96c2-4268-b513-33866fd9aee8 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:05.546107 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00e3c6-96c2-4268-b513-33866fd9aee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:05.546429 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00e3c6-96c2-4268-b513-33866fd9aee8 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:05.547190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00e3c6-96c2-4268-b513-33866fd9aee8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:05.547555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00e3c6-96c2-4268-b513-33866fd9aee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:05.549122 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00e3c6-96c2-4268-b513-33866fd9aee8 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:05.558722 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 602/1209] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:05:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:05.564362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb724a-8ea9-4545-ab8e-0d80ddb8629b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:05.618107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:05.676426 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb724a-8ea9-4545-ab8e-0d80ddb8629b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:05.711849 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b9144-693f-4870-a917-8fa04ded73c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:05.712662 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b9144-693f-4870-a917-8fa04ded73c4 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:05.712946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b9144-693f-4870-a917-8fa04ded73c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:05.713218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b9144-693f-4870-a917-8fa04ded73c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:05.723092 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b9144-693f-4870-a917-8fa04ded73c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:05.725112 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b9144-693f-4870-a917-8fa04ded73c4 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:05.742899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-019b9144-693f-4870-a917-8fa04ded73c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:05.742899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:05.742899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:05.742899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:05.742899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:05.742899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:05.742899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:05.742899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:05.742899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:05.742899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:05.742899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:05.742899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:05.742899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:05:05.742899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:05:05.742899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:05:05.751661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:05:05.751661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:05.751661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:05.751661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:05.751661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:05.751661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:05.751661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:05.751661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:05.751661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:05:05.751661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:05.751661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:05.751661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:05.751661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:05.751661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:05.751661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:05.751661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:05.751661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:05.752827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:05:05.752827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:05:05.752827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:05.752827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:05.752827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 608/1210] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:05.753189 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00e3c6-96c2-4268-b513-33866fd9aee8 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:05.851980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:05.855013 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00e3c6-96c2-4268-b513-33866fd9aee8 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:05.890644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a989ec-bb7c-4f65-bf4c-842a02b828d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:05.891298 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a989ec-bb7c-4f65-bf4c-842a02b828d9 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:05.891576 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a989ec-bb7c-4f65-bf4c-842a02b828d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:05.891848 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a989ec-bb7c-4f65-bf4c-842a02b828d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:05.892568 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a989ec-bb7c-4f65-bf4c-842a02b828d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:05.892896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a989ec-bb7c-4f65-bf4c-842a02b828d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:05.894266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a989ec-bb7c-4f65-bf4c-842a02b828d9 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:05.906459 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 603/1211] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:05.913048 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b9144-693f-4870-a917-8fa04ded73c4 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:06.016269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b9144-693f-4870-a917-8fa04ded73c4 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:06.017973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:06.051539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c88a32-2165-44e5-b6ce-ff67859c380c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:06.052813 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c88a32-2165-44e5-b6ce-ff67859c380c None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:06.053152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c88a32-2165-44e5-b6ce-ff67859c380c None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:06.053427 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c88a32-2165-44e5-b6ce-ff67859c380c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:06.061170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c88a32-2165-44e5-b6ce-ff67859c380c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:06.062749 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c88a32-2165-44e5-b6ce-ff67859c380c None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:06.077890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-78c88a32-2165-44e5-b6ce-ff67859c380c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 21:05:06.077890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:06.077890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:06.077890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:06.077890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:06.077890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:06.077890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:06.077890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:06.077890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:06.077890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:06.077890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:06.077890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:06.077890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:05:06.077890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:05:06.077890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:05:06.077890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:05:06.079126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:06.079126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:06.079126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:05:06.079126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:05:06.079126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:05:06.079126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:05:06.079126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:06.079126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:06.079126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:06.079126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:06.079126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:06.079126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:05:06.079126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:06.079126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:06.079126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:06.079126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:06.079126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:06.079126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:06.080379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:06.080379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:06.080379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:05:06.080379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:05:06.080379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:05:06.080379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:05:06.080379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:05:06.080379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:05:06.080379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 21:05:06.080379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:06.080379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 609/1212] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:06.086143 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a989ec-bb7c-4f65-bf4c-842a02b828d9 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:06.184881 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a989ec-bb7c-4f65-bf4c-842a02b828d9 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:06.219715 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136952e-8162-400b-bb4b-91f1ff7127d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:06.220388 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136952e-8162-400b-bb4b-91f1ff7127d4 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:06.220711 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136952e-8162-400b-bb4b-91f1ff7127d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:06.221045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136952e-8162-400b-bb4b-91f1ff7127d4 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:06.221866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136952e-8162-400b-bb4b-91f1ff7127d4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:06.222173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136952e-8162-400b-bb4b-91f1ff7127d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:06.223604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136952e-8162-400b-bb4b-91f1ff7127d4 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:06.241278 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 604/1213] 10.222.0.66 () {56 vars in 1143 bytes} [Thu May 26 21:05:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:06.247102 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c88a32-2165-44e5-b6ce-ff67859c380c None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:06.344929 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c88a32-2165-44e5-b6ce-ff67859c380c None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:06.377761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd706894-36ea-4c86-8e77-e1f950b96c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:06.378402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd706894-36ea-4c86-8e77-e1f950b96c2b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:06.378687 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd706894-36ea-4c86-8e77-e1f950b96c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:06.378957 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd706894-36ea-4c86-8e77-e1f950b96c2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:06.410693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:06.450113 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd706894-36ea-4c86-8e77-e1f950b96c2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:06.451601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd706894-36ea-4c86-8e77-e1f950b96c2b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:06.550243 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 610/1214] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:05:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:05:06.556986 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136952e-8162-400b-bb4b-91f1ff7127d4 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:06.577155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:06.658623 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136952e-8162-400b-bb4b-91f1ff7127d4 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:06.696178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27f99e-838a-4bcd-98f5-1975d670fa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:06.696991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27f99e-838a-4bcd-98f5-1975d670fa71 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:06.697269 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27f99e-838a-4bcd-98f5-1975d670fa71 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:06.697538 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27f99e-838a-4bcd-98f5-1975d670fa71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:06.707496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27f99e-838a-4bcd-98f5-1975d670fa71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:06.709059 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27f99e-838a-4bcd-98f5-1975d670fa71 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:06.726206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-4c27f99e-838a-4bcd-98f5-1975d670fa71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:06.726206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:06.726206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:06.726206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:06.726206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:06.726206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:06.726206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:06.726206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:06.726206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:06.726206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:06.726206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:06.726206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:06.726206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:05:06.726206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:05:06.726206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:05:06.727798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:05:06.727798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:06.727798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:06.727798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:06.727798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:06.727798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:06.727798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:06.727798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:06.727798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:05:06.727798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:06.727798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:06.727798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:06.727798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:06.727798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:06.727798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:06.727798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:06.727798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:06.729052 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:05:06.729052 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:05:06.729052 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:06.729052 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:05:06.729052 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 605/1215] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:06.733284 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd706894-36ea-4c86-8e77-e1f950b96c2b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:06.797600 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:06.836851 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd706894-36ea-4c86-8e77-e1f950b96c2b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:06.871339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410877f-26c6-4881-a784-427f9629d617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:06.872062 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410877f-26c6-4881-a784-427f9629d617 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:06.872285 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410877f-26c6-4881-a784-427f9629d617 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:06.872556 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410877f-26c6-4881-a784-427f9629d617 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:06.873312 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410877f-26c6-4881-a784-427f9629d617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:06.873614 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410877f-26c6-4881-a784-427f9629d617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:06.875031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410877f-26c6-4881-a784-427f9629d617 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:06.887364 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 611/1216] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:06.893280 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27f99e-838a-4bcd-98f5-1975d670fa71 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:06.962252 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:06.993730 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27f99e-838a-4bcd-98f5-1975d670fa71 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:07.026303 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf89c07-ce8d-4a09-b7db-02f7d09d245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:07.027482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf89c07-ce8d-4a09-b7db-02f7d09d245a None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:07.027482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf89c07-ce8d-4a09-b7db-02f7d09d245a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:07.027728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf89c07-ce8d-4a09-b7db-02f7d09d245a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:07.034452 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf89c07-ce8d-4a09-b7db-02f7d09d245a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:07.035898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf89c07-ce8d-4a09-b7db-02f7d09d245a None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:07.050834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-4bf89c07-ce8d-4a09-b7db-02f7d09d245a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:05:07.050834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:07.050834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:07.050834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:07.050834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:07.050834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:07.050834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:07.050834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:07.050834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:07.050834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:07.050834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:07.050834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:07.050834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:05:07.050834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:05:07.050834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:05:07.052191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:05:07.052191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:07.052191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:07.052191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:07.052191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:07.052191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:07.052191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:07.052191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:07.052191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:05:07.052191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:07.052191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:07.052191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:07.052191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:07.052191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:07.052191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:07.052191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:07.052191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:07.054344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:05:07.054344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:05:07.054344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:05:07.054344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:05:07.054344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:05:07.054344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:05:07.054344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:05:07.054344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:05:07.054344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 606/1217] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:05:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:07.058720 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410877f-26c6-4881-a784-427f9629d617 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:07.155237 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410877f-26c6-4881-a784-427f9629d617 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:07.178892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:07.190252 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdda717-35c6-4353-987c-cb7033a5f691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:07.190917 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdda717-35c6-4353-987c-cb7033a5f691 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:07.191200 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdda717-35c6-4353-987c-cb7033a5f691 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:07.191474 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdda717-35c6-4353-987c-cb7033a5f691 None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:07.192262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdda717-35c6-4353-987c-cb7033a5f691 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:07.192569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdda717-35c6-4353-987c-cb7033a5f691 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:07.194063 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdda717-35c6-4353-987c-cb7033a5f691 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:07.205547 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 612/1218] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:05:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:07.211994 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf89c07-ce8d-4a09-b7db-02f7d09d245a None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:07.312026 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf89c07-ce8d-4a09-b7db-02f7d09d245a None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:07.340526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:07.346220 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a151a-8365-40a8-96fe-888332f7934f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:07.346880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a151a-8365-40a8-96fe-888332f7934f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:07.347165 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a151a-8365-40a8-96fe-888332f7934f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:07.347441 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a151a-8365-40a8-96fe-888332f7934f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:07.348272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a151a-8365-40a8-96fe-888332f7934f None admin] RBAC: Adding query filter params (role.id=6391321aa2bd4ed5980bebfc65f307a9, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=2d68ccb9b89843078c40b13f79a72dda) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:07.348596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a151a-8365-40a8-96fe-888332f7934f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:07.350678 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a151a-8365-40a8-96fe-888332f7934f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:07.356294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 607/1219] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:05:07 2022] GET /identity/v3/role_assignments?user.id=2d68ccb9b89843078c40b13f79a72dda&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=6391321aa2bd4ed5980bebfc65f307a9 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:09.545441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad797cd-caee-40ca-bbeb-df4cbc0a38cb None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:09.546030 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad797cd-caee-40ca-bbeb-df4cbc0a38cb None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:09.546030 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad797cd-caee-40ca-bbeb-df4cbc0a38cb None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:09.547348 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 613/1220] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:05:09.553577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974257aa-0106-428a-a72d-712170c37cc0 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:09.554083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974257aa-0106-428a-a72d-712170c37cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:09.554176 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974257aa-0106-428a-a72d-712170c37cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:09.571272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-974257aa-0106-428a-a72d-712170c37cc0 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:05:09.572460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-974257aa-0106-428a-a72d-712170c37cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:05:09.639095 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 608/1221] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:05:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:05:09.661784 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad797cd-caee-40ca-bbeb-df4cbc0a38cb None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:09.765000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad797cd-caee-40ca-bbeb-df4cbc0a38cb None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:09.799024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61eb0a5-513a-4cf7-8f07-a257595e91a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:09.799738 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61eb0a5-513a-4cf7-8f07-a257595e91a0 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:09.800017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61eb0a5-513a-4cf7-8f07-a257595e91a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:09.800289 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61eb0a5-513a-4cf7-8f07-a257595e91a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:09.811290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61eb0a5-513a-4cf7-8f07-a257595e91a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:05:09.819388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-f61eb0a5-513a-4cf7-8f07-a257595e91a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:05:09.819388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:09.819388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:09.819388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:09.819388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:09.819388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:09.819388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:09.819388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:09.819388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:09.819388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:09.819388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:09.819388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:09.819388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:05:09.819388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:05:09.819388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:05:09.819388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:05:09.821747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:05:09.821747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:05:09.821747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:05:09.821747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:05:09.821747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:09.821747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:09.821747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:09.821747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:09.821747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:09.821747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:09.821747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:09.821747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:05:09.821747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:09.821747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:09.821747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:09.821747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:09.822763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:09.822763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:09.822763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:09.822763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:09.822763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:05:09.822763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:05:09.822763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:05:09.822763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:05:09.822763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:05:09.822763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:05:09.822763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:05:09.822763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:09.822763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 614/1222] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:05:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 21:05:09.826935 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974257aa-0106-428a-a72d-712170c37cc0 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:09.922495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974257aa-0106-428a-a72d-712170c37cc0 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:09.946388 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:09.959168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589711e-7ec2-4cc1-a820-d650c53d8955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:09.959838 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589711e-7ec2-4cc1-a820-d650c53d8955 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:09.960127 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589711e-7ec2-4cc1-a820-d650c53d8955 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:09.960403 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589711e-7ec2-4cc1-a820-d650c53d8955 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:09.961188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589711e-7ec2-4cc1-a820-d650c53d8955 None admin] RBAC: Adding query filter params (name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:09.961496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589711e-7ec2-4cc1-a820-d650c53d8955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:09.962870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589711e-7ec2-4cc1-a820-d650c53d8955 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:09.970676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 609/1223] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:05:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:09.977338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61eb0a5-513a-4cf7-8f07-a257595e91a0 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:10.020842 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:10.077139 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61eb0a5-513a-4cf7-8f07-a257595e91a0 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:10.110863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1daac-e37e-4861-9d62-52a527f71435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:10.111649 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1daac-e37e-4861-9d62-52a527f71435 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:10.111961 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1daac-e37e-4861-9d62-52a527f71435 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:10.112232 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1daac-e37e-4861-9d62-52a527f71435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:10.123984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1daac-e37e-4861-9d62-52a527f71435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:10.125485 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1daac-e37e-4861-9d62-52a527f71435 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:10.142220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-d8c1daac-e37e-4861-9d62-52a527f71435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:10.142220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:10.142220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:10.142220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:10.142220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:10.142220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:10.142220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:10.142220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:10.142220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:10.142220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:10.142220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:10.142220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:10.142220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:05:10.142220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:05:10.142220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:05:10.143332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:05:10.143332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:10.143332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:10.143332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:10.143332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:10.143332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:10.143332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:10.143332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:10.143332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:05:10.143332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:10.143332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:10.143332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:10.143332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:10.143332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:10.143332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:10.143332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:10.143332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:10.144460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:05:10.144460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:05:10.144460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:10.144460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:10.144460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 615/1224] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:10.149232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589711e-7ec2-4cc1-a820-d650c53d8955 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:10.250080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589711e-7ec2-4cc1-a820-d650c53d8955 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:10.288297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438caa8-4858-4ab6-b461-c4be4c2adb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:10.289020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438caa8-4858-4ab6-b461-c4be4c2adb68 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:10.289372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438caa8-4858-4ab6-b461-c4be4c2adb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:10.289652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438caa8-4858-4ab6-b461-c4be4c2adb68 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:10.290391 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438caa8-4858-4ab6-b461-c4be4c2adb68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:10.290700 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438caa8-4858-4ab6-b461-c4be4c2adb68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:10.292172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438caa8-4858-4ab6-b461-c4be4c2adb68 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:10.305924 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 610/1225] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:10.312128 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1daac-e37e-4861-9d62-52a527f71435 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:10.414533 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:10.422180 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1daac-e37e-4861-9d62-52a527f71435 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:10.462062 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c380068-55bf-4c64-bf25-a298216a294a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:10.462947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c380068-55bf-4c64-bf25-a298216a294a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:10.463168 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c380068-55bf-4c64-bf25-a298216a294a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:10.463440 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c380068-55bf-4c64-bf25-a298216a294a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:10.471940 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c380068-55bf-4c64-bf25-a298216a294a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:10.473460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c380068-55bf-4c64-bf25-a298216a294a None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:10.490542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-0c380068-55bf-4c64-bf25-a298216a294a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 21:05:10.490542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:10.490542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:10.490542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:10.490542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:10.490542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:10.490542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:10.490542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:10.490542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:10.490542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:10.490542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:10.490542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:10.490542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:05:10.490542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:05:10.490542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:05:10.490542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:05:10.492323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:10.492323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:10.492323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:05:10.492323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:05:10.492323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:05:10.492323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:05:10.492323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:10.492323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:10.492323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:10.492323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:10.492323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:10.492323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:05:10.492323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:10.492323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:10.492323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:10.492323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:10.492323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:10.492323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:10.495303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:10.495303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:10.495303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:05:10.495303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:05:10.495303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:05:10.495303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:05:10.495303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:05:10.495303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:05:10.495303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 21:05:10.495303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:10.495303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 616/1226] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:10.498098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438caa8-4858-4ab6-b461-c4be4c2adb68 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:10.545786 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:10.607451 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438caa8-4858-4ab6-b461-c4be4c2adb68 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:10.640558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ee2e-13fe-49e2-a905-f2386451e839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:10.641314 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ee2e-13fe-49e2-a905-f2386451e839 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:10.641551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ee2e-13fe-49e2-a905-f2386451e839 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:10.641831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ee2e-13fe-49e2-a905-f2386451e839 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:10.642676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2ee2e-13fe-49e2-a905-f2386451e839 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:10.642991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2ee2e-13fe-49e2-a905-f2386451e839 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:10.644437 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2ee2e-13fe-49e2-a905-f2386451e839 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:10.662646 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 611/1227] 10.222.0.66 () {56 vars in 1143 bytes} [Thu May 26 21:05:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:05:10.668956 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c380068-55bf-4c64-bf25-a298216a294a None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:10.769549 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c380068-55bf-4c64-bf25-a298216a294a None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:10.802908 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb6de5-6091-48da-ad10-5872ef20728b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:10.803702 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb6de5-6091-48da-ad10-5872ef20728b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:10.803980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb6de5-6091-48da-ad10-5872ef20728b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:10.804254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb6de5-6091-48da-ad10-5872ef20728b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:10.814312 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb6de5-6091-48da-ad10-5872ef20728b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:10.815757 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb6de5-6091-48da-ad10-5872ef20728b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:10.833455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-99eb6de5-6091-48da-ad10-5872ef20728b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:10.833455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:10.833455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:10.833455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:10.833455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:10.833455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:10.833455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:10.833455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:10.833455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:10.833455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:10.833455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:10.833455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:10.833455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:05:10.833455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:05:10.833455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:05:10.835040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:05:10.835040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:10.835040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:10.835040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:10.835040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:10.835040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:10.835040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:10.835040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:10.835040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:05:10.835040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:10.835040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:10.835040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:10.835040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:10.835040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:10.835040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:10.835040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:10.835040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:10.836183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:05:10.836183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:05:10.836183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:10.836183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:10.836183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 617/1228] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:10.841158 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ee2e-13fe-49e2-a905-f2386451e839 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:10.939563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ee2e-13fe-49e2-a905-f2386451e839 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:10.941852 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:10.975303 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177237a-3659-4684-8971-43a282ccfe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:10.976001 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177237a-3659-4684-8971-43a282ccfe97 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:10.976282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177237a-3659-4684-8971-43a282ccfe97 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:10.976684 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177237a-3659-4684-8971-43a282ccfe97 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:10.981241 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177237a-3659-4684-8971-43a282ccfe97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:10.981241 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177237a-3659-4684-8971-43a282ccfe97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:10.981241 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177237a-3659-4684-8971-43a282ccfe97 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:10.990369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 612/1229] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:10.996060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb6de5-6091-48da-ad10-5872ef20728b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:11.005179 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:11.096849 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb6de5-6091-48da-ad10-5872ef20728b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:11.130480 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8ba22-133f-402a-852b-0342ef3751ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:11.131870 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8ba22-133f-402a-852b-0342ef3751ca None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:11.132148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8ba22-133f-402a-852b-0342ef3751ca None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:11.132418 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8ba22-133f-402a-852b-0342ef3751ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:11.139216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8ba22-133f-402a-852b-0342ef3751ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:11.140672 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8ba22-133f-402a-852b-0342ef3751ca None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:11.154492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-8ff8ba22-133f-402a-852b-0342ef3751ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:05:11.154492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:11.154492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:11.154492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:11.154492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:11.154492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:11.154492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:11.154492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:11.154492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:11.154492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:11.154492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:11.154492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:11.154492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:05:11.154492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:05:11.154492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:05:11.155550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:05:11.155550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:11.155550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:11.155550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:11.155550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:11.155550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:11.155550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:11.155550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:11.155550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:05:11.155550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:11.155550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:11.155550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:11.155550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:11.155550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:11.155550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:11.155550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:11.155550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:11.156605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:05:11.156605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:05:11.156605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:05:11.156605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:05:11.156605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:05:11.156605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:05:11.156605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:05:11.156605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:11.156605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 618/1230] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:05:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:11.162073 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177237a-3659-4684-8971-43a282ccfe97 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:11.261259 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177237a-3659-4684-8971-43a282ccfe97 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:11.295648 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d3853-4683-45a3-abc3-74dac6f5a118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:11.296305 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d3853-4683-45a3-abc3-74dac6f5a118 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:11.296614 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d3853-4683-45a3-abc3-74dac6f5a118 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:11.296909 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d3853-4683-45a3-abc3-74dac6f5a118 None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:11.297693 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d3853-4683-45a3-abc3-74dac6f5a118 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:11.298001 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d3853-4683-45a3-abc3-74dac6f5a118 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:11.299418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d3853-4683-45a3-abc3-74dac6f5a118 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:11.312016 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 613/1231] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:05:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:11.319017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8ba22-133f-402a-852b-0342ef3751ca None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:11.388757 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:11.423730 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8ba22-133f-402a-852b-0342ef3751ca None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:11.456743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e79d2-b917-4fe5-b47c-4c87f9da1b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:11.457657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e79d2-b917-4fe5-b47c-4c87f9da1b47 None admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:11.457940 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e79d2-b917-4fe5-b47c-4c87f9da1b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:11.458217 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e79d2-b917-4fe5-b47c-4c87f9da1b47 None admin] PATH_INFO: `/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/2d68ccb9b89843078c40b13f79a72dda/roles/6391321aa2bd4ed5980bebfc65f307a9` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:11.474123 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e79d2-b917-4fe5-b47c-4c87f9da1b47 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3db24bf0708446e9b05197fafeb00e4, user_id=2d68ccb9b89843078c40b13f79a72dda, role_id=6391321aa2bd4ed5980bebfc65f307a9)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:11.476103 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e79d2-b917-4fe5-b47c-4c87f9da1b47 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:11.613293 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 619/1232] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:05:11 2022] PUT /identity/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/2d68ccb9b89843078c40b13f79a72dda/roles/6391321aa2bd4ed5980bebfc65f307a9 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:05:13.809131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b7908-4389-4c72-9fc6-c08f671a04d1 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:13.809654 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b7908-4389-4c72-9fc6-c08f671a04d1 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:13.809654 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b7908-4389-4c72-9fc6-c08f671a04d1 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:13.810979 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 614/1233] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:05:13.816119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25196a7d-f900-450b-8c27-854c31fa27ab None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:13.816540 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25196a7d-f900-450b-8c27-854c31fa27ab None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:13.816778 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25196a7d-f900-450b-8c27-854c31fa27ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:13.834748 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-25196a7d-f900-450b-8c27-854c31fa27ab None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:05:13.835929 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-25196a7d-f900-450b-8c27-854c31fa27ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:05:13.903771 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 620/1234] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:05:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:05:13.927410 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b7908-4389-4c72-9fc6-c08f671a04d1 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:13.952099 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:14.029934 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b7908-4389-4c72-9fc6-c08f671a04d1 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:14.064977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9961d56-2ddc-4eaa-baa9-991ba70e5bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:14.065694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9961d56-2ddc-4eaa-baa9-991ba70e5bfd None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:14.065975 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9961d56-2ddc-4eaa-baa9-991ba70e5bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:14.066246 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9961d56-2ddc-4eaa-baa9-991ba70e5bfd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:14.076831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9961d56-2ddc-4eaa-baa9-991ba70e5bfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:05:14.084495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-a9961d56-2ddc-4eaa-baa9-991ba70e5bfd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 21:05:14.084495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:14.084495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:14.084495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:14.084495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:14.084495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:14.084495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:14.084495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:14.084495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:14.084495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:14.084495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:14.084495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:14.084495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:05:14.084495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:05:14.084495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:05:14.084495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:05:14.085604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:05:14.085604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:05:14.085604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:05:14.085604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:05:14.085604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:14.085604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:14.085604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:14.085604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:14.085604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:14.085604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:14.085604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:14.085604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:05:14.085604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:14.085604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:14.085604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:14.085604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:14.091504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:14.091504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:14.091504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:14.091504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:14.091504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:05:14.091504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:05:14.091504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:05:14.091504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:05:14.091504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:05:14.091504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:05:14.091504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 21:05:14.091504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:05:14.091504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 615/1235] 10.222.0.66 () {56 vars in 1102 bytes} [Thu May 26 21:05:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:14.092371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25196a7d-f900-450b-8c27-854c31fa27ab None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:14.137003 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:14.187499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25196a7d-f900-450b-8c27-854c31fa27ab None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:14.222445 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbca18-7a73-416b-a418-525420459098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:14.223165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbca18-7a73-416b-a418-525420459098 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:14.223449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbca18-7a73-416b-a418-525420459098 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:14.223726 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbca18-7a73-416b-a418-525420459098 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:14.224560 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbca18-7a73-416b-a418-525420459098 None admin] RBAC: Adding query filter params (name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:14.224902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbca18-7a73-416b-a418-525420459098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:14.226265 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbca18-7a73-416b-a418-525420459098 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:14.234508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 621/1236] 10.222.0.66 () {56 vars in 1103 bytes} [Thu May 26 21:05:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:14.240610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9961d56-2ddc-4eaa-baa9-991ba70e5bfd None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:14.325052 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:14.340141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9961d56-2ddc-4eaa-baa9-991ba70e5bfd None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:14.373566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7db76c-e2ac-4861-84f3-b65dea8537a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:14.374351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7db76c-e2ac-4861-84f3-b65dea8537a3 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:14.374633 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7db76c-e2ac-4861-84f3-b65dea8537a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:14.374907 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7db76c-e2ac-4861-84f3-b65dea8537a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:14.385378 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7db76c-e2ac-4861-84f3-b65dea8537a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:14.391419 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7db76c-e2ac-4861-84f3-b65dea8537a3 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:14.404984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-da7db76c-e2ac-4861-84f3-b65dea8537a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:14.404984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:14.404984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:14.404984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:14.404984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:14.404984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:14.404984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:14.404984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:14.404984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:14.404984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:14.404984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:14.404984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:14.404984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:05:14.404984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:05:14.404984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:05:14.410207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:05:14.410207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:14.410207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:14.410207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:14.410207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:14.410207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:14.410207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:14.410207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:14.410207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:05:14.410207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:14.410207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:14.410207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:14.410207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:14.410207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:14.410207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:14.410207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:14.410207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:14.411276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:05:14.411276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:05:14.411276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:14.411276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:05:14.411276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 616/1237] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:14.412492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbca18-7a73-416b-a418-525420459098 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:14.512460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbca18-7a73-416b-a418-525420459098 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:14.521261 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:14.545703 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b5b2e-bc66-4ff5-a8e7-7f1e61db169f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:14.546366 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b5b2e-bc66-4ff5-a8e7-7f1e61db169f None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:14.546647 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b5b2e-bc66-4ff5-a8e7-7f1e61db169f None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:14.546920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b5b2e-bc66-4ff5-a8e7-7f1e61db169f None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:14.547645 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b5b2e-bc66-4ff5-a8e7-7f1e61db169f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:14.547951 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b5b2e-bc66-4ff5-a8e7-7f1e61db169f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:14.549381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b5b2e-bc66-4ff5-a8e7-7f1e61db169f None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:14.561972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 622/1238] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:14.567630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7db76c-e2ac-4861-84f3-b65dea8537a3 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:14.668883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7db76c-e2ac-4861-84f3-b65dea8537a3 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:14.703688 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20605d-75b0-45a2-a70c-84a096171758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:14.704549 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20605d-75b0-45a2-a70c-84a096171758 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:14.704862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20605d-75b0-45a2-a70c-84a096171758 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:14.705135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20605d-75b0-45a2-a70c-84a096171758 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:14.707858 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:14.712358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20605d-75b0-45a2-a70c-84a096171758 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:14.713842 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20605d-75b0-45a2-a70c-84a096171758 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:14.729148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-ed20605d-75b0-45a2-a70c-84a096171758 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 21:05:14.729148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:14.729148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:14.729148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:14.729148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:14.729148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:14.729148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:14.729148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:14.729148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:14.729148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:14.729148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:14.729148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:14.729148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:05:14.729148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:05:14.729148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:05:14.729148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:05:14.730374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:14.730374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:14.730374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:05:14.730374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:05:14.730374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:05:14.730374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:05:14.730374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:14.730374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:14.730374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:14.730374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:14.730374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:14.730374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:05:14.730374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:14.730374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:14.730374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:14.730374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:14.730374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:14.730374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:14.731739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:14.731739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:14.731739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:05:14.731739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:05:14.731739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:05:14.731739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:05:14.731739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:05:14.731739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:05:14.731739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 21:05:14.731739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:05:14.731739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 617/1239] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:14.736248 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b5b2e-bc66-4ff5-a8e7-7f1e61db169f None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:14.835016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b5b2e-bc66-4ff5-a8e7-7f1e61db169f None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:14.869374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817dc35-6d8a-4640-aa21-c46841cb3601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:14.870054 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817dc35-6d8a-4640-aa21-c46841cb3601 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:14.870332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817dc35-6d8a-4640-aa21-c46841cb3601 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:14.870600 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817dc35-6d8a-4640-aa21-c46841cb3601 None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:14.871450 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817dc35-6d8a-4640-aa21-c46841cb3601 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:14.871754 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817dc35-6d8a-4640-aa21-c46841cb3601 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:14.873213 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817dc35-6d8a-4640-aa21-c46841cb3601 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:14.891021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 623/1240] 10.222.0.66 () {56 vars in 1143 bytes} [Thu May 26 21:05:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:14.897462 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20605d-75b0-45a2-a70c-84a096171758 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:14.996104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20605d-75b0-45a2-a70c-84a096171758 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:15.030812 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a85906-66a0-4570-ac79-77575d866b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:15.031462 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a85906-66a0-4570-ac79-77575d866b15 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:15.031746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a85906-66a0-4570-ac79-77575d866b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:15.032024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a85906-66a0-4570-ac79-77575d866b15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:15.093861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:15.101012 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a85906-66a0-4570-ac79-77575d866b15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:15.102507 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a85906-66a0-4570-ac79-77575d866b15 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:15.199032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 618/1241] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:05:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:05:15.204910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817dc35-6d8a-4640-aa21-c46841cb3601 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:15.234710 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:15.309180 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817dc35-6d8a-4640-aa21-c46841cb3601 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:15.344282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341f9a6-85bf-4873-90ca-924b7466bdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:15.345112 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341f9a6-85bf-4873-90ca-924b7466bdcb None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:15.345393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341f9a6-85bf-4873-90ca-924b7466bdcb None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:15.345669 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341f9a6-85bf-4873-90ca-924b7466bdcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:15.355733 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341f9a6-85bf-4873-90ca-924b7466bdcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:15.357215 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341f9a6-85bf-4873-90ca-924b7466bdcb None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:15.374458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-f341f9a6-85bf-4873-90ca-924b7466bdcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:15.374458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:15.374458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:15.374458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:15.374458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:15.374458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:15.374458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:15.374458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:15.374458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:15.374458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:15.374458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:15.374458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:15.374458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:05:15.374458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:05:15.374458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:05:15.375464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:05:15.375464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:15.375464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:15.375464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:15.375464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:15.375464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:15.375464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:15.375464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:15.375464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:05:15.375464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:15.375464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:15.375464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:15.375464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:15.375464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:15.375464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:15.375464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:15.375464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:15.376495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:05:15.376495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:05:15.376495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:15.376495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:15.376495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 624/1242] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:15.381982 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a85906-66a0-4570-ac79-77575d866b15 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:15.474708 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:15.480510 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a85906-66a0-4570-ac79-77575d866b15 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:15.513949 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5c190-19c6-4063-896c-07c09885a215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:15.514616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5c190-19c6-4063-896c-07c09885a215 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:15.514901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5c190-19c6-4063-896c-07c09885a215 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:15.515175 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5c190-19c6-4063-896c-07c09885a215 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:15.515899 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5c190-19c6-4063-896c-07c09885a215 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:15.516208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5c190-19c6-4063-896c-07c09885a215 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:15.517629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5c190-19c6-4063-896c-07c09885a215 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:15.529256 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 619/1243] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:15.535095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341f9a6-85bf-4873-90ca-924b7466bdcb None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:15.617632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:15.639154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341f9a6-85bf-4873-90ca-924b7466bdcb None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:15.681267 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a208adb-f2c8-4f7f-b283-7ac7bef9f7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:15.682076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a208adb-f2c8-4f7f-b283-7ac7bef9f7db None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:15.682377 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a208adb-f2c8-4f7f-b283-7ac7bef9f7db None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:15.682640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a208adb-f2c8-4f7f-b283-7ac7bef9f7db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:15.689456 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a208adb-f2c8-4f7f-b283-7ac7bef9f7db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:15.690882 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a208adb-f2c8-4f7f-b283-7ac7bef9f7db None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:15.705084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-5a208adb-f2c8-4f7f-b283-7ac7bef9f7db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:05:15.705084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:15.705084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:15.705084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:15.705084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:15.705084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:15.705084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:15.705084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:15.705084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:15.705084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:15.705084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:15.705084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:15.705084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:05:15.705084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:05:15.705084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:05:15.706125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:05:15.706125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:15.706125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:15.706125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:15.706125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:15.706125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:15.706125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:15.706125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:15.706125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:05:15.706125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:15.706125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:15.706125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:15.706125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:15.706125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:15.706125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:15.706125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:15.706125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:15.707195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:05:15.707195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:05:15.707195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:05:15.707195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:05:15.707195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:05:15.707195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:05:15.707195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:05:15.707195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:15.707195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 625/1244] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:05:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:15.712434 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5c190-19c6-4063-896c-07c09885a215 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:15.809552 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5c190-19c6-4063-896c-07c09885a215 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:15.846683 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3acbb-ea4f-46f9-a4c4-bedd8b5b1b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:15.847341 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3acbb-ea4f-46f9-a4c4-bedd8b5b1b55 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:15.847624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3acbb-ea4f-46f9-a4c4-bedd8b5b1b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:15.847901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3acbb-ea4f-46f9-a4c4-bedd8b5b1b55 None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:15.848731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3acbb-ea4f-46f9-a4c4-bedd8b5b1b55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:15.849045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3acbb-ea4f-46f9-a4c4-bedd8b5b1b55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:15.852561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3acbb-ea4f-46f9-a4c4-bedd8b5b1b55 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:15.867127 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 620/1245] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:05:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:15.874257 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a208adb-f2c8-4f7f-b283-7ac7bef9f7db None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:15.973548 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a208adb-f2c8-4f7f-b283-7ac7bef9f7db None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:16.008349 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c42f3-6e5e-426b-9fff-4ed40d232071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:16.009039 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c42f3-6e5e-426b-9fff-4ed40d232071 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:16.009327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c42f3-6e5e-426b-9fff-4ed40d232071 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:16.009648 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c42f3-6e5e-426b-9fff-4ed40d232071 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:16.010486 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c42f3-6e5e-426b-9fff-4ed40d232071 None admin] RBAC: Adding query filter params (role.id=6391321aa2bd4ed5980bebfc65f307a9, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=2d68ccb9b89843078c40b13f79a72dda) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:16.010801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c42f3-6e5e-426b-9fff-4ed40d232071 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:16.012233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c42f3-6e5e-426b-9fff-4ed40d232071 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:16.018282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 626/1246] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:05:15 2022] GET /identity/v3/role_assignments?user.id=2d68ccb9b89843078c40b13f79a72dda&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=6391321aa2bd4ed5980bebfc65f307a9 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:18.281557 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02e5ba-e3e7-4245-a26f-56a7435afbe4 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:18.282141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02e5ba-e3e7-4245-a26f-56a7435afbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:18.282141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02e5ba-e3e7-4245-a26f-56a7435afbe4 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:18.283466 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 621/1247] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:05:18.288765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d5fbe-b28d-4e42-ab4b-55161093abe7 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:18.289162 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d5fbe-b28d-4e42-ab4b-55161093abe7 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:18.289375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d5fbe-b28d-4e42-ab4b-55161093abe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:18.295038 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:18.306574 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-052d5fbe-b28d-4e42-ab4b-55161093abe7 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:05:18.307758 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-052d5fbe-b28d-4e42-ab4b-55161093abe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:05:18.372374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 627/1248] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:05:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:05:18.396011 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02e5ba-e3e7-4245-a26f-56a7435afbe4 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:18.415942 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:18.497353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02e5ba-e3e7-4245-a26f-56a7435afbe4 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:18.532019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d84e3-3410-43e2-b273-e0410df428e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:18.532743 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d84e3-3410-43e2-b273-e0410df428e5 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:18.533024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d84e3-3410-43e2-b273-e0410df428e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:18.533296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d84e3-3410-43e2-b273-e0410df428e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:18.543284 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d84e3-3410-43e2-b273-e0410df428e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:05:18.550900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-9a3d84e3-3410-43e2-b273-e0410df428e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:05:18.550900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:18.550900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:18.550900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:18.550900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:18.550900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:18.550900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:18.550900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:18.550900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:18.550900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:18.550900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:18.550900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:18.550900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:05:18.550900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:05:18.550900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:05:18.550900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:05:18.552018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:05:18.552018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:05:18.552018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:05:18.552018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:05:18.552018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:18.552018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:18.552018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:18.552018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:18.552018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:18.552018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:18.552018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:18.552018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:05:18.552018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:18.552018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:18.552018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:18.552018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:18.553987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:18.553987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:18.553987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:18.553987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:18.553987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:05:18.553987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:05:18.553987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:05:18.553987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:05:18.553987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:05:18.553987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:05:18.553987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:05:18.553987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:05:18.553987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 622/1249] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:05:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:18.558840 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d5fbe-b28d-4e42-ab4b-55161093abe7 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:18.657444 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d5fbe-b28d-4e42-ab4b-55161093abe7 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:18.687986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:18.692924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4013565-bff3-4bbf-85e8-958656bc0cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:18.694275 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4013565-bff3-4bbf-85e8-958656bc0cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:18.694560 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4013565-bff3-4bbf-85e8-958656bc0cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:18.694838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4013565-bff3-4bbf-85e8-958656bc0cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:18.695591 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4013565-bff3-4bbf-85e8-958656bc0cf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:18.695899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4013565-bff3-4bbf-85e8-958656bc0cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:18.697389 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4013565-bff3-4bbf-85e8-958656bc0cf1 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:18.705726 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 628/1250] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:05:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:18.711551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d84e3-3410-43e2-b273-e0410df428e5 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:18.790974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:18.812667 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d84e3-3410-43e2-b273-e0410df428e5 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:18.845183 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7fcd7-03c5-4cee-9f35-22b38d8eb7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:18.845989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7fcd7-03c5-4cee-9f35-22b38d8eb7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:18.847994 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7fcd7-03c5-4cee-9f35-22b38d8eb7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:18.847994 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7fcd7-03c5-4cee-9f35-22b38d8eb7a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:18.856721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7fcd7-03c5-4cee-9f35-22b38d8eb7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:18.858171 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7fcd7-03c5-4cee-9f35-22b38d8eb7a8 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:18.875358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-79e7fcd7-03c5-4cee-9f35-22b38d8eb7a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:18.875358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:18.875358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:18.875358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:18.875358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:18.875358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:18.875358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:18.875358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:18.875358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:18.875358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:18.875358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:18.875358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:18.875358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:05:18.875358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:05:18.875358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:05:18.876395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:05:18.876395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:18.876395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:18.876395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:18.876395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:18.876395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:18.876395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:18.876395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:18.876395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:05:18.876395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:18.876395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:18.876395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:18.876395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:18.876395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:18.876395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:18.876395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:18.876395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:18.883382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:05:18.883382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:05:18.883382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:18.883382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:05:18.883382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 623/1251] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:18.883722 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4013565-bff3-4bbf-85e8-958656bc0cf1 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:18.983382 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4013565-bff3-4bbf-85e8-958656bc0cf1 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:19.016686 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d0a7c-10f1-4676-bd62-f401ed86098a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:19.017350 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d0a7c-10f1-4676-bd62-f401ed86098a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:19.017637 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d0a7c-10f1-4676-bd62-f401ed86098a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:19.017917 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d0a7c-10f1-4676-bd62-f401ed86098a None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:19.018639 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d0a7c-10f1-4676-bd62-f401ed86098a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:19.018948 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d0a7c-10f1-4676-bd62-f401ed86098a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:19.020314 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d0a7c-10f1-4676-bd62-f401ed86098a None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:19.032449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 629/1252] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:19.038933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7fcd7-03c5-4cee-9f35-22b38d8eb7a8 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:19.139775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7fcd7-03c5-4cee-9f35-22b38d8eb7a8 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:19.166333 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:19.174263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02986332-cb5d-481f-8252-2d6ec295d16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:19.175068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02986332-cb5d-481f-8252-2d6ec295d16f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:19.175352 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02986332-cb5d-481f-8252-2d6ec295d16f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:19.175630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02986332-cb5d-481f-8252-2d6ec295d16f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:19.184065 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02986332-cb5d-481f-8252-2d6ec295d16f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:19.185542 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02986332-cb5d-481f-8252-2d6ec295d16f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:19.199504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-02986332-cb5d-481f-8252-2d6ec295d16f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 21:05:19.199504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:19.199504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:19.199504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:19.199504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:19.199504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:19.199504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:19.199504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:19.199504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:19.199504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:19.199504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:19.199504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:19.199504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:05:19.199504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:05:19.199504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:05:19.199504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:05:19.206116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:19.206116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:19.206116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:05:19.206116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:05:19.206116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:05:19.206116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:05:19.206116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:19.206116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:19.206116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:19.206116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:19.206116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:19.206116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:05:19.206116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:19.206116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:19.206116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:19.206116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:19.206116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:19.206116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:19.207285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:19.207285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:19.207285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:05:19.207285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:05:19.207285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:05:19.207285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:05:19.207285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:05:19.207285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:05:19.207285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 21:05:19.207285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:05:19.207285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 624/1253] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:19.208004 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d0a7c-10f1-4676-bd62-f401ed86098a None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:19.263194 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:19.308170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d0a7c-10f1-4676-bd62-f401ed86098a None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:19.340945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90367720-b689-4f45-9f17-397384fed36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:19.341642 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90367720-b689-4f45-9f17-397384fed36a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:19.341911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90367720-b689-4f45-9f17-397384fed36a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:19.342190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90367720-b689-4f45-9f17-397384fed36a None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:19.343033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90367720-b689-4f45-9f17-397384fed36a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:19.343342 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90367720-b689-4f45-9f17-397384fed36a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:19.344787 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90367720-b689-4f45-9f17-397384fed36a None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:19.361956 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 630/1254] 10.222.0.66 () {56 vars in 1143 bytes} [Thu May 26 21:05:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:19.367819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02986332-cb5d-481f-8252-2d6ec295d16f None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:19.464799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02986332-cb5d-481f-8252-2d6ec295d16f None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:19.497503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec171f-bbcf-4dfa-bdd9-8995bfb1dd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:19.498150 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec171f-bbcf-4dfa-bdd9-8995bfb1dd46 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:19.498433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec171f-bbcf-4dfa-bdd9-8995bfb1dd46 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:19.498713 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec171f-bbcf-4dfa-bdd9-8995bfb1dd46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:19.552692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:19.564604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec171f-bbcf-4dfa-bdd9-8995bfb1dd46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:19.566067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec171f-bbcf-4dfa-bdd9-8995bfb1dd46 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:19.659804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 625/1255] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:05:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:05:19.666461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90367720-b689-4f45-9f17-397384fed36a None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:19.765875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90367720-b689-4f45-9f17-397384fed36a None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:19.779295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:19.799902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198edd93-0e5f-41fc-b7d0-fffa1e6082c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:19.800770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198edd93-0e5f-41fc-b7d0-fffa1e6082c9 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:19.801056 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198edd93-0e5f-41fc-b7d0-fffa1e6082c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:19.801333 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198edd93-0e5f-41fc-b7d0-fffa1e6082c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:19.811529 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198edd93-0e5f-41fc-b7d0-fffa1e6082c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:19.813091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198edd93-0e5f-41fc-b7d0-fffa1e6082c9 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:19.831819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-198edd93-0e5f-41fc-b7d0-fffa1e6082c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:19.831819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:19.831819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:19.831819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:19.831819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:19.831819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:19.831819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:19.831819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:19.831819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:19.831819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:19.831819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:19.831819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:19.831819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:05:19.831819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:05:19.831819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:05:19.832945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:05:19.832945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:19.832945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:19.832945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:19.832945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:19.832945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:19.832945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:19.832945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:19.832945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:05:19.832945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:19.832945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:19.832945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:19.832945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:19.832945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:19.832945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:19.832945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:19.832945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:19.834737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:05:19.834737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:05:19.834737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:19.834737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:19.834737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 631/1256] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:19.839401 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec171f-bbcf-4dfa-bdd9-8995bfb1dd46 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:19.926256 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:19.937993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec171f-bbcf-4dfa-bdd9-8995bfb1dd46 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:19.971613 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b9e34-e0f0-4c1a-8077-174aa057b5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:19.972279 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9e34-e0f0-4c1a-8077-174aa057b5cc None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:19.972563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9e34-e0f0-4c1a-8077-174aa057b5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:19.972877 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9e34-e0f0-4c1a-8077-174aa057b5cc None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:19.973601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b9e34-e0f0-4c1a-8077-174aa057b5cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:19.973912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b9e34-e0f0-4c1a-8077-174aa057b5cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:19.975314 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b9e34-e0f0-4c1a-8077-174aa057b5cc None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:19.986287 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 626/1257] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:19.992094 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198edd93-0e5f-41fc-b7d0-fffa1e6082c9 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:20.092567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198edd93-0e5f-41fc-b7d0-fffa1e6082c9 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:20.128476 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de053677-c5e2-4c28-abad-0f7d7f2bbf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:20.129292 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de053677-c5e2-4c28-abad-0f7d7f2bbf6a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:20.129608 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de053677-c5e2-4c28-abad-0f7d7f2bbf6a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:20.129840 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de053677-c5e2-4c28-abad-0f7d7f2bbf6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:20.137210 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de053677-c5e2-4c28-abad-0f7d7f2bbf6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:20.138656 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de053677-c5e2-4c28-abad-0f7d7f2bbf6a None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:20.151885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-de053677-c5e2-4c28-abad-0f7d7f2bbf6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:05:20.151885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:20.151885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:20.151885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:20.151885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:20.151885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:20.151885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:20.151885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:20.151885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:20.151885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:20.151885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:20.151885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:20.151885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:05:20.151885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:05:20.151885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:05:20.156697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:05:20.156697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:20.156697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:20.156697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:20.156697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:20.156697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:20.156697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:20.156697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:20.156697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:05:20.156697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:20.156697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:20.156697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:20.156697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:20.156697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:20.156697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:20.156697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:20.156697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:20.158262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:05:20.158262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:05:20.158262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:05:20.158262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:05:20.158262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:05:20.158262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:05:20.158262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:05:20.158262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:20.158262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 632/1258] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:05:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:20.159000 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b9e34-e0f0-4c1a-8077-174aa057b5cc None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:20.261713 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b9e34-e0f0-4c1a-8077-174aa057b5cc None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:20.293614 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d97bed-24d9-4cdf-8768-6db32c74713f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:20.294272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d97bed-24d9-4cdf-8768-6db32c74713f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:20.294555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d97bed-24d9-4cdf-8768-6db32c74713f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:20.294834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d97bed-24d9-4cdf-8768-6db32c74713f None admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:20.295615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d97bed-24d9-4cdf-8768-6db32c74713f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:20.295924 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d97bed-24d9-4cdf-8768-6db32c74713f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:20.297422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d97bed-24d9-4cdf-8768-6db32c74713f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:20.310347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 627/1259] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:05:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:05:20.316480 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de053677-c5e2-4c28-abad-0f7d7f2bbf6a None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:20.342112 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:20.413635 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de053677-c5e2-4c28-abad-0f7d7f2bbf6a None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:20.447659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129d823-0fa9-49fc-a3d2-21e8bddbf7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:20.448314 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129d823-0fa9-49fc-a3d2-21e8bddbf7ff None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:20.448622 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129d823-0fa9-49fc-a3d2-21e8bddbf7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:20.448907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129d823-0fa9-49fc-a3d2-21e8bddbf7ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:20.449742 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129d823-0fa9-49fc-a3d2-21e8bddbf7ff None admin] RBAC: Adding query filter params (role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=2d68ccb9b89843078c40b13f79a72dda) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:20.450057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129d823-0fa9-49fc-a3d2-21e8bddbf7ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:20.451526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129d823-0fa9-49fc-a3d2-21e8bddbf7ff None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:20.457023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 633/1260] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:05:20 2022] GET /identity/v3/role_assignments?user.id=2d68ccb9b89843078c40b13f79a72dda&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:05:22.657593 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fbce7-c1bf-4b7d-888d-2860f0882610 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:22.658124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fbce7-c1bf-4b7d-888d-2860f0882610 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:22.658213 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fbce7-c1bf-4b7d-888d-2860f0882610 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:22.659515 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 628/1261] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:05:22.665433 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06f274-4835-4ba9-900d-e31b051cf793 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:22.665874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06f274-4835-4ba9-900d-e31b051cf793 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:22.665976 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06f274-4835-4ba9-900d-e31b051cf793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:22.684454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-1c06f274-4835-4ba9-900d-e31b051cf793 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:05:22.685720 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1c06f274-4835-4ba9-900d-e31b051cf793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:05:22.755220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 634/1262] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:05:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:05:22.778757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fbce7-c1bf-4b7d-888d-2860f0882610 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:22.791148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:22.884574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fbce7-c1bf-4b7d-888d-2860f0882610 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:22.919407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a18e58-f029-4e33-a9c4-398da7ec9c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:22.920313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a18e58-f029-4e33-a9c4-398da7ec9c36 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:22.920623 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a18e58-f029-4e33-a9c4-398da7ec9c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:22.920936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a18e58-f029-4e33-a9c4-398da7ec9c36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:22.931939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a18e58-f029-4e33-a9c4-398da7ec9c36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:05:22.939621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-72a18e58-f029-4e33-a9c4-398da7ec9c36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:05:22.939621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:22.939621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:22.939621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:22.939621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:22.939621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:22.939621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:22.939621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:22.939621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:22.939621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:22.939621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:22.939621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:22.939621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:05:22.939621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:05:22.939621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:05:22.939621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:05:22.941424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:05:22.941424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:05:22.941424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:05:22.941424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:05:22.941424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:22.941424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:22.941424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:22.941424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:22.941424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:22.941424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:22.941424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:22.941424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:05:22.941424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:22.941424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:22.941424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:22.941424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:22.942480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:22.942480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:22.942480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:22.942480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:22.942480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:05:22.942480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:05:22.942480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:05:22.942480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:05:22.942480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:05:22.942480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:05:22.942480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:05:22.942480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:05:22.942480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 629/1263] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:05:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:22.947084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06f274-4835-4ba9-900d-e31b051cf793 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:22.965283 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:23.045317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06f274-4835-4ba9-900d-e31b051cf793 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:23.079604 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653684a-3645-442b-9f3a-404399338510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:23.080300 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653684a-3645-442b-9f3a-404399338510 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:23.080601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653684a-3645-442b-9f3a-404399338510 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:23.080889 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653684a-3645-442b-9f3a-404399338510 None admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:23.081639 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653684a-3645-442b-9f3a-404399338510 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:23.081949 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653684a-3645-442b-9f3a-404399338510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:23.083335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653684a-3645-442b-9f3a-404399338510 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:23.092274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 635/1264] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:05:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:23.098261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a18e58-f029-4e33-a9c4-398da7ec9c36 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:23.165259 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:23.198223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a18e58-f029-4e33-a9c4-398da7ec9c36 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:23.232884 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e51ef3-421e-4960-af46-410e119f66de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:23.233680 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e51ef3-421e-4960-af46-410e119f66de None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:23.233964 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e51ef3-421e-4960-af46-410e119f66de None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:23.234243 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e51ef3-421e-4960-af46-410e119f66de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:23.245044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e51ef3-421e-4960-af46-410e119f66de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:23.246553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e51ef3-421e-4960-af46-410e119f66de None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:23.263443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-a1e51ef3-421e-4960-af46-410e119f66de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:23.263443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:23.263443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:23.263443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:23.263443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:23.263443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:23.263443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:23.263443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:23.263443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:23.263443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:23.263443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:23.263443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:23.263443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:05:23.263443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:05:23.263443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:05:23.267653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:05:23.267653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:23.267653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:23.267653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:23.267653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:23.267653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:23.267653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:23.267653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:23.267653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:05:23.267653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:23.267653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:23.267653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:23.267653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:23.267653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:23.267653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:23.267653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:23.267653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:23.268818 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:05:23.268818 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:05:23.268818 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:23.268818 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:05:23.268818 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 630/1265] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:23.270775 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653684a-3645-442b-9f3a-404399338510 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:23.354239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:23.372901 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653684a-3645-442b-9f3a-404399338510 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:23.406439 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de80154-9041-4f0a-ae5f-7ca4526f070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:23.407099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de80154-9041-4f0a-ae5f-7ca4526f070e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:23.407384 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de80154-9041-4f0a-ae5f-7ca4526f070e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:23.407660 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de80154-9041-4f0a-ae5f-7ca4526f070e None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:23.408385 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de80154-9041-4f0a-ae5f-7ca4526f070e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:23.408722 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de80154-9041-4f0a-ae5f-7ca4526f070e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:23.410085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de80154-9041-4f0a-ae5f-7ca4526f070e None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:23.422365 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 636/1266] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:23.428523 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e51ef3-421e-4960-af46-410e119f66de None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:23.528264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e51ef3-421e-4960-af46-410e119f66de None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:23.547155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:23.561133 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e4e9f-b5ae-487e-84a8-bd0324a8f125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:23.561941 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e4e9f-b5ae-487e-84a8-bd0324a8f125 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:23.562219 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e4e9f-b5ae-487e-84a8-bd0324a8f125 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:23.562491 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e4e9f-b5ae-487e-84a8-bd0324a8f125 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:23.570647 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e4e9f-b5ae-487e-84a8-bd0324a8f125 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:23.572112 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e4e9f-b5ae-487e-84a8-bd0324a8f125 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:23.587695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-389e4e9f-b5ae-487e-84a8-bd0324a8f125 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 21:05:23.587695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:23.587695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:23.587695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:23.587695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:23.587695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:23.587695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:23.587695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:23.587695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:23.587695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:23.587695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:23.587695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:23.587695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:05:23.587695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:05:23.587695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:05:23.587695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:05:23.588905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:23.588905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:23.588905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:05:23.588905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:05:23.588905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:05:23.588905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:05:23.588905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:23.588905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:23.588905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:23.588905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:23.588905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:23.588905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:05:23.588905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:23.588905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:23.588905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:23.588905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:23.588905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:23.588905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:23.594470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:23.594470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:23.594470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:05:23.594470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:05:23.594470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:05:23.594470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:05:23.594470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:05:23.594470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:05:23.594470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 21:05:23.594470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:05:23.594470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 631/1267] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:23.595086 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de80154-9041-4f0a-ae5f-7ca4526f070e None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:23.694861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de80154-9041-4f0a-ae5f-7ca4526f070e None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:23.730826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73dc91-8e29-4565-aa21-01b480b6bdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:23.731568 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73dc91-8e29-4565-aa21-01b480b6bdc2 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:23.731853 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73dc91-8e29-4565-aa21-01b480b6bdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:23.732135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73dc91-8e29-4565-aa21-01b480b6bdc2 None admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:23.733024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73dc91-8e29-4565-aa21-01b480b6bdc2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:23.733338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73dc91-8e29-4565-aa21-01b480b6bdc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:23.734778 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73dc91-8e29-4565-aa21-01b480b6bdc2 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:23.745190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:23.753771 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 637/1268] 10.222.0.66 () {56 vars in 1143 bytes} [Thu May 26 21:05:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:23.760145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e4e9f-b5ae-487e-84a8-bd0324a8f125 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:23.863532 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e4e9f-b5ae-487e-84a8-bd0324a8f125 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:23.897011 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912084c5-d1dc-4c96-a412-39605b7d041c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:23.897786 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912084c5-d1dc-4c96-a412-39605b7d041c None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:23.898067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912084c5-d1dc-4c96-a412-39605b7d041c None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:23.898344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912084c5-d1dc-4c96-a412-39605b7d041c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:23.908836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912084c5-d1dc-4c96-a412-39605b7d041c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:23.910297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912084c5-d1dc-4c96-a412-39605b7d041c None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:23.928414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-912084c5-d1dc-4c96-a412-39605b7d041c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:23.928414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:23.928414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:23.928414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:23.928414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:23.928414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:23.928414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:23.928414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:23.928414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:23.928414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:23.928414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:23.928414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:23.928414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:05:23.928414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:05:23.928414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:05:23.929561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:05:23.929561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:23.929561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:23.929561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:23.929561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:23.929561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:23.929561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:23.929561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:23.929561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:05:23.929561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:23.929561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:23.929561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:23.929561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:23.929561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:23.929561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:23.929561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:23.929561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:23.930832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:05:23.930832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:05:23.930832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:23.930832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:05:23.930832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 632/1269] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:23.935398 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73dc91-8e29-4565-aa21-01b480b6bdc2 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:24.034421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73dc91-8e29-4565-aa21-01b480b6bdc2 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:24.069324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8203da-dec7-493d-839d-f4b592fbc043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:24.070124 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8203da-dec7-493d-839d-f4b592fbc043 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:24.070420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8203da-dec7-493d-839d-f4b592fbc043 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:24.070698 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8203da-dec7-493d-839d-f4b592fbc043 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:24.071429 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8203da-dec7-493d-839d-f4b592fbc043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:24.071738 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8203da-dec7-493d-839d-f4b592fbc043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:24.073202 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8203da-dec7-493d-839d-f4b592fbc043 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:24.086199 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 638/1270] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:24.092001 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912084c5-d1dc-4c96-a412-39605b7d041c None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:24.125131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:24.192960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912084c5-d1dc-4c96-a412-39605b7d041c None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:24.226966 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecd5e3-2ab5-45fc-ade4-698d6c518c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:24.227753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecd5e3-2ab5-45fc-ade4-698d6c518c6f None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:24.228032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecd5e3-2ab5-45fc-ade4-698d6c518c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:24.228303 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecd5e3-2ab5-45fc-ade4-698d6c518c6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:24.236238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecd5e3-2ab5-45fc-ade4-698d6c518c6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:24.237777 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecd5e3-2ab5-45fc-ade4-698d6c518c6f None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:24.252484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-87ecd5e3-2ab5-45fc-ade4-698d6c518c6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:05:24.252484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:24.252484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:24.252484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:24.252484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:24.252484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:24.252484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:24.252484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:24.252484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:24.252484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:24.252484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:24.252484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:24.252484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:05:24.252484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:05:24.252484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:05:24.253638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:05:24.253638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:24.253638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:24.253638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:24.253638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:24.253638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:24.253638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:24.253638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:24.253638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:05:24.253638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:24.253638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:24.253638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:24.253638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:24.253638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:24.253638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:24.253638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:24.253638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:24.254543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:05:24.254543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:05:24.254543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:05:24.254543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:05:24.254543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:05:24.254543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:05:24.254543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:05:24.254543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:05:24.256736 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 633/1271] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:05:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:24.259702 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8203da-dec7-493d-839d-f4b592fbc043 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:24.320519 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:24.361952 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8203da-dec7-493d-839d-f4b592fbc043 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:24.394994 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3990238-6d78-4d1a-bf87-c96b251ba751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:24.395643 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3990238-6d78-4d1a-bf87-c96b251ba751 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:24.395930 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3990238-6d78-4d1a-bf87-c96b251ba751 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:24.396201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3990238-6d78-4d1a-bf87-c96b251ba751 None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:24.397042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3990238-6d78-4d1a-bf87-c96b251ba751 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:24.397346 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3990238-6d78-4d1a-bf87-c96b251ba751 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:24.398756 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3990238-6d78-4d1a-bf87-c96b251ba751 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:24.410355 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 639/1272] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:05:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:24.417037 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecd5e3-2ab5-45fc-ade4-698d6c518c6f None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:24.506504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:24.514929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecd5e3-2ab5-45fc-ade4-698d6c518c6f None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:24.549508 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a44daa-8ea4-462c-a8e0-012acd30be4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:24.550421 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a44daa-8ea4-462c-a8e0-012acd30be4a None admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:24.550701 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a44daa-8ea4-462c-a8e0-012acd30be4a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:24.550975 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a44daa-8ea4-462c-a8e0-012acd30be4a None admin] PATH_INFO: `/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/2d68ccb9b89843078c40b13f79a72dda/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:24.553862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a44daa-8ea4-462c-a8e0-012acd30be4a None admin] RBAC: Authorizing `identity:create_grant(project_id=a3db24bf0708446e9b05197fafeb00e4, user_id=2d68ccb9b89843078c40b13f79a72dda, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:24.555281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a44daa-8ea4-462c-a8e0-012acd30be4a None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:24.739340 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 634/1273] 10.222.0.66 () {58 vars in 1439 bytes} [Thu May 26 21:05:24 2022] PUT /identity/v3/projects/a3db24bf0708446e9b05197fafeb00e4/users/2d68ccb9b89843078c40b13f79a72dda/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:05:26.952957 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be42cb-6854-4fcd-84fc-05037a52830e None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:26.953508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be42cb-6854-4fcd-84fc-05037a52830e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:26.953508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be42cb-6854-4fcd-84fc-05037a52830e None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:26.954801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 640/1274] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:05:26.960907 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5fd0a-a4a4-445a-bc40-4f23c5018050 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:26.969260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5fd0a-a4a4-445a-bc40-4f23c5018050 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:26.969260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5fd0a-a4a4-445a-bc40-4f23c5018050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:26.979366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-45b5fd0a-a4a4-445a-bc40-4f23c5018050 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:05:26.980624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-45b5fd0a-a4a4-445a-bc40-4f23c5018050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:05:27.053588 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 635/1275] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:05:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:05:27.077675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be42cb-6854-4fcd-84fc-05037a52830e None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:27.179857 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be42cb-6854-4fcd-84fc-05037a52830e None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:27.196905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:27.213640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29838a4-3cc2-40de-8b14-12b94b08126e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:27.214375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29838a4-3cc2-40de-8b14-12b94b08126e None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:27.214664 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29838a4-3cc2-40de-8b14-12b94b08126e None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:27.214944 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29838a4-3cc2-40de-8b14-12b94b08126e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:27.224905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29838a4-3cc2-40de-8b14-12b94b08126e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 21:05:27.232517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-f29838a4-3cc2-40de-8b14-12b94b08126e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:05:27.232517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:27.232517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:27.232517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:27.232517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:27.232517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:27.232517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:27.232517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:27.232517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:27.232517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:27.232517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:27.232517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:27.232517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 21:05:27.232517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 21:05:27.232517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 21:05:27.232517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 21:05:27.233632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 21:05:27.233632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 21:05:27.233632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 21:05:27.233632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 21:05:27.233632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:27.233632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:27.233632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:27.233632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:27.233632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:27.233632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:27.233632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:27.233632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:05:27.233632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:27.233632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:27.233632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:27.233632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:27.234619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:27.234619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:27.234619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:27.234619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:27.234619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 21:05:27.234619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 21:05:27.234619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 21:05:27.234619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 21:05:27.234619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 21:05:27.234619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 21:05:27.234619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 21:05:27.234619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:27.234619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 641/1276] 10.222.0.66 () {56 vars in 1096 bytes} [Thu May 26 21:05:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:27.239843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5fd0a-a4a4-445a-bc40-4f23c5018050 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:27.320907 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:27.338652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5fd0a-a4a4-445a-bc40-4f23c5018050 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:27.371027 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cbcdf-185a-47b4-a270-d7ce7f6a79f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:27.371696 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cbcdf-185a-47b4-a270-d7ce7f6a79f7 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:27.371982 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cbcdf-185a-47b4-a270-d7ce7f6a79f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:27.372321 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cbcdf-185a-47b4-a270-d7ce7f6a79f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:27.373111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cbcdf-185a-47b4-a270-d7ce7f6a79f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:27.373432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cbcdf-185a-47b4-a270-d7ce7f6a79f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:27.374806 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cbcdf-185a-47b4-a270-d7ce7f6a79f7 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:27.383435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 636/1277] 10.222.0.66 () {56 vars in 1099 bytes} [Thu May 26 21:05:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:27.389143 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29838a4-3cc2-40de-8b14-12b94b08126e None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:27.488744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29838a4-3cc2-40de-8b14-12b94b08126e None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:27.522168 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f784cdc-3c4f-4da1-ba0b-8e42e701282a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:27.522952 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f784cdc-3c4f-4da1-ba0b-8e42e701282a None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:27.523234 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f784cdc-3c4f-4da1-ba0b-8e42e701282a None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:27.523509 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f784cdc-3c4f-4da1-ba0b-8e42e701282a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:27.534033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f784cdc-3c4f-4da1-ba0b-8e42e701282a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:27.538708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f784cdc-3c4f-4da1-ba0b-8e42e701282a None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:27.552297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-6f784cdc-3c4f-4da1-ba0b-8e42e701282a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:27.552297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:27.552297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:27.552297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:27.552297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:27.552297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:27.552297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:27.552297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:27.552297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:27.552297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:27.552297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:27.552297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:27.552297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:05:27.552297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:05:27.552297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:05:27.553950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:05:27.553950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:27.553950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:27.553950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:27.553950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:27.553950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:27.553950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:27.553950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:27.553950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:05:27.553950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:27.553950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:27.553950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:27.553950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:27.553950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:27.553950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:27.553950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:27.553950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:27.554980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:05:27.554980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:05:27.554980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:27.554980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:27.554980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 642/1278] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:27.560158 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cbcdf-185a-47b4-a270-d7ce7f6a79f7 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:27.664459 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cbcdf-185a-47b4-a270-d7ce7f6a79f7 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:27.699260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999cf7f-1f23-4ee1-8eac-2b1da2571585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:27.699920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999cf7f-1f23-4ee1-8eac-2b1da2571585 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:27.700206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999cf7f-1f23-4ee1-8eac-2b1da2571585 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:27.700480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999cf7f-1f23-4ee1-8eac-2b1da2571585 None admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:27.701238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999cf7f-1f23-4ee1-8eac-2b1da2571585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:27.701547 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999cf7f-1f23-4ee1-8eac-2b1da2571585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:27.702926 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999cf7f-1f23-4ee1-8eac-2b1da2571585 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:27.715075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 637/1279] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:27.721258 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f784cdc-3c4f-4da1-ba0b-8e42e701282a None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:27.752933 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:27.821611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f784cdc-3c4f-4da1-ba0b-8e42e701282a None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:27.855398 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15695a6a-dab6-4b58-bfaf-fd55e6e5589b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:27.856194 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15695a6a-dab6-4b58-bfaf-fd55e6e5589b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:27.856479 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15695a6a-dab6-4b58-bfaf-fd55e6e5589b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:27.856785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15695a6a-dab6-4b58-bfaf-fd55e6e5589b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:27.864068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15695a6a-dab6-4b58-bfaf-fd55e6e5589b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:27.866070 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15695a6a-dab6-4b58-bfaf-fd55e6e5589b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:27.880633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-15695a6a-dab6-4b58-bfaf-fd55e6e5589b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 21:05:27.880633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:27.880633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:27.880633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:27.880633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:27.880633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:27.880633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:27.880633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:27.880633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:27.880633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:27.880633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:27.880633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:27.880633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 21:05:27.880633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 21:05:27.880633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 21:05:27.880633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 21:05:27.882320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:27.882320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:27.882320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 21:05:27.882320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:05:27.882320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 21:05:27.882320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 21:05:27.882320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:27.882320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:27.882320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:27.882320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:27.882320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:27.882320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:05:27.882320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:27.882320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:27.882320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:27.882320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:27.882320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:27.882320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:27.883801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:27.883801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:27.883801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 21:05:27.883801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 21:05:27.883801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 21:05:27.883801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 21:05:27.883801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 21:05:27.883801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 21:05:27.883801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 21:05:27.883801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:27.883801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 643/1280] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:27.888225 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999cf7f-1f23-4ee1-8eac-2b1da2571585 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:27.892011 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:27.983277 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999cf7f-1f23-4ee1-8eac-2b1da2571585 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:28.015574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec6d74-d4af-4187-bf94-e7468850b901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:28.016169 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec6d74-d4af-4187-bf94-e7468850b901 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:28.016449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec6d74-d4af-4187-bf94-e7468850b901 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:28.016757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec6d74-d4af-4187-bf94-e7468850b901 None admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:28.017583 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec6d74-d4af-4187-bf94-e7468850b901 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:28.017888 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec6d74-d4af-4187-bf94-e7468850b901 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:28.019346 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec6d74-d4af-4187-bf94-e7468850b901 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:28.035722 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 638/1281] 10.222.0.66 () {56 vars in 1143 bytes} [Thu May 26 21:05:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:28.041951 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15695a6a-dab6-4b58-bfaf-fd55e6e5589b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:28.131574 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:28.140803 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15695a6a-dab6-4b58-bfaf-fd55e6e5589b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:28.173293 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb2bf7-037d-4f3b-9f9e-3b98a9a4a09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:28.173938 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb2bf7-037d-4f3b-9f9e-3b98a9a4a09b None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:28.174222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb2bf7-037d-4f3b-9f9e-3b98a9a4a09b None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:28.174498 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb2bf7-037d-4f3b-9f9e-3b98a9a4a09b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:28.243037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb2bf7-037d-4f3b-9f9e-3b98a9a4a09b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:28.244484 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb2bf7-037d-4f3b-9f9e-3b98a9a4a09b None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:28.330067 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:28.340537 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 644/1282] 10.222.0.66 () {58 vars in 1282 bytes} [Thu May 26 21:05:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 21:05:28.346421 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec6d74-d4af-4187-bf94-e7468850b901 None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:28.406491 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:28.444439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec6d74-d4af-4187-bf94-e7468850b901 None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:28.478502 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1f1cc-3062-4ded-9dcf-078c7d44d1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:28.479290 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1f1cc-3062-4ded-9dcf-078c7d44d1cd None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:28.479577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1f1cc-3062-4ded-9dcf-078c7d44d1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:28.479855 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1f1cc-3062-4ded-9dcf-078c7d44d1cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:28.490012 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1f1cc-3062-4ded-9dcf-078c7d44d1cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:28.491495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1f1cc-3062-4ded-9dcf-078c7d44d1cd None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:28.508173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-58e1f1cc-3062-4ded-9dcf-078c7d44d1cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:28.508173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:28.508173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:28.508173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:28.508173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:28.508173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:28.508173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:28.508173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:28.508173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:28.508173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:28.508173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:28.508173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:28.508173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 21:05:28.508173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 21:05:28.508173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 21:05:28.509406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 21:05:28.509406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:28.509406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:28.509406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:28.509406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:28.509406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:28.509406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:28.509406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:28.509406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:05:28.509406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:28.509406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:28.509406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:28.509406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:28.509406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:28.509406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:28.509406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:28.509406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:28.510644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 21:05:28.510644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 21:05:28.510644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 21:05:28.510644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:05:28.510644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 639/1283] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:05:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:28.515349 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb2bf7-037d-4f3b-9f9e-3b98a9a4a09b None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:28.613928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb2bf7-037d-4f3b-9f9e-3b98a9a4a09b None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:28.647638 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4457f-a795-473a-953f-9a980c65cff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:28.648298 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4457f-a795-473a-953f-9a980c65cff7 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:28.648602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4457f-a795-473a-953f-9a980c65cff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:28.648886 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4457f-a795-473a-953f-9a980c65cff7 None admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:28.649607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4457f-a795-473a-953f-9a980c65cff7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:28.649920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4457f-a795-473a-953f-9a980c65cff7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:28.651279 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4457f-a795-473a-953f-9a980c65cff7 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:28.663105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 645/1284] 10.222.0.66 () {56 vars in 1109 bytes} [Thu May 26 21:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:28.668953 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1f1cc-3062-4ded-9dcf-078c7d44d1cd None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:28.767212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1f1cc-3062-4ded-9dcf-078c7d44d1cd None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:28.781037 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:28.800490 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4b71a-3574-4a2b-8858-598216dbdc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:28.801358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4b71a-3574-4a2b-8858-598216dbdc8e None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:28.801635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4b71a-3574-4a2b-8858-598216dbdc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:28.801905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4b71a-3574-4a2b-8858-598216dbdc8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:28.808661 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4b71a-3574-4a2b-8858-598216dbdc8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:28.811942 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4b71a-3574-4a2b-8858-598216dbdc8e None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:28.824233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application [None req-8ca4b71a-3574-4a2b-8858-598216dbdc8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:05:28.824233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:28.824233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:28.824233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:28.824233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:28.824233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:28.824233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:28.824233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:28.824233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:28.824233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:28.824233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:28.824233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:28.824233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 21:05:28.824233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 21:05:28.824233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 21:05:28.825343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 21:05:28.825343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:28.825343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:28.825343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:28.825343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:28.825343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:28.825343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:28.825343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:28.825343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application with Lock( May 26 21:05:28.825343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:28.825343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:28.825343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:28.825343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:28.825343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:28.825343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:28.825343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:28.825343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:28.826474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 21:05:28.826474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 21:05:28.826474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 21:05:28.826474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 21:05:28.826474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 21:05:28.826474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 21:05:28.826474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 21:05:28.826474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: ERROR keystone.server.flask.application May 26 21:05:28.826474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 640/1285] 10.222.0.66 () {56 vars in 1111 bytes} [Thu May 26 21:05:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:28.831288 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4457f-a795-473a-953f-9a980c65cff7 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:28.881406 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:28.928605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4457f-a795-473a-953f-9a980c65cff7 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:28.960667 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2e171-a9d4-487e-bd9a-fe6a60ca5ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:28.961313 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2e171-a9d4-487e-bd9a-fe6a60ca5ffb None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:28.961593 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2e171-a9d4-487e-bd9a-fe6a60ca5ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:28.961864 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2e171-a9d4-487e-bd9a-fe6a60ca5ffb None admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:28.962639 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2e171-a9d4-487e-bd9a-fe6a60ca5ffb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:28.962943 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2e171-a9d4-487e-bd9a-fe6a60ca5ffb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:28.964356 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2e171-a9d4-487e-bd9a-fe6a60ca5ffb None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:28.976238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 646/1286] 10.222.0.66 () {56 vars in 1148 bytes} [Thu May 26 21:05:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:28.982780 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4b71a-3574-4a2b-8858-598216dbdc8e None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:29.078617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4b71a-3574-4a2b-8858-598216dbdc8e None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:29.110759 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015a5e1-26d6-4397-9b50-b717f4ff4e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:29.111408 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015a5e1-26d6-4397-9b50-b717f4ff4e48 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:29.111688 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015a5e1-26d6-4397-9b50-b717f4ff4e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:29.111965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015a5e1-26d6-4397-9b50-b717f4ff4e48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:29.112817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015a5e1-26d6-4397-9b50-b717f4ff4e48 None admin] RBAC: Adding query filter params (role.id=2e83f1fc8fb3416f956854dacd0843c1, scope.project.id=a3db24bf0708446e9b05197fafeb00e4, user.id=2d68ccb9b89843078c40b13f79a72dda) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:29.113130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015a5e1-26d6-4397-9b50-b717f4ff4e48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:29.114577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015a5e1-26d6-4397-9b50-b717f4ff4e48 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:29.121525 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 641/1287] 10.222.0.66 () {56 vars in 1374 bytes} [Thu May 26 21:05:28 2022] GET /identity/v3/role_assignments?user.id=2d68ccb9b89843078c40b13f79a72dda&scope.project.id=a3db24bf0708446e9b05197fafeb00e4&role.id=2e83f1fc8fb3416f956854dacd0843c1 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:31.338776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ba24f-841f-4293-b374-66ef28924f90 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:31.339334 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ba24f-841f-4293-b374-66ef28924f90 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:31.339334 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ba24f-841f-4293-b374-66ef28924f90 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:31.340970 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 647/1288] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:05:31.346350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c0a79-3842-4159-af2b-15614595644e None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:31.346818 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c0a79-3842-4159-af2b-15614595644e None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:31.346922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c0a79-3842-4159-af2b-15614595644e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:31.364454 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-e28c0a79-3842-4159-af2b-15614595644e None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:05:31.365675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-e28c0a79-3842-4159-af2b-15614595644e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:05:31.396143 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:31.436642 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 642/1289] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:05:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:05:31.459125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ba24f-841f-4293-b374-66ef28924f90 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:31.562779 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ba24f-841f-4293-b374-66ef28924f90 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:31.574381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:31.598729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c76510-0af7-49fc-8ed9-f8167486dd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:31.598729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c76510-0af7-49fc-8ed9-f8167486dd48 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:31.598729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c76510-0af7-49fc-8ed9-f8167486dd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:31.599108 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c76510-0af7-49fc-8ed9-f8167486dd48 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:31.599691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c76510-0af7-49fc-8ed9-f8167486dd48 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:31.601194 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c76510-0af7-49fc-8ed9-f8167486dd48 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:31.612972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-82c76510-0af7-49fc-8ed9-f8167486dd48 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 21:05:31.612972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:31.612972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:05:31.612972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:05:31.612972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:05:31.612972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:05:31.612972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:05:31.612972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:05:31.612972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 21:05:31.612972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:31.612972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:05:31.612972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:31.612972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:31.612972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:31.612972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:31.612972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:31.612972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:31.614228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:31.614228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:31.614228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:31.614228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:31.614228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:31.614228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:31.614228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:05:31.614228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:05:31.614228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:05:31.614228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:05:31.614228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:31.614228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:31.614228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:31.614228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:31.614228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:31.614228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:31.615340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:31.615340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:05:31.615340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:31.615340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:31.615340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:31.615340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:31.615340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:31.615340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:31.615340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:31.615340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:31.615340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:05:31.615340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:05:31.615340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 21:05:31.615340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:31.615340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 648/1290] 10.222.0.66 () {56 vars in 1117 bytes} [Thu May 26 21:05:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:31.620763 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c0a79-3842-4159-af2b-15614595644e None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:31.717490 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c0a79-3842-4159-af2b-15614595644e None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:31.750833 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b293ca-0e29-48ad-a20d-68b4a9839858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:31.753171 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b293ca-0e29-48ad-a20d-68b4a9839858 None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:31.753171 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b293ca-0e29-48ad-a20d-68b4a9839858 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:31.753171 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b293ca-0e29-48ad-a20d-68b4a9839858 None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:31.753171 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b293ca-0e29-48ad-a20d-68b4a9839858 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:31.753171 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b293ca-0e29-48ad-a20d-68b4a9839858 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:31.754366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b293ca-0e29-48ad-a20d-68b4a9839858 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:31.759067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 643/1291] 10.222.0.66 () {56 vars in 1116 bytes} [Thu May 26 21:05:31 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:31.764887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c76510-0af7-49fc-8ed9-f8167486dd48 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:31.863099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c76510-0af7-49fc-8ed9-f8167486dd48 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:31.895621 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273f68b-58d6-4015-b8af-3870d62f8ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:31.896280 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273f68b-58d6-4015-b8af-3870d62f8ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:31.896564 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273f68b-58d6-4015-b8af-3870d62f8ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:31.896873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273f68b-58d6-4015-b8af-3870d62f8ee3 None admin] PATH_INFO: `/v3/services` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:31.897691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273f68b-58d6-4015-b8af-3870d62f8ee3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:31.897998 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273f68b-58d6-4015-b8af-3870d62f8ee3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:31.899355 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273f68b-58d6-4015-b8af-3870d62f8ee3 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:31.903706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 649/1292] 10.222.0.66 () {56 vars in 1116 bytes} [Thu May 26 21:05:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:34.086086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6cdc3-5301-47c1-b550-ad199b0b34ab None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:34.086655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6cdc3-5301-47c1-b550-ad199b0b34ab None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:34.086655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6cdc3-5301-47c1-b550-ad199b0b34ab None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:34.088031 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 644/1293] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:05:34.093367 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff93dd1-5f94-4d46-a5ea-50aebe4adc4c None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:34.093817 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff93dd1-5f94-4d46-a5ea-50aebe4adc4c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:34.093984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff93dd1-5f94-4d46-a5ea-50aebe4adc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:34.111065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-aff93dd1-5f94-4d46-a5ea-50aebe4adc4c None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:05:34.112240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-aff93dd1-5f94-4d46-a5ea-50aebe4adc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:05:34.142295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:34.177963 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 650/1294] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:05:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:05:34.201489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6cdc3-5301-47c1-b550-ad199b0b34ab None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:34.232039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:34.304097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6cdc3-5301-47c1-b550-ad199b0b34ab None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:34.337833 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d9165-42ac-48ec-b108-82285db67ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:34.338412 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d9165-42ac-48ec-b108-82285db67ac0 None admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:34.338753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d9165-42ac-48ec-b108-82285db67ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:34.339022 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d9165-42ac-48ec-b108-82285db67ac0 None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:34.339753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d9165-42ac-48ec-b108-82285db67ac0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:34.341178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d9165-42ac-48ec-b108-82285db67ac0 None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:34.436675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 645/1295] 10.222.0.66 () {60 vars in 1141 bytes} [Thu May 26 21:05:34 2022] POST /identity/v3/services => generated 246 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:05:36.633765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3be964-16f2-4561-9aee-298e75c56656 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:36.634404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3be964-16f2-4561-9aee-298e75c56656 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:36.634404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3be964-16f2-4561-9aee-298e75c56656 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:36.635770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 651/1296] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:05:36.641179 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedadda-93d5-47ae-9548-fee0be3cccbc None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:36.641630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedadda-93d5-47ae-9548-fee0be3cccbc None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:36.641747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedadda-93d5-47ae-9548-fee0be3cccbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:36.658105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-ebedadda-93d5-47ae-9548-fee0be3cccbc None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:05:36.659271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ebedadda-93d5-47ae-9548-fee0be3cccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:05:36.731168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 646/1297] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:05:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:05:36.754185 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3be964-16f2-4561-9aee-298e75c56656 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:36.854413 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3be964-16f2-4561-9aee-298e75c56656 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:36.887482 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb9c19-77a8-4065-b30a-1d339e2a5dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:36.888274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb9c19-77a8-4065-b30a-1d339e2a5dbf None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:36.888548 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb9c19-77a8-4065-b30a-1d339e2a5dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:36.888852 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb9c19-77a8-4065-b30a-1d339e2a5dbf None admin] PATH_INFO: `/v3/services/placement` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:36.889497 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb9c19-77a8-4065-b30a-1d339e2a5dbf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:36.890863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb9c19-77a8-4065-b30a-1d339e2a5dbf None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:36.902599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-deeb9c19-77a8-4065-b30a-1d339e2a5dbf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 21:05:36.902599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:36.902599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:05:36.902599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:05:36.902599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:05:36.902599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:05:36.902599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:05:36.902599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:05:36.902599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 21:05:36.902599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:36.902599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:05:36.902599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:36.902599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:36.902599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:36.902599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:36.902599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:36.902599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:36.903833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:36.903833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:36.903833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:36.903833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:36.903833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:36.903833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:36.903833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:05:36.903833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:05:36.903833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:05:36.903833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:05:36.903833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:36.903833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:36.903833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:36.903833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:36.903833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:36.903833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:36.905080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:36.905080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:05:36.905080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:36.905080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:36.905080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:36.905080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:36.905080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:36.905080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:36.905080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:36.905080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:36.905080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:05:36.905080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:05:36.905080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 21:05:36.905080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:36.905080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 652/1298] 10.222.0.66 () {56 vars in 1117 bytes} [Thu May 26 21:05:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:36.909853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedadda-93d5-47ae-9548-fee0be3cccbc None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:36.928199 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:37.007247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedadda-93d5-47ae-9548-fee0be3cccbc None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:37.040763 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b601a0-7244-4f6d-980c-eafc10ba0b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:37.041599 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b601a0-7244-4f6d-980c-eafc10ba0b5a None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:37.042105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b601a0-7244-4f6d-980c-eafc10ba0b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:37.042804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b601a0-7244-4f6d-980c-eafc10ba0b5a None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:37.043523 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b601a0-7244-4f6d-980c-eafc10ba0b5a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:37.043836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b601a0-7244-4f6d-980c-eafc10ba0b5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:37.045295 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b601a0-7244-4f6d-980c-eafc10ba0b5a None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:37.050297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 647/1299] 10.222.0.66 () {56 vars in 1116 bytes} [Thu May 26 21:05:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:37.057227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb9c19-77a8-4065-b30a-1d339e2a5dbf None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:37.087417 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:37.152678 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb9c19-77a8-4065-b30a-1d339e2a5dbf None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:37.185858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4faaf7-3c39-4049-b307-4423b29d1f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:37.186509 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4faaf7-3c39-4049-b307-4423b29d1f30 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:37.186790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4faaf7-3c39-4049-b307-4423b29d1f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:37.187065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4faaf7-3c39-4049-b307-4423b29d1f30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:37.187848 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4faaf7-3c39-4049-b307-4423b29d1f30 None admin] RBAC: Adding query filter params (interface=public, service_id=d8e8bc30cb9349ad9697d68e2ea93a3f, region_id=RegionOne) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:37.188158 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4faaf7-3c39-4049-b307-4423b29d1f30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:37.189550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4faaf7-3c39-4049-b307-4423b29d1f30 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:37.194376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 653/1300] 10.222.0.66 () {56 vars in 1251 bytes} [Thu May 26 21:05:37 2022] GET /identity/v3/endpoints?service_id=d8e8bc30cb9349ad9697d68e2ea93a3f&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:37.200054 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b601a0-7244-4f6d-980c-eafc10ba0b5a None admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:37.283828 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:37.301335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b601a0-7244-4f6d-980c-eafc10ba0b5a None admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:37.333623 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b649c0a-e40b-4185-897a-58fd0a24784a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:37.334273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b649c0a-e40b-4185-897a-58fd0a24784a None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:37.335034 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b649c0a-e40b-4185-897a-58fd0a24784a None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:37.335316 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b649c0a-e40b-4185-897a-58fd0a24784a None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:37.335989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b649c0a-e40b-4185-897a-58fd0a24784a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:37.337391 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b649c0a-e40b-4185-897a-58fd0a24784a None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:37.344017 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 648/1301] 10.222.0.66 () {56 vars in 1087 bytes} [Thu May 26 21:05:37 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:05:39.546494 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a3f3-9914-489d-854c-235b4be012c8 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:39.547037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a3f3-9914-489d-854c-235b4be012c8 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:39.547037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a3f3-9914-489d-854c-235b4be012c8 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:39.548427 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 654/1302] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:05:39.554540 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedf070-6a43-4447-a9df-9a4c2934057a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:39.554960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedf070-6a43-4447-a9df-9a4c2934057a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:39.555103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedf070-6a43-4447-a9df-9a4c2934057a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:39.572870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-0dedf070-6a43-4447-a9df-9a4c2934057a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:05:39.574045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-0dedf070-6a43-4447-a9df-9a4c2934057a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:05:39.639742 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 649/1303] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:05:39 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 21:05:39.662355 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7a3f3-9914-489d-854c-235b4be012c8 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:39.758530 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:39.764915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7a3f3-9914-489d-854c-235b4be012c8 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:39.797205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d8116-2db5-488e-94f7-b31a16ba2d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:39.797938 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d8116-2db5-488e-94f7-b31a16ba2d08 None admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:39.798223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d8116-2db5-488e-94f7-b31a16ba2d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:39.798499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d8116-2db5-488e-94f7-b31a16ba2d08 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:39.799159 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d8116-2db5-488e-94f7-b31a16ba2d08 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:39.800599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d8116-2db5-488e-94f7-b31a16ba2d08 None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:39.813269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application [None req-779d8116-2db5-488e-94f7-b31a16ba2d08 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 21:05:39.813269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:39.813269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 21:05:39.813269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 21:05:39.813269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 21:05:39.813269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 21:05:39.813269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 21:05:39.813269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:05:39.813269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 21:05:39.813269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:39.813269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 21:05:39.813269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:39.813269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 21:05:39.813269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 21:05:39.813269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 21:05:39.813269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 21:05:39.813269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 21:05:39.814449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 21:05:39.814449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 21:05:39.814449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 21:05:39.814449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 21:05:39.814449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 21:05:39.814449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 21:05:39.814449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 21:05:39.814449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 21:05:39.814449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 21:05:39.814449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 21:05:39.814449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 21:05:39.814449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 21:05:39.814449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 21:05:39.814449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 21:05:39.814449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 21:05:39.814449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.get_or_create( May 26 21:05:39.815603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 21:05:39.815603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application with Lock( May 26 21:05:39.815603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 21:05:39.815603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self._enter() May 26 21:05:39.815603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 21:05:39.815603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 21:05:39.815603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 21:05:39.815603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application return self.creator() May 26 21:05:39.815603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 21:05:39.815603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application created_value = creator( May 26 21:05:39.815603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 21:05:39.815603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 21:05:39.815603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 21:05:39.815603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: ERROR keystone.server.flask.application May 26 21:05:39.815603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 655/1304] 10.222.0.66 () {56 vars in 1117 bytes} [Thu May 26 21:05:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 21:05:39.821266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedf070-6a43-4447-a9df-9a4c2934057a None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:39.895052 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:39.917240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedf070-6a43-4447-a9df-9a4c2934057a None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:39.951150 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4839798-99b1-419e-96f5-eea5faa39bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:39.951808 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4839798-99b1-419e-96f5-eea5faa39bef None admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:39.952093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4839798-99b1-419e-96f5-eea5faa39bef None admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:39.952368 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4839798-99b1-419e-96f5-eea5faa39bef None admin] PATH_INFO: `/v3/services` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:39.953102 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4839798-99b1-419e-96f5-eea5faa39bef None admin] RBAC: Adding query filter params (name=placement) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:05:39.953409 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4839798-99b1-419e-96f5-eea5faa39bef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:39.954829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4839798-99b1-419e-96f5-eea5faa39bef None admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:39.959977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 650/1305] 10.222.0.66 () {56 vars in 1116 bytes} [Thu May 26 21:05:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:05:39.965714 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d8116-2db5-488e-94f7-b31a16ba2d08 None admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:05:40.065999 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d8116-2db5-488e-94f7-b31a16ba2d08 None admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:05:40.098280 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f46c6a-bb78-40a7-b1ba-cd2ed5a994cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:05:40.098967 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f46c6a-bb78-40a7-b1ba-cd2ed5a994cb None admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:05:40.099221 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f46c6a-bb78-40a7-b1ba-cd2ed5a994cb None admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:05:40.099501 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f46c6a-bb78-40a7-b1ba-cd2ed5a994cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:05:40.100782 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f46c6a-bb78-40a7-b1ba-cd2ed5a994cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:05:40.104351 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f46c6a-bb78-40a7-b1ba-cd2ed5a994cb None admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:05:40.202406 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 656/1306] 10.222.0.66 () {60 vars in 1144 bytes} [Thu May 26 21:05:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:05:49.957005 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=30 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:05:50.197333 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:10.060803 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cc0f5-6624-4116-bb8a-68cbf4a811bb None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:10.061844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cc0f5-6624-4116-bb8a-68cbf4a811bb None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:10.062358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cc0f5-6624-4116-bb8a-68cbf4a811bb None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:10.069928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697645aa-5fdb-407d-9aaa-e514b8fbdca3 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:10.070839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697645aa-5fdb-407d-9aaa-e514b8fbdca3 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:10.071316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697645aa-5fdb-407d-9aaa-e514b8fbdca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:10.074957 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 651/1307] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:12:10 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:12:10.163444 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-697645aa-5fdb-407d-9aaa-e514b8fbdca3 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:10.165042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-697645aa-5fdb-407d-9aaa-e514b8fbdca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:10.425641 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 657/1308] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:12:10.467259 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f3c37-6900-4bc2-8240-7cc841d3e182 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:10.467488 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f3c37-6900-4bc2-8240-7cc841d3e182 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:10.467947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f3c37-6900-4bc2-8240-7cc841d3e182 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:10.471294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 652/1309] 10.222.0.66 () {54 vars in 964 bytes} [Thu May 26 21:12:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:12:10.476037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c0d10-4c29-484a-b4bf-feeddfcfd747 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:10.476705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c0d10-4c29-484a-b4bf-feeddfcfd747 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:10.476705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c0d10-4c29-484a-b4bf-feeddfcfd747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:10.569156 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-171c0d10-4c29-484a-b4bf-feeddfcfd747 None None] MFA Rules not processed for user `98ec4e37c2714729afec6ad805ed775a`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:10.570592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-171c0d10-4c29-484a-b4bf-feeddfcfd747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:10.601996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:10.663552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 658/1310] 10.222.0.66 () {58 vars in 1061 bytes} [Thu May 26 21:12:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:12:10.672527 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f3c37-6900-4bc2-8240-7cc841d3e182 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:12:10.674559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-147f3c37-6900-4bc2-8240-7cc841d3e182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:10.790623 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f3c37-6900-4bc2-8240-7cc841d3e182 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:12:10.875093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d07ae6-5b44-433e-a4ad-521230cf955e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:12:10.875750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d07ae6-5b44-433e-a4ad-521230cf955e service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:10.876031 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d07ae6-5b44-433e-a4ad-521230cf955e service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:10.876302 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d07ae6-5b44-433e-a4ad-521230cf955e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:10.878078 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-13d07ae6-5b44-433e-a4ad-521230cf955e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:10.939183 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:10.996118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d07ae6-5b44-433e-a4ad-521230cf955e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:12:10.997747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d07ae6-5b44-433e-a4ad-521230cf955e service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:12:11.017375 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 653/1311] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:12:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:12:13.553742 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98052fa-bfde-4343-ac27-4b303c419674 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:13.554252 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98052fa-bfde-4343-ac27-4b303c419674 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:13.554332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98052fa-bfde-4343-ac27-4b303c419674 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:13.555831 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 659/1312] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:12:13.561101 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74eead-1f50-44ca-a9b8-12b37022cd97 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:13.561544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74eead-1f50-44ca-a9b8-12b37022cd97 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:13.561690 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74eead-1f50-44ca-a9b8-12b37022cd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:13.651988 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-0e74eead-1f50-44ca-a9b8-12b37022cd97 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:13.653266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-0e74eead-1f50-44ca-a9b8-12b37022cd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:13.773723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 654/1313] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:12:13.813518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98052fa-bfde-4343-ac27-4b303c419674 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:12:13.815377 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-a98052fa-bfde-4343-ac27-4b303c419674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:13.929512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98052fa-bfde-4343-ac27-4b303c419674 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:12:14.003522 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:14.006884 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394b5b2-3250-4285-b00f-ac365ca94a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:12:14.007542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394b5b2-3250-4285-b00f-ac365ca94a04 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:14.007821 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394b5b2-3250-4285-b00f-ac365ca94a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:14.008091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394b5b2-3250-4285-b00f-ac365ca94a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:14.009782 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-9394b5b2-3250-4285-b00f-ac365ca94a04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:14.132766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394b5b2-3250-4285-b00f-ac365ca94a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:12:14.134406 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394b5b2-3250-4285-b00f-ac365ca94a04 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:12:14.157909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 660/1314] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:12:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:12:16.929253 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e27ef-ad82-4859-8626-f89db92ec4ec None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:16.929792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e27ef-ad82-4859-8626-f89db92ec4ec None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:16.929792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e27ef-ad82-4859-8626-f89db92ec4ec None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:16.931207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 655/1315] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:12:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:12:16.936388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691ab62-71ea-4b69-8b3e-75aff906b894 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:16.936865 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691ab62-71ea-4b69-8b3e-75aff906b894 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:16.936988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691ab62-71ea-4b69-8b3e-75aff906b894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:17.000056 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-e691ab62-71ea-4b69-8b3e-75aff906b894 None None] MFA Rules not processed for user `e941a7c6994b4caf960392573fa084ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:17.001264 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e691ab62-71ea-4b69-8b3e-75aff906b894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:17.051950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:17.095175 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 661/1316] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:12:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:12:17.134605 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e27ef-ad82-4859-8626-f89db92ec4ec None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:12:17.136130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-181e27ef-ad82-4859-8626-f89db92ec4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:17.145850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:17.245480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e27ef-ad82-4859-8626-f89db92ec4ec None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:12:17.313137 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da3e5a-67da-426e-a735-13cb113677f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:12:17.313830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da3e5a-67da-426e-a735-13cb113677f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:17.314113 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da3e5a-67da-426e-a735-13cb113677f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:17.314387 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da3e5a-67da-426e-a735-13cb113677f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:17.316027 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b8da3e5a-67da-426e-a735-13cb113677f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:17.376487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:17.421900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da3e5a-67da-426e-a735-13cb113677f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:12:17.423646 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da3e5a-67da-426e-a735-13cb113677f2 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:12:17.442208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 656/1317] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:12:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:12:20.481795 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b780126-379c-4a22-b82a-7785b3a0c755 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:20.482306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b780126-379c-4a22-b82a-7785b3a0c755 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:20.482306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b780126-379c-4a22-b82a-7785b3a0c755 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:20.483624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 662/1318] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:12:20.488957 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd8982-3c71-41ab-b7c9-5c8221d39376 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:20.489364 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd8982-3c71-41ab-b7c9-5c8221d39376 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:20.489518 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd8982-3c71-41ab-b7c9-5c8221d39376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:20.554570 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-e3cd8982-3c71-41ab-b7c9-5c8221d39376 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:20.555817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-e3cd8982-3c71-41ab-b7c9-5c8221d39376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:20.648327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 657/1319] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:12:20.687291 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b780126-379c-4a22-b82a-7785b3a0c755 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:12:20.688870 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0b780126-379c-4a22-b82a-7785b3a0c755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:20.792204 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b780126-379c-4a22-b82a-7785b3a0c755 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:12:20.865785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc46bd-c9fa-4f6b-af73-e52cf3da3155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:12:20.866445 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc46bd-c9fa-4f6b-af73-e52cf3da3155 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:20.866729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc46bd-c9fa-4f6b-af73-e52cf3da3155 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:20.867007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc46bd-c9fa-4f6b-af73-e52cf3da3155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:20.868705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-18bc46bd-c9fa-4f6b-af73-e52cf3da3155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:20.875411 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:20.975565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc46bd-c9fa-4f6b-af73-e52cf3da3155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:12:20.977046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc46bd-c9fa-4f6b-af73-e52cf3da3155 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:12:20.994819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 663/1320] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:12:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:12:24.256215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75397e-bcd4-44c6-b507-2572c8469fa8 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:24.256778 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75397e-bcd4-44c6-b507-2572c8469fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:24.256896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75397e-bcd4-44c6-b507-2572c8469fa8 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:24.258345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 658/1321] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:12:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:12:24.263787 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d050859-455d-4683-bc37-63e8ad5e6850 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:24.264247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d050859-455d-4683-bc37-63e8ad5e6850 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:24.265076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d050859-455d-4683-bc37-63e8ad5e6850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:24.329714 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-4d050859-455d-4683-bc37-63e8ad5e6850 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:24.330863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4d050859-455d-4683-bc37-63e8ad5e6850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:24.388733 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:24.427368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 664/1322] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:12:24.478948 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d728430-fabb-4fc8-9d4f-149ecf64fc8c None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:24.479243 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d728430-fabb-4fc8-9d4f-149ecf64fc8c None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:24.479512 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d728430-fabb-4fc8-9d4f-149ecf64fc8c None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:24.480961 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 659/1323] 10.222.0.66 () {54 vars in 964 bytes} [Thu May 26 21:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:12:24.487110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1158f04-f72e-49ae-baeb-93c3b6437de6 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:24.487401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1158f04-f72e-49ae-baeb-93c3b6437de6 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:24.487684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1158f04-f72e-49ae-baeb-93c3b6437de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:24.564632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-d1158f04-f72e-49ae-baeb-93c3b6437de6 None None] MFA Rules not processed for user `98ec4e37c2714729afec6ad805ed775a`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:24.565856 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d1158f04-f72e-49ae-baeb-93c3b6437de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:24.642781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 665/1324] 10.222.0.66 () {58 vars in 1061 bytes} [Thu May 26 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:12:24.651783 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d728430-fabb-4fc8-9d4f-149ecf64fc8c None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:12:24.653337 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-6d728430-fabb-4fc8-9d4f-149ecf64fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:24.672824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:24.758596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d728430-fabb-4fc8-9d4f-149ecf64fc8c None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:12:24.832105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0889b5-cc1c-4a6b-8358-834c1eef3eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:12:24.832786 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0889b5-cc1c-4a6b-8358-834c1eef3eaa service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:24.833096 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0889b5-cc1c-4a6b-8358-834c1eef3eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:24.833371 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0889b5-cc1c-4a6b-8358-834c1eef3eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:24.835154 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3d0889b5-cc1c-4a6b-8358-834c1eef3eaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:24.908516 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:24.946873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0889b5-cc1c-4a6b-8358-834c1eef3eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:12:24.948329 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0889b5-cc1c-4a6b-8358-834c1eef3eaa service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:12:24.967084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 660/1325] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:12:27.498417 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc907da3-0089-4ee6-83a3-3148281766b6 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:27.498992 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc907da3-0089-4ee6-83a3-3148281766b6 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:27.498992 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc907da3-0089-4ee6-83a3-3148281766b6 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:27.500316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 666/1326] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:12:27.506402 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e3c0a-b4f3-47ce-8e25-bdbbf40a8bc9 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:27.506814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e3c0a-b4f3-47ce-8e25-bdbbf40a8bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:27.506963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e3c0a-b4f3-47ce-8e25-bdbbf40a8bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:27.571542 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-cc0e3c0a-b4f3-47ce-8e25-bdbbf40a8bc9 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:27.572772 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-cc0e3c0a-b4f3-47ce-8e25-bdbbf40a8bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:27.672292 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 661/1327] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:12:27.709606 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc907da3-0089-4ee6-83a3-3148281766b6 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:12:27.711132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-cc907da3-0089-4ee6-83a3-3148281766b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:27.774963 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:27.819541 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc907da3-0089-4ee6-83a3-3148281766b6 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:12:27.894606 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc6257-ee2d-42ef-9fe5-a7bfdf6a4962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:12:27.895256 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc6257-ee2d-42ef-9fe5-a7bfdf6a4962 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:27.895535 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc6257-ee2d-42ef-9fe5-a7bfdf6a4962 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:27.895806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc6257-ee2d-42ef-9fe5-a7bfdf6a4962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:27.897459 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-88fc6257-ee2d-42ef-9fe5-a7bfdf6a4962 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:28.008971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:28.011751 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc6257-ee2d-42ef-9fe5-a7bfdf6a4962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:12:28.013259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc6257-ee2d-42ef-9fe5-a7bfdf6a4962 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:12:28.031961 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 667/1328] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:12:30.296620 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2572a-55ab-4c21-bb63-fc70ef765028 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:30.297150 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2572a-55ab-4c21-bb63-fc70ef765028 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:30.297150 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2572a-55ab-4c21-bb63-fc70ef765028 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:30.298728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 662/1329] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:12:30.304037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a0428-6e7a-4237-b933-07c714577988 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:30.304477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a0428-6e7a-4237-b933-07c714577988 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:30.304625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a0428-6e7a-4237-b933-07c714577988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:30.369636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-b03a0428-6e7a-4237-b933-07c714577988 None None] MFA Rules not processed for user `e941a7c6994b4caf960392573fa084ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:30.370851 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-b03a0428-6e7a-4237-b933-07c714577988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:30.466392 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 668/1330] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:12:30.503676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2572a-55ab-4c21-bb63-fc70ef765028 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:12:30.505809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-78b2572a-55ab-4c21-bb63-fc70ef765028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:30.536398 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:30.609396 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2572a-55ab-4c21-bb63-fc70ef765028 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:12:30.680713 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bb968-1908-4a32-9297-68d8a87af3e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:12:30.681358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bb968-1908-4a32-9297-68d8a87af3e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:30.681642 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bb968-1908-4a32-9297-68d8a87af3e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:30.681910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bb968-1908-4a32-9297-68d8a87af3e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:30.683536 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ac5bb968-1908-4a32-9297-68d8a87af3e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:30.764644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:30.796824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bb968-1908-4a32-9297-68d8a87af3e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:12:30.798630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bb968-1908-4a32-9297-68d8a87af3e9 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:12:30.817021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 663/1331] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:12:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:12:33.465553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da1084-ac5a-4dde-af14-bb2cff91b06b None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:33.466223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da1084-ac5a-4dde-af14-bb2cff91b06b None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:33.466223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da1084-ac5a-4dde-af14-bb2cff91b06b None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:33.467509 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 669/1332] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:12:33.473125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc672a-323f-4749-89d3-f272e748f46c None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:33.474136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc672a-323f-4749-89d3-f272e748f46c None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:33.474283 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc672a-323f-4749-89d3-f272e748f46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:33.542468 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-82bc672a-323f-4749-89d3-f272e748f46c None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:33.543722 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-82bc672a-323f-4749-89d3-f272e748f46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:33.649640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 664/1333] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:12:33.686399 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da1084-ac5a-4dde-af14-bb2cff91b06b None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:12:33.688001 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-64da1084-ac5a-4dde-af14-bb2cff91b06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:33.759103 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:33.793476 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da1084-ac5a-4dde-af14-bb2cff91b06b None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:12:33.869224 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a01bb1-3140-4e3b-ae9f-3b631917dfe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:12:33.869874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a01bb1-3140-4e3b-ae9f-3b631917dfe7 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:33.870160 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a01bb1-3140-4e3b-ae9f-3b631917dfe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:33.870445 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a01bb1-3140-4e3b-ae9f-3b631917dfe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:33.872081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f9a01bb1-3140-4e3b-ae9f-3b631917dfe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:33.981181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a01bb1-3140-4e3b-ae9f-3b631917dfe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:12:33.982540 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a01bb1-3140-4e3b-ae9f-3b631917dfe7 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:12:33.992941 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:34.001072 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 670/1334] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:12:36.279509 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49841e56-3bca-488d-acc1-29b9e76e6521 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:36.280053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49841e56-3bca-488d-acc1-29b9e76e6521 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:36.280053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49841e56-3bca-488d-acc1-29b9e76e6521 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:36.281409 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 665/1335] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:12:36.286709 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f89f6-90f8-43fd-ad2d-86cb33523048 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:36.287164 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f89f6-90f8-43fd-ad2d-86cb33523048 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:36.287279 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f89f6-90f8-43fd-ad2d-86cb33523048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:36.352253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-2f6f89f6-90f8-43fd-ad2d-86cb33523048 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:36.353489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-2f6f89f6-90f8-43fd-ad2d-86cb33523048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:36.448389 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 671/1336] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:12:36.488765 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49841e56-3bca-488d-acc1-29b9e76e6521 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:12:36.490369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-49841e56-3bca-488d-acc1-29b9e76e6521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:36.530492 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:36.594857 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49841e56-3bca-488d-acc1-29b9e76e6521 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:12:36.666860 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05913dfb-8e9e-4475-bdf9-0da24f1ef0e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:12:36.667511 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05913dfb-8e9e-4475-bdf9-0da24f1ef0e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:36.667795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05913dfb-8e9e-4475-bdf9-0da24f1ef0e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:36.668072 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05913dfb-8e9e-4475-bdf9-0da24f1ef0e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:36.669754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-05913dfb-8e9e-4475-bdf9-0da24f1ef0e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:36.751406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:36.777516 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05913dfb-8e9e-4475-bdf9-0da24f1ef0e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:12:36.778960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05913dfb-8e9e-4475-bdf9-0da24f1ef0e8 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:12:36.796997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 666/1337] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:12:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:12:39.834564 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4424fc-d2c1-4292-9da8-0036d90baabe None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:39.835150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4424fc-d2c1-4292-9da8-0036d90baabe None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:39.835150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4424fc-d2c1-4292-9da8-0036d90baabe None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:39.836411 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 672/1338] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:12:39.841676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51071e-703e-49ae-8b03-e11dc8af5f71 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:39.842135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51071e-703e-49ae-8b03-e11dc8af5f71 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:39.842261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51071e-703e-49ae-8b03-e11dc8af5f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:39.905550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-8e51071e-703e-49ae-8b03-e11dc8af5f71 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:39.906750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-8e51071e-703e-49ae-8b03-e11dc8af5f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:40.003078 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 667/1339] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:12:40.038736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4424fc-d2c1-4292-9da8-0036d90baabe None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:12:40.040266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-2a4424fc-d2c1-4292-9da8-0036d90baabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:40.118172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:40.149469 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4424fc-d2c1-4292-9da8-0036d90baabe None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:12:40.226135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85290de6-9f37-4bff-b5d7-58ae8cbef789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:12:40.226816 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290de6-9f37-4bff-b5d7-58ae8cbef789 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:40.227097 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290de6-9f37-4bff-b5d7-58ae8cbef789 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:40.227370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290de6-9f37-4bff-b5d7-58ae8cbef789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:40.229472 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-85290de6-9f37-4bff-b5d7-58ae8cbef789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:40.346961 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85290de6-9f37-4bff-b5d7-58ae8cbef789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:12:40.349060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85290de6-9f37-4bff-b5d7-58ae8cbef789 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:12:40.374050 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 673/1340] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:12:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:12:44.932632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045e4bd-4ffe-49b8-a8c2-edeaf813d3e0 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:44.933221 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045e4bd-4ffe-49b8-a8c2-edeaf813d3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:44.933221 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045e4bd-4ffe-49b8-a8c2-edeaf813d3e0 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:44.934739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 668/1341] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:12:44.940172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7190eb6-e2a7-4db7-b4f9-9340b9987fd7 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:44.940705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7190eb6-e2a7-4db7-b4f9-9340b9987fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:44.940826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7190eb6-e2a7-4db7-b4f9-9340b9987fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:44.945939 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:44.989373 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-a7190eb6-e2a7-4db7-b4f9-9340b9987fd7 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:44.990582 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-a7190eb6-e2a7-4db7-b4f9-9340b9987fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:45.069559 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 674/1342] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:12:45.107875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045e4bd-4ffe-49b8-a8c2-edeaf813d3e0 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:12:45.110058 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-9045e4bd-4ffe-49b8-a8c2-edeaf813d3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:45.146328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045e4bd-4ffe-49b8-a8c2-edeaf813d3e0 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:12:45.149951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be47bae-5c0c-4efd-abe2-851391a057a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:12:45.150599 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be47bae-5c0c-4efd-abe2-851391a057a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:45.150945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be47bae-5c0c-4efd-abe2-851391a057a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:45.151226 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be47bae-5c0c-4efd-abe2-851391a057a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:45.161073 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be47bae-5c0c-4efd-abe2-851391a057a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:12:45.162576 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be47bae-5c0c-4efd-abe2-851391a057a1 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:12:45.172197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 669/1343] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:12:48.516844 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a40a6c-316e-405d-820f-260855172a32 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:48.517459 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a40a6c-316e-405d-820f-260855172a32 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:48.517562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a40a6c-316e-405d-820f-260855172a32 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:48.518916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 675/1344] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:12:48.524422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dce57-d09f-410c-8974-538ffe4b2006 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:48.524891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dce57-d09f-410c-8974-538ffe4b2006 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:48.525053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dce57-d09f-410c-8974-538ffe4b2006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:48.541684 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:48.553907 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-7d5dce57-d09f-410c-8974-538ffe4b2006 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:48.555126 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-7d5dce57-d09f-410c-8974-538ffe4b2006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:48.563535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 670/1345] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:12:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:12:48.601322 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a40a6c-316e-405d-820f-260855172a32 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:12:48.603036 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-29a40a6c-316e-405d-820f-260855172a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:48.616436 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a40a6c-316e-405d-820f-260855172a32 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:12:48.620036 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a95f21-2de3-4c78-a246-bbfc8c61a549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:12:48.620700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a95f21-2de3-4c78-a246-bbfc8c61a549 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:48.620978 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a95f21-2de3-4c78-a246-bbfc8c61a549 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:48.621280 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a95f21-2de3-4c78-a246-bbfc8c61a549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:48.630186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a95f21-2de3-4c78-a246-bbfc8c61a549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:12:48.631598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a95f21-2de3-4c78-a246-bbfc8c61a549 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:12:48.640857 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 676/1346] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:12:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:12:53.862020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b760-4aa0-4519-94cf-c1bfa729589d None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:53.862586 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b760-4aa0-4519-94cf-c1bfa729589d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:53.862586 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b760-4aa0-4519-94cf-c1bfa729589d None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:53.864135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 671/1347] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:12:53.869343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9b64a-d297-4a0b-850a-07b132f94c8c None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:53.869833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9b64a-d297-4a0b-850a-07b132f94c8c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:53.869930 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9b64a-d297-4a0b-850a-07b132f94c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:53.888206 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-0ae9b64a-d297-4a0b-850a-07b132f94c8c None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:53.889482 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0ae9b64a-d297-4a0b-850a-07b132f94c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:53.898154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 677/1348] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:12:53.935732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817b760-4aa0-4519-94cf-c1bfa729589d None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:12:53.946940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817b760-4aa0-4519-94cf-c1bfa729589d None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:12:53.950490 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5c0e9-7ba9-4240-914b-27179cd7413c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:12:53.951129 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5c0e9-7ba9-4240-914b-27179cd7413c service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:53.951415 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5c0e9-7ba9-4240-914b-27179cd7413c service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:53.951691 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5c0e9-7ba9-4240-914b-27179cd7413c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:53.962539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5c0e9-7ba9-4240-914b-27179cd7413c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:12:53.964959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5c0e9-7ba9-4240-914b-27179cd7413c service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:12:53.973703 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 672/1349] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:12:59.236652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7a28b-2839-4a2d-8d9b-f800fa689a9e None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:59.236652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7a28b-2839-4a2d-8d9b-f800fa689a9e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:59.236652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7a28b-2839-4a2d-8d9b-f800fa689a9e None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:59.241565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 678/1350] 10.222.0.66 () {54 vars in 921 bytes} [Thu May 26 21:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:12:59.243330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa883b-4128-451d-bfdd-5e343fc39001 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:59.244790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa883b-4128-451d-bfdd-5e343fc39001 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:59.245069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa883b-4128-451d-bfdd-5e343fc39001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:59.315546 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-9caa883b-4128-451d-bfdd-5e343fc39001 None None] MFA Rules not processed for user `2d68ccb9b89843078c40b13f79a72dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:59.317292 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-9caa883b-4128-451d-bfdd-5e343fc39001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:59.392180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 673/1351] 10.222.0.66 () {58 vars in 1018 bytes} [Thu May 26 21:12:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:03.671769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c1fdf-fffb-475f-a2ec-80e6a8c2f410 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:03.672576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c1fdf-fffb-475f-a2ec-80e6a8c2f410 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:03.672576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c1fdf-fffb-475f-a2ec-80e6a8c2f410 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:03.674182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 679/1352] 10.222.0.66 () {54 vars in 921 bytes} [Thu May 26 21:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:03.679926 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef126d-ca4b-4cf9-b824-67ab03b6b054 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:03.680411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef126d-ca4b-4cf9-b824-67ab03b6b054 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:03.680490 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef126d-ca4b-4cf9-b824-67ab03b6b054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:03.699984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-a2ef126d-ca4b-4cf9-b824-67ab03b6b054 None None] MFA Rules not processed for user `2d68ccb9b89843078c40b13f79a72dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:03.701215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a2ef126d-ca4b-4cf9-b824-67ab03b6b054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:03.710264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 674/1353] 10.222.0.66 () {58 vars in 1018 bytes} [Thu May 26 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:03.882591 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=52 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:05.350817 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a5be0-a03b-4deb-997b-3227dcbbb6ef None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:05.351488 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a5be0-a03b-4deb-997b-3227dcbbb6ef None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:05.351488 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a5be0-a03b-4deb-997b-3227dcbbb6ef None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:05.352845 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 680/1354] 10.222.0.66 () {54 vars in 921 bytes} [Thu May 26 21:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:05.358331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf156d2-88d6-4023-a449-0e7eb5f3d005 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:05.358802 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf156d2-88d6-4023-a449-0e7eb5f3d005 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:05.359022 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf156d2-88d6-4023-a449-0e7eb5f3d005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:05.377852 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-fcf156d2-88d6-4023-a449-0e7eb5f3d005 None None] MFA Rules not processed for user `2d68ccb9b89843078c40b13f79a72dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:05.379136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-fcf156d2-88d6-4023-a449-0e7eb5f3d005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:05.387790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 675/1355] 10.222.0.66 () {58 vars in 1018 bytes} [Thu May 26 21:13:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:09.257752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29f086-2964-4c58-a18d-6b34259d39a1 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:09.259666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29f086-2964-4c58-a18d-6b34259d39a1 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:09.259666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29f086-2964-4c58-a18d-6b34259d39a1 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:09.260939 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 681/1356] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:13:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:09.265125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66de5ca-0927-4f47-8b44-5249f7ba495f None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:09.265577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66de5ca-0927-4f47-8b44-5249f7ba495f None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:09.265674 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66de5ca-0927-4f47-8b44-5249f7ba495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:09.283683 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-d66de5ca-0927-4f47-8b44-5249f7ba495f None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:09.284935 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d66de5ca-0927-4f47-8b44-5249f7ba495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:09.293074 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 676/1357] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:09.347067 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75885f-cf6f-4e7e-8c19-f3cd63f1bdc6 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:09.347662 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75885f-cf6f-4e7e-8c19-f3cd63f1bdc6 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:09.348239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75885f-cf6f-4e7e-8c19-f3cd63f1bdc6 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:09.349908 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 682/1358] 10.222.0.66 () {54 vars in 961 bytes} [Thu May 26 21:13:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:13:09.357082 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b36973-283b-489a-aaa3-1aaa16b14934 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:09.357763 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b36973-283b-489a-aaa3-1aaa16b14934 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:09.358368 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b36973-283b-489a-aaa3-1aaa16b14934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:09.412303 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-a6b36973-283b-489a-aaa3-1aaa16b14934 None None] MFA Rules not processed for user `df008eed25464be387741ee7a1e5ce80`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:09.413853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a6b36973-283b-489a-aaa3-1aaa16b14934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:09.466686 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:09.509019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 677/1359] 10.222.0.66 () {58 vars in 1058 bytes} [Thu May 26 21:13:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:09.517348 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75885f-cf6f-4e7e-8c19-f3cd63f1bdc6 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:09.536837 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75885f-cf6f-4e7e-8c19-f3cd63f1bdc6 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:09.543437 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1f078-cd2a-4407-b5fd-578806ea5a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:09.544092 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1f078-cd2a-4407-b5fd-578806ea5a44 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:09.544376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1f078-cd2a-4407-b5fd-578806ea5a44 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:09.544686 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1f078-cd2a-4407-b5fd-578806ea5a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:09.559431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1f078-cd2a-4407-b5fd-578806ea5a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:09.561112 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1f078-cd2a-4407-b5fd-578806ea5a44 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:09.572846 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 683/1360] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:13:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:12.031350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fce019-d6e4-4a4c-8091-5070a1834867 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:12.031894 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fce019-d6e4-4a4c-8091-5070a1834867 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:12.031894 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fce019-d6e4-4a4c-8091-5070a1834867 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:12.037519 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 678/1361] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:13:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:12.039325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bbc21-9b77-4c51-b2fe-9477bf9915b3 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:12.039800 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bbc21-9b77-4c51-b2fe-9477bf9915b3 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:12.039892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bbc21-9b77-4c51-b2fe-9477bf9915b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:12.060449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-f42bbc21-9b77-4c51-b2fe-9477bf9915b3 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:12.061807 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f42bbc21-9b77-4c51-b2fe-9477bf9915b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:12.070908 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 684/1362] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:12.116642 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fce019-d6e4-4a4c-8091-5070a1834867 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:12.133884 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fce019-d6e4-4a4c-8091-5070a1834867 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:12.139446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7f579-de35-459e-9974-b22c05247c78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:12.140118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7f579-de35-459e-9974-b22c05247c78 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:12.140433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7f579-de35-459e-9974-b22c05247c78 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:12.140811 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7f579-de35-459e-9974-b22c05247c78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:12.150239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7f579-de35-459e-9974-b22c05247c78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:12.152011 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7f579-de35-459e-9974-b22c05247c78 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:12.162291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 679/1363] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:13:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:14.899042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8cf9f-b44c-466a-9317-ec079102cc50 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:14.899551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8cf9f-b44c-466a-9317-ec079102cc50 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:14.899551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8cf9f-b44c-466a-9317-ec079102cc50 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:14.901353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 685/1364] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:14.906700 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec8fac-968a-44aa-bdb6-82194cc7bfc3 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:14.907182 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec8fac-968a-44aa-bdb6-82194cc7bfc3 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:14.907300 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec8fac-968a-44aa-bdb6-82194cc7bfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:14.926032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-0bec8fac-968a-44aa-bdb6-82194cc7bfc3 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:14.927149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-0bec8fac-968a-44aa-bdb6-82194cc7bfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:14.934941 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 680/1365] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:14.982227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4896883-c2b3-4f42-9502-2bfe1857778a None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:14.982516 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4896883-c2b3-4f42-9502-2bfe1857778a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:14.982787 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4896883-c2b3-4f42-9502-2bfe1857778a None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:14.984135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 686/1366] 10.222.0.66 () {54 vars in 961 bytes} [Thu May 26 21:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:14.989937 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a4e5d-fca2-4a8c-8e97-76616b308509 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:14.990228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a4e5d-fca2-4a8c-8e97-76616b308509 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:14.990509 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a4e5d-fca2-4a8c-8e97-76616b308509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:15.010055 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-577a4e5d-fca2-4a8c-8e97-76616b308509 None None] MFA Rules not processed for user `df008eed25464be387741ee7a1e5ce80`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:15.011243 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-577a4e5d-fca2-4a8c-8e97-76616b308509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:15.021160 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 681/1367] 10.222.0.66 () {58 vars in 1058 bytes} [Thu May 26 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:13:15.029135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4896883-c2b3-4f42-9502-2bfe1857778a None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:15.043651 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4896883-c2b3-4f42-9502-2bfe1857778a None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:15.049505 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54773337-5472-402f-aa85-ba1f0b51e367 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:15.050215 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54773337-5472-402f-aa85-ba1f0b51e367 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:15.050517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54773337-5472-402f-aa85-ba1f0b51e367 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:15.050851 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54773337-5472-402f-aa85-ba1f0b51e367 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:15.059253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54773337-5472-402f-aa85-ba1f0b51e367 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:15.060883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54773337-5472-402f-aa85-ba1f0b51e367 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:15.070876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 687/1368] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:13:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:17.604246 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f3f2a-f939-4725-806f-de1c60c057b8 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:17.604901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f3f2a-f939-4725-806f-de1c60c057b8 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:17.604901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f3f2a-f939-4725-806f-de1c60c057b8 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:17.606265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 682/1369] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:17.613029 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb83ab-a025-4a34-9178-6cdf2c8dae34 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:17.613578 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb83ab-a025-4a34-9178-6cdf2c8dae34 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:17.613578 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb83ab-a025-4a34-9178-6cdf2c8dae34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:17.634297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-20cb83ab-a025-4a34-9178-6cdf2c8dae34 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:17.635640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-20cb83ab-a025-4a34-9178-6cdf2c8dae34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:17.644651 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 688/1370] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:17.658401 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dfe35-3812-49db-a6fa-a5fc130957e2 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:17.659020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dfe35-3812-49db-a6fa-a5fc130957e2 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:17.659810 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dfe35-3812-49db-a6fa-a5fc130957e2 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:17.661749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 683/1371] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:17.666658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec4546-dbdb-4ae3-8209-c2fd8bdb3422 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:17.666940 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec4546-dbdb-4ae3-8209-c2fd8bdb3422 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:17.667432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec4546-dbdb-4ae3-8209-c2fd8bdb3422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:17.686620 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-90ec4546-dbdb-4ae3-8209-c2fd8bdb3422 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:17.687825 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-90ec4546-dbdb-4ae3-8209-c2fd8bdb3422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:17.696773 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 689/1372] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:17.741758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dfe35-3812-49db-a6fa-a5fc130957e2 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:17.756184 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dfe35-3812-49db-a6fa-a5fc130957e2 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:17.761763 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c9589-8f9c-4902-93af-dbc8e2976d6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:17.762489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c9589-8f9c-4902-93af-dbc8e2976d6f service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:17.763000 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c9589-8f9c-4902-93af-dbc8e2976d6f service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:17.763504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c9589-8f9c-4902-93af-dbc8e2976d6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:17.772042 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c9589-8f9c-4902-93af-dbc8e2976d6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:17.773744 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c9589-8f9c-4902-93af-dbc8e2976d6f service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:17.783571 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 684/1373] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:17.919315 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26ea33-ced9-4b2e-bb5f-86c444e8e5c7 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:17.919638 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26ea33-ced9-4b2e-bb5f-86c444e8e5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:17.919920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26ea33-ced9-4b2e-bb5f-86c444e8e5c7 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:17.921399 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 690/1374] 10.222.0.66 () {54 vars in 963 bytes} [Thu May 26 21:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:17.927566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd2cfe-d493-44c3-b94f-ed17a6f62b27 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:17.927857 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd2cfe-d493-44c3-b94f-ed17a6f62b27 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:17.928143 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd2cfe-d493-44c3-b94f-ed17a6f62b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:17.977755 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-78dd2cfe-d493-44c3-b94f-ed17a6f62b27 None None] MFA Rules not processed for user `628bac94f0c54ac7a14ff19287efd8df`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:17.978951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-78dd2cfe-d493-44c3-b94f-ed17a6f62b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:18.052144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 685/1375] 10.222.0.66 () {58 vars in 1060 bytes} [Thu May 26 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:18.061261 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26ea33-ced9-4b2e-bb5f-86c444e8e5c7 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:18.075711 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26ea33-ced9-4b2e-bb5f-86c444e8e5c7 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:18.080467 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a3624-4c7f-4b14-b15a-d9b468d38dfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:18.081408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a3624-4c7f-4b14-b15a-d9b468d38dfb service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:18.081864 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a3624-4c7f-4b14-b15a-d9b468d38dfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:18.082294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a3624-4c7f-4b14-b15a-d9b468d38dfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:18.094672 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a3624-4c7f-4b14-b15a-d9b468d38dfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:18.096435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a3624-4c7f-4b14-b15a-d9b468d38dfb service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:18.109701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 691/1376] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:13:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:20.209585 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df81591-8205-4798-9b53-24b0f742ef63 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:20.210034 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df81591-8205-4798-9b53-24b0f742ef63 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:20.210524 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df81591-8205-4798-9b53-24b0f742ef63 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:20.211625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 686/1377] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:20.217121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b8426-9d5c-42a0-b7b4-143f42eb620d None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:20.217571 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b8426-9d5c-42a0-b7b4-143f42eb620d None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:20.217681 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b8426-9d5c-42a0-b7b4-143f42eb620d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:20.235553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-818b8426-9d5c-42a0-b7b4-143f42eb620d None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:20.236757 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-818b8426-9d5c-42a0-b7b4-143f42eb620d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:20.245134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 692/1378] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:20.290179 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df81591-8205-4798-9b53-24b0f742ef63 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:20.304865 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df81591-8205-4798-9b53-24b0f742ef63 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:20.310623 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edcdf6-7b11-4268-bcff-fd6d98165af0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:20.311216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edcdf6-7b11-4268-bcff-fd6d98165af0 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:20.311499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edcdf6-7b11-4268-bcff-fd6d98165af0 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:20.311771 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edcdf6-7b11-4268-bcff-fd6d98165af0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:20.321395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edcdf6-7b11-4268-bcff-fd6d98165af0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:20.322992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edcdf6-7b11-4268-bcff-fd6d98165af0 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:20.333589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 687/1379] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:22.762671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fd801-5266-4983-bba1-887f4f475697 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:22.763278 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fd801-5266-4983-bba1-887f4f475697 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:22.763278 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fd801-5266-4983-bba1-887f4f475697 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:22.764569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 693/1380] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:22.770586 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1b254-e991-4652-8f6a-24e9881f1a54 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:22.771383 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1b254-e991-4652-8f6a-24e9881f1a54 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:22.771851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1b254-e991-4652-8f6a-24e9881f1a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:22.790555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-75d1b254-e991-4652-8f6a-24e9881f1a54 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:22.791761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-75d1b254-e991-4652-8f6a-24e9881f1a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:22.800012 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 688/1381] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:22.844859 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fd801-5266-4983-bba1-887f4f475697 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:22.861103 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fd801-5266-4983-bba1-887f4f475697 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:22.867315 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20352cd6-16c8-4df1-b78f-c7c3a428c6ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:22.868159 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20352cd6-16c8-4df1-b78f-c7c3a428c6ae service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:22.868546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20352cd6-16c8-4df1-b78f-c7c3a428c6ae service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:22.868954 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20352cd6-16c8-4df1-b78f-c7c3a428c6ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:22.878537 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20352cd6-16c8-4df1-b78f-c7c3a428c6ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:22.880217 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20352cd6-16c8-4df1-b78f-c7c3a428c6ae service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:22.890593 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 694/1382] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:13:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:25.267352 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dbfda-b7fb-4414-90c0-f0b6f5cb48ca None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:25.267924 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dbfda-b7fb-4414-90c0-f0b6f5cb48ca None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:25.267924 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dbfda-b7fb-4414-90c0-f0b6f5cb48ca None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:25.269344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 689/1383] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:25.274914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958317d-59d6-4b55-ab01-57fe0fcfbda1 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:25.275361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958317d-59d6-4b55-ab01-57fe0fcfbda1 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:25.275478 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958317d-59d6-4b55-ab01-57fe0fcfbda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:25.293926 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-c958317d-59d6-4b55-ab01-57fe0fcfbda1 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:25.295102 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-c958317d-59d6-4b55-ab01-57fe0fcfbda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:25.304011 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 695/1384] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:25.344930 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dbfda-b7fb-4414-90c0-f0b6f5cb48ca None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:25.360610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dbfda-b7fb-4414-90c0-f0b6f5cb48ca None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:25.367129 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e090160-ab27-4d94-97be-98daba9ca75b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:25.367872 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e090160-ab27-4d94-97be-98daba9ca75b service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:25.368268 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e090160-ab27-4d94-97be-98daba9ca75b service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:25.368562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e090160-ab27-4d94-97be-98daba9ca75b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:25.378301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e090160-ab27-4d94-97be-98daba9ca75b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:25.380035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e090160-ab27-4d94-97be-98daba9ca75b service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:25.390711 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 690/1385] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:27.640823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e775a-e5b2-458d-ae33-ecf19b14b1c9 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:27.641483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e775a-e5b2-458d-ae33-ecf19b14b1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:27.641483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e775a-e5b2-458d-ae33-ecf19b14b1c9 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:27.642732 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 696/1386] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:27.649192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e776615-7d40-4314-a11b-286e5ee76268 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:27.649668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e776615-7d40-4314-a11b-286e5ee76268 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:27.649935 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e776615-7d40-4314-a11b-286e5ee76268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:27.672169 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-0e776615-7d40-4314-a11b-286e5ee76268 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:27.673894 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-0e776615-7d40-4314-a11b-286e5ee76268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:27.683181 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 691/1387] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:27.737644 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e775a-e5b2-458d-ae33-ecf19b14b1c9 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:27.753500 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e775a-e5b2-458d-ae33-ecf19b14b1c9 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:27.759279 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b39ce-d24b-4712-bccc-8eeb761fffac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:27.759938 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b39ce-d24b-4712-bccc-8eeb761fffac service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:27.760274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b39ce-d24b-4712-bccc-8eeb761fffac service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:27.760525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b39ce-d24b-4712-bccc-8eeb761fffac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:27.770492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b39ce-d24b-4712-bccc-8eeb761fffac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:27.772170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b39ce-d24b-4712-bccc-8eeb761fffac service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:27.782579 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 697/1388] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:13:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:30.233934 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197e36-17a2-46d7-bd8e-8d633567ae3a None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:30.234489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197e36-17a2-46d7-bd8e-8d633567ae3a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:30.234592 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197e36-17a2-46d7-bd8e-8d633567ae3a None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:30.235957 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 692/1389] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:30.242667 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c0347-8081-43e9-a15e-fdf30544b36b None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:30.243159 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c0347-8081-43e9-a15e-fdf30544b36b None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:30.243361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c0347-8081-43e9-a15e-fdf30544b36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:30.265894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-f06c0347-8081-43e9-a15e-fdf30544b36b None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:30.267407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f06c0347-8081-43e9-a15e-fdf30544b36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:30.277619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 698/1390] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:30.322894 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197e36-17a2-46d7-bd8e-8d633567ae3a None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:30.339240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197e36-17a2-46d7-bd8e-8d633567ae3a None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:30.346447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da99504-2b95-4167-aca5-dbf461a4c5a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:30.347240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da99504-2b95-4167-aca5-dbf461a4c5a4 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:30.347598 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da99504-2b95-4167-aca5-dbf461a4c5a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:30.347960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da99504-2b95-4167-aca5-dbf461a4c5a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:30.359598 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da99504-2b95-4167-aca5-dbf461a4c5a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:30.361704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da99504-2b95-4167-aca5-dbf461a4c5a4 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:30.374656 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 693/1391] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:32.792416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dd90d-3bce-4644-b258-bd81e314999d None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:32.793060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dd90d-3bce-4644-b258-bd81e314999d None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:32.793060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dd90d-3bce-4644-b258-bd81e314999d None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:32.794481 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 699/1392] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:32.800922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468d963-2130-4c7b-bc76-b4e38a7f3871 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:32.801382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468d963-2130-4c7b-bc76-b4e38a7f3871 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:32.801488 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468d963-2130-4c7b-bc76-b4e38a7f3871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:32.811332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:32.822750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-0468d963-2130-4c7b-bc76-b4e38a7f3871 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:32.825382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-0468d963-2130-4c7b-bc76-b4e38a7f3871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:32.832447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 694/1393] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:32.877072 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220dd90d-3bce-4644-b258-bd81e314999d None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:32.891391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220dd90d-3bce-4644-b258-bd81e314999d None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:32.896864 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4a1f4-1c93-4760-8851-795c79407678 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:32.897502 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4a1f4-1c93-4760-8851-795c79407678 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:32.897783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4a1f4-1c93-4760-8851-795c79407678 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:32.898060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4a1f4-1c93-4760-8851-795c79407678 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:32.906520 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4a1f4-1c93-4760-8851-795c79407678 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:32.908084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4a1f4-1c93-4760-8851-795c79407678 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:32.918379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 700/1394] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:33.931713 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f6466-6983-46ab-8e84-137cf347239f None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:33.932269 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f6466-6983-46ab-8e84-137cf347239f None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:33.932269 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f6466-6983-46ab-8e84-137cf347239f None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:33.933672 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 695/1395] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:33.939105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b6c89-d26d-4334-aa2c-aaa7e5a3830d None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:33.939558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b6c89-d26d-4334-aa2c-aaa7e5a3830d None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:33.939719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b6c89-d26d-4334-aa2c-aaa7e5a3830d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:33.945968 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=55 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:33.958468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-609b6c89-d26d-4334-aa2c-aaa7e5a3830d None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:33.959728 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-609b6c89-d26d-4334-aa2c-aaa7e5a3830d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:33.967838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 701/1396] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:34.023902 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051e5b5-7a16-42c4-a2ce-fa349e134441 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:34.024191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051e5b5-7a16-42c4-a2ce-fa349e134441 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:34.024470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051e5b5-7a16-42c4-a2ce-fa349e134441 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:34.025899 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 696/1397] 10.222.0.66 () {54 vars in 962 bytes} [Thu May 26 21:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:34.030992 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6e14b-06fa-4ec7-a1a7-cafb86e71753 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:34.031288 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6e14b-06fa-4ec7-a1a7-cafb86e71753 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:34.031627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6e14b-06fa-4ec7-a1a7-cafb86e71753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:34.081351 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-21e6e14b-06fa-4ec7-a1a7-cafb86e71753 None None] MFA Rules not processed for user `4561bdb2d75e4025a5d73ea713c690b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:34.082565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-21e6e14b-06fa-4ec7-a1a7-cafb86e71753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:34.145910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 702/1398] 10.222.0.66 () {58 vars in 1059 bytes} [Thu May 26 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:34.154683 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051e5b5-7a16-42c4-a2ce-fa349e134441 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:34.166829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051e5b5-7a16-42c4-a2ce-fa349e134441 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:34.170638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def46df-40f9-40b6-83de-58ec6f31da90 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdb2d75e4025a5d73ea713c690b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:34.171688 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def46df-40f9-40b6-83de-58ec6f31da90 service glance] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:34.172069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def46df-40f9-40b6-83de-58ec6f31da90 service glance] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:34.172444 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def46df-40f9-40b6-83de-58ec6f31da90 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:34.183075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def46df-40f9-40b6-83de-58ec6f31da90 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:34.184613 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def46df-40f9-40b6-83de-58ec6f31da90 service glance] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:34.195769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 697/1399] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:34.921251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b8d72-31eb-4af9-af0d-3e0b26949eb0 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:34.921554 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b8d72-31eb-4af9-af0d-3e0b26949eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:34.921864 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b8d72-31eb-4af9-af0d-3e0b26949eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:34.974277 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-bf1b8d72-31eb-4af9-af0d-3e0b26949eb0 None None] MFA Rules not processed for user `5890e1e70ffd4e33a812691e9c43b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:34.975486 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-bf1b8d72-31eb-4af9-af0d-3e0b26949eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:35.039988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 703/1400] 10.222.0.66 () {58 vars in 1009 bytes} [Thu May 26 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:35.085372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02566a38-6c3b-4308-a6ae-a34022a3ff3b None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:35.085845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02566a38-6c3b-4308-a6ae-a34022a3ff3b None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:35.085926 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02566a38-6c3b-4308-a6ae-a34022a3ff3b None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:35.087284 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 698/1401] 10.222.0.66 () {54 vars in 942 bytes} [Thu May 26 21:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:35.093942 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d01190-ccc8-45b1-9408-9ab7775de93c None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:35.094227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d01190-ccc8-45b1-9408-9ab7775de93c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:35.094497 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d01190-ccc8-45b1-9408-9ab7775de93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:35.151970 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-81d01190-ccc8-45b1-9408-9ab7775de93c None None] MFA Rules not processed for user `6304e47844214d2db0acfae11e4714ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:35.153235 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-81d01190-ccc8-45b1-9408-9ab7775de93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:35.168642 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:35.227220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 704/1402] 10.222.0.66 () {58 vars in 1039 bytes} [Thu May 26 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:35.236304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02566a38-6c3b-4308-a6ae-a34022a3ff3b None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:35.250659 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02566a38-6c3b-4308-a6ae-a34022a3ff3b None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:35.256005 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e864c9f-6c97-4f62-b025-11ba399d480b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6304e47844214d2db0acfae11e4714ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:35.256671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e864c9f-6c97-4f62-b025-11ba399d480b service swift] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:35.256958 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e864c9f-6c97-4f62-b025-11ba399d480b service swift] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:35.257241 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e864c9f-6c97-4f62-b025-11ba399d480b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:35.265720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e864c9f-6c97-4f62-b025-11ba399d480b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:35.267303 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e864c9f-6c97-4f62-b025-11ba399d480b service swift] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:35.275517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 699/1403] 10.222.0.66 () {60 vars in 1384 bytes} [Thu May 26 21:13:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:13:35.335197 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368c776-7d81-4cd9-85f7-abd86ddc81fe None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:35.335485 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368c776-7d81-4cd9-85f7-abd86ddc81fe None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:35.335768 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368c776-7d81-4cd9-85f7-abd86ddc81fe None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:35.337192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 705/1404] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:35.342452 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ead36d-c52d-4575-a191-c1cfb5aa7657 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:35.342736 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ead36d-c52d-4575-a191-c1cfb5aa7657 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:35.343016 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ead36d-c52d-4575-a191-c1cfb5aa7657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:35.361226 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-a3ead36d-c52d-4575-a191-c1cfb5aa7657 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:35.363014 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a3ead36d-c52d-4575-a191-c1cfb5aa7657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:35.371040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 700/1405] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:35.416442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368c776-7d81-4cd9-85f7-abd86ddc81fe None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:35.431156 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368c776-7d81-4cd9-85f7-abd86ddc81fe None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:35.436553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae4546-619f-43bf-a38c-429c073a70e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:35.437219 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae4546-619f-43bf-a38c-429c073a70e9 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:35.437504 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae4546-619f-43bf-a38c-429c073a70e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:35.437783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae4546-619f-43bf-a38c-429c073a70e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:35.445855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae4546-619f-43bf-a38c-429c073a70e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:35.447432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae4546-619f-43bf-a38c-429c073a70e9 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:35.457150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 706/1406] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:37.913273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66003c-78f4-442a-bc65-518a52de0fc7 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:37.913802 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66003c-78f4-442a-bc65-518a52de0fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:37.913802 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66003c-78f4-442a-bc65-518a52de0fc7 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:37.915225 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 701/1407] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:37.920827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13b25e-8982-4172-a2f0-fdfde85960e3 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:37.921594 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13b25e-8982-4172-a2f0-fdfde85960e3 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:37.922011 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13b25e-8982-4172-a2f0-fdfde85960e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:37.941235 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-6b13b25e-8982-4172-a2f0-fdfde85960e3 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:37.942546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6b13b25e-8982-4172-a2f0-fdfde85960e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:37.951240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 707/1408] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:37.997316 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66003c-78f4-442a-bc65-518a52de0fc7 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:38.015334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66003c-78f4-442a-bc65-518a52de0fc7 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:38.022080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a9d9d-3e03-41b6-8833-47f9f8480bf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:38.022736 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a9d9d-3e03-41b6-8833-47f9f8480bf1 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:38.023036 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a9d9d-3e03-41b6-8833-47f9f8480bf1 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:38.023309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a9d9d-3e03-41b6-8833-47f9f8480bf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:38.032435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a9d9d-3e03-41b6-8833-47f9f8480bf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:38.034137 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a9d9d-3e03-41b6-8833-47f9f8480bf1 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:38.046411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 702/1409] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:47.935956 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=33 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:48.354814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=22 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:00.198607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afaa7e-e844-408f-88b8-35779b2beba7 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:00.199218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afaa7e-e844-408f-88b8-35779b2beba7 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:00.199218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afaa7e-e844-408f-88b8-35779b2beba7 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:00.200536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 708/1410] 10.222.0.66 () {54 vars in 918 bytes} [Thu May 26 21:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:00.205709 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87127c-8084-4716-a9a3-e4da2080a295 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:00.206170 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87127c-8084-4716-a9a3-e4da2080a295 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:00.206282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87127c-8084-4716-a9a3-e4da2080a295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:00.225181 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-ce87127c-8084-4716-a9a3-e4da2080a295 None None] MFA Rules not processed for user `2d68ccb9b89843078c40b13f79a72dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:00.226366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ce87127c-8084-4716-a9a3-e4da2080a295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:00.234672 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 703/1411] 10.222.0.66 () {58 vars in 1015 bytes} [Thu May 26 21:14:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:00.248834 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49140a-4ce9-4879-afa3-5e7cbba3ee4e None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:00.249126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49140a-4ce9-4879-afa3-5e7cbba3ee4e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:00.249407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49140a-4ce9-4879-afa3-5e7cbba3ee4e None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:00.250779 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 709/1412] 10.222.0.66 () {54 vars in 918 bytes} [Thu May 26 21:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:00.256895 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a2da6-7391-4dee-ae6c-91703734b685 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:00.257181 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a2da6-7391-4dee-ae6c-91703734b685 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:00.257459 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a2da6-7391-4dee-ae6c-91703734b685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:00.275658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-7c5a2da6-7391-4dee-ae6c-91703734b685 None None] MFA Rules not processed for user `df008eed25464be387741ee7a1e5ce80`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:00.276868 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-7c5a2da6-7391-4dee-ae6c-91703734b685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:00.285822 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 704/1413] 10.222.0.66 () {58 vars in 1015 bytes} [Thu May 26 21:14:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:02.947655 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c645559-12b6-4988-a035-56249531534c None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:02.948229 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c645559-12b6-4988-a035-56249531534c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:02.948229 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c645559-12b6-4988-a035-56249531534c None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:02.949602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:02.956041 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c667-38d3-4401-b97e-7061157ca500 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:02.957095 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c667-38d3-4401-b97e-7061157ca500 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:02.957200 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c667-38d3-4401-b97e-7061157ca500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:02.975109 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-4149c667-38d3-4401-b97e-7061157ca500 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:02.976294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-4149c667-38d3-4401-b97e-7061157ca500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:02.984000 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:03.026852 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c645559-12b6-4988-a035-56249531534c None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:03.041461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c645559-12b6-4988-a035-56249531534c None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:03.047046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae099d-86ea-4dbe-8e46-5f9d8998778a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:03.047679 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae099d-86ea-4dbe-8e46-5f9d8998778a service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:03.047985 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae099d-86ea-4dbe-8e46-5f9d8998778a service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:03.048245 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae099d-86ea-4dbe-8e46-5f9d8998778a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:03.056523 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae099d-86ea-4dbe-8e46-5f9d8998778a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:03.058128 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae099d-86ea-4dbe-8e46-5f9d8998778a service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:03.068569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 711/1416] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:14:04.035501 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6d984-5d84-4272-a887-846ff10d2eaf None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:04.036070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6d984-5d84-4272-a887-846ff10d2eaf None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:04.036070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6d984-5d84-4272-a887-846ff10d2eaf None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:04.037465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:04.042579 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e97753-2b9f-45d8-a725-70a17237cbcb None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:04.043045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e97753-2b9f-45d8-a725-70a17237cbcb None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:04.043157 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e97753-2b9f-45d8-a725-70a17237cbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:04.061732 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-18e97753-2b9f-45d8-a725-70a17237cbcb None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:04.062930 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-18e97753-2b9f-45d8-a725-70a17237cbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:04.070650 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:04.229287 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6d984-5d84-4272-a887-846ff10d2eaf None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:04.243530 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6d984-5d84-4272-a887-846ff10d2eaf None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:04.248898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c14a73-4e6c-4075-a1b1-f34437a735d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:04.249531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c14a73-4e6c-4075-a1b1-f34437a735d3 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:04.249811 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c14a73-4e6c-4075-a1b1-f34437a735d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:04.250086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c14a73-4e6c-4075-a1b1-f34437a735d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:04.258049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c14a73-4e6c-4075-a1b1-f34437a735d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:04.259610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c14a73-4e6c-4075-a1b1-f34437a735d3 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:04.269404 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 707/1419] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:05.200659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef6609-dcb9-4fa1-92f8-ea163c071baa None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:05.201259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef6609-dcb9-4fa1-92f8-ea163c071baa None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:05.201359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef6609-dcb9-4fa1-92f8-ea163c071baa None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:05.202755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:05.207975 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d88ec-9e6e-4a7e-8dfe-276867968e57 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:05.208446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d88ec-9e6e-4a7e-8dfe-276867968e57 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:05.208556 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d88ec-9e6e-4a7e-8dfe-276867968e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:05.227083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-b56d88ec-9e6e-4a7e-8dfe-276867968e57 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:05.228312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b56d88ec-9e6e-4a7e-8dfe-276867968e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:05.236337 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:14:05.387694 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef6609-dcb9-4fa1-92f8-ea163c071baa None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:05.401756 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef6609-dcb9-4fa1-92f8-ea163c071baa None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:05.407108 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388aea16-502a-4b62-97aa-87814f45dc72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:05.407745 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aea16-502a-4b62-97aa-87814f45dc72 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:05.408028 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aea16-502a-4b62-97aa-87814f45dc72 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:05.408307 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aea16-502a-4b62-97aa-87814f45dc72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:05.416992 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388aea16-502a-4b62-97aa-87814f45dc72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:05.418558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388aea16-502a-4b62-97aa-87814f45dc72 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:05.428837 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 714/1422] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:06.340418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6faf16-3f8d-4faa-b336-c466c9098c0d None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:06.341039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6faf16-3f8d-4faa-b336-c466c9098c0d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:06.341039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6faf16-3f8d-4faa-b336-c466c9098c0d None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:06.342381 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:06.347843 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a90528-846a-4949-907d-338dd281a1f5 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:06.348273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a90528-846a-4949-907d-338dd281a1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:06.348381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a90528-846a-4949-907d-338dd281a1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:06.366511 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-38a90528-846a-4949-907d-338dd281a1f5 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:06.367697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-38a90528-846a-4949-907d-338dd281a1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:06.375538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:06.525494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6faf16-3f8d-4faa-b336-c466c9098c0d None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:06.540028 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6faf16-3f8d-4faa-b336-c466c9098c0d None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:06.545579 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f8b15-83a2-4d07-9d9d-779c24d98835 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:06.546208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f8b15-83a2-4d07-9d9d-779c24d98835 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:06.546488 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f8b15-83a2-4d07-9d9d-779c24d98835 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:06.546760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f8b15-83a2-4d07-9d9d-779c24d98835 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:06.554838 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f8b15-83a2-4d07-9d9d-779c24d98835 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:06.556429 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f8b15-83a2-4d07-9d9d-779c24d98835 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:06.566206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 710/1425] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:07.474528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728b23f-1867-4a97-aad8-b1c764f0c006 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:07.475079 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728b23f-1867-4a97-aad8-b1c764f0c006 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:07.475079 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728b23f-1867-4a97-aad8-b1c764f0c006 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:07.476380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:07.481365 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9bde-91fe-41f9-80bd-c9b04bfede5a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:07.481785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9bde-91fe-41f9-80bd-c9b04bfede5a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:07.481959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9bde-91fe-41f9-80bd-c9b04bfede5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:07.500890 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-bc4d9bde-91fe-41f9-80bd-c9b04bfede5a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:07.502093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-bc4d9bde-91fe-41f9-80bd-c9b04bfede5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:07.510583 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:07.660326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728b23f-1867-4a97-aad8-b1c764f0c006 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:07.674728 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728b23f-1867-4a97-aad8-b1c764f0c006 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:07.680671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edffac-82bb-45fc-822c-63e94293831d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:07.681320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edffac-82bb-45fc-822c-63e94293831d service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:07.681606 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edffac-82bb-45fc-822c-63e94293831d service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:07.681883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edffac-82bb-45fc-822c-63e94293831d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:07.690444 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edffac-82bb-45fc-822c-63e94293831d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:07.692040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edffac-82bb-45fc-822c-63e94293831d service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:07.701638 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 717/1428] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:08.616271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376edaa-0f67-4767-a081-cc96c08ccfff None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:08.616904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376edaa-0f67-4767-a081-cc96c08ccfff None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:08.616904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376edaa-0f67-4767-a081-cc96c08ccfff None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:08.618265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:08.623262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90a884-3203-4ab3-9a42-742513818025 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:08.623691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90a884-3203-4ab3-9a42-742513818025 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:08.623827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90a884-3203-4ab3-9a42-742513818025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:08.642158 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-6a90a884-3203-4ab3-9a42-742513818025 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:08.643369 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6a90a884-3203-4ab3-9a42-742513818025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:08.651057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:08.801923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376edaa-0f67-4767-a081-cc96c08ccfff None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:08.816465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376edaa-0f67-4767-a081-cc96c08ccfff None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:08.822235 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cf86d-e4ae-423c-bb83-6a4fb0760537 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:08.822869 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cf86d-e4ae-423c-bb83-6a4fb0760537 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:08.823157 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cf86d-e4ae-423c-bb83-6a4fb0760537 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:08.823431 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cf86d-e4ae-423c-bb83-6a4fb0760537 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:08.832076 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cf86d-e4ae-423c-bb83-6a4fb0760537 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:08.833684 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cf86d-e4ae-423c-bb83-6a4fb0760537 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:08.843082 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 713/1431] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:09.793110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68405fb-675b-4d8e-afe1-7e68c595af6d None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:09.793651 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68405fb-675b-4d8e-afe1-7e68c595af6d None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:09.793651 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68405fb-675b-4d8e-afe1-7e68c595af6d None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:09.795232 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:09.800900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cb66e-dc4b-4b1e-bb9e-e8f4b4a5c2c1 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:09.801320 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cb66e-dc4b-4b1e-bb9e-e8f4b4a5c2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:09.801453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cb66e-dc4b-4b1e-bb9e-e8f4b4a5c2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:09.942666 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-d99cb66e-dc4b-4b1e-bb9e-e8f4b4a5c2c1 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:09.943934 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d99cb66e-dc4b-4b1e-bb9e-e8f4b4a5c2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:09.951686 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:10.099998 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68405fb-675b-4d8e-afe1-7e68c595af6d None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:10.115017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68405fb-675b-4d8e-afe1-7e68c595af6d None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:10.120518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ebb0b-1e72-4a99-b6cc-b4a3fc78e4c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:10.121205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ebb0b-1e72-4a99-b6cc-b4a3fc78e4c8 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:10.121492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ebb0b-1e72-4a99-b6cc-b4a3fc78e4c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:10.121772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ebb0b-1e72-4a99-b6cc-b4a3fc78e4c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:10.130105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ebb0b-1e72-4a99-b6cc-b4a3fc78e4c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:10.131685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ebb0b-1e72-4a99-b6cc-b4a3fc78e4c8 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:10.140951 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 720/1434] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:11.090404 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611428e-cdfa-4a8a-a510-a24473d812b2 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:11.090981 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611428e-cdfa-4a8a-a510-a24473d812b2 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:11.090981 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611428e-cdfa-4a8a-a510-a24473d812b2 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:11.092532 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:11.097615 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072d66f-0497-44ab-a258-6c5deec4acb3 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:11.098058 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072d66f-0497-44ab-a258-6c5deec4acb3 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:11.098156 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072d66f-0497-44ab-a258-6c5deec4acb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:11.116416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-9072d66f-0497-44ab-a258-6c5deec4acb3 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:11.117700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-9072d66f-0497-44ab-a258-6c5deec4acb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:11.125531 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:11.276047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611428e-cdfa-4a8a-a510-a24473d812b2 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:11.290423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611428e-cdfa-4a8a-a510-a24473d812b2 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:11.296022 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cd466-43a7-4373-829d-40e4f6fbb47f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:11.296690 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cd466-43a7-4373-829d-40e4f6fbb47f service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:11.296975 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cd466-43a7-4373-829d-40e4f6fbb47f service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:11.297248 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cd466-43a7-4373-829d-40e4f6fbb47f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:11.305838 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cd466-43a7-4373-829d-40e4f6fbb47f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:11.307405 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cd466-43a7-4373-829d-40e4f6fbb47f service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:11.317225 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 716/1437] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:12.217080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b69a9e-fce6-4e0a-9357-4cdb198dc89b None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:12.217652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b69a9e-fce6-4e0a-9357-4cdb198dc89b None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:12.217652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b69a9e-fce6-4e0a-9357-4cdb198dc89b None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:12.219061 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:12.224901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1240d4-01b9-49c0-919c-62ad786c937c None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:12.225337 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1240d4-01b9-49c0-919c-62ad786c937c None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:12.225463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1240d4-01b9-49c0-919c-62ad786c937c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:12.243592 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-bd1240d4-01b9-49c0-919c-62ad786c937c None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:12.244814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-bd1240d4-01b9-49c0-919c-62ad786c937c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:12.253763 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:12.401006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b69a9e-fce6-4e0a-9357-4cdb198dc89b None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:12.415658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b69a9e-fce6-4e0a-9357-4cdb198dc89b None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:12.421378 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c70f7-cbe9-48a3-82cc-852411eefcc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:12.422011 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c70f7-cbe9-48a3-82cc-852411eefcc6 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:12.422297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c70f7-cbe9-48a3-82cc-852411eefcc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:12.422574 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c70f7-cbe9-48a3-82cc-852411eefcc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:12.432979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c70f7-cbe9-48a3-82cc-852411eefcc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:12.434563 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c70f7-cbe9-48a3-82cc-852411eefcc6 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:12.443997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 723/1440] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:14.519294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96925e59-92f3-4143-88c4-fd1812188baf None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:14.519947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96925e59-92f3-4143-88c4-fd1812188baf None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:14.519947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96925e59-92f3-4143-88c4-fd1812188baf None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:14.521231 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:14.526476 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea973e2-418d-422e-a84a-9b1ff98f3b44 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:14.526912 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea973e2-418d-422e-a84a-9b1ff98f3b44 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:14.527017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea973e2-418d-422e-a84a-9b1ff98f3b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:14.544140 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-fea973e2-418d-422e-a84a-9b1ff98f3b44 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:14.545620 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-fea973e2-418d-422e-a84a-9b1ff98f3b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:14.553262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:14.591632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96925e59-92f3-4143-88c4-fd1812188baf None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:14.602528 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96925e59-92f3-4143-88c4-fd1812188baf None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:14.606002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80b34c-4cd9-4f3d-b543-3f2358f54a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:14.606628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80b34c-4cd9-4f3d-b543-3f2358f54a3f service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:14.606907 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80b34c-4cd9-4f3d-b543-3f2358f54a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:14.607179 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80b34c-4cd9-4f3d-b543-3f2358f54a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:14.616547 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80b34c-4cd9-4f3d-b543-3f2358f54a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:14.617987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80b34c-4cd9-4f3d-b543-3f2358f54a3f service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:14.627084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 719/1443] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:16.985782 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f2305-267a-4860-b05f-36b810ff19a2 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:16.986299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f2305-267a-4860-b05f-36b810ff19a2 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:16.986299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f2305-267a-4860-b05f-36b810ff19a2 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:16.988190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:14:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:16.993729 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a4aeb-990b-4210-a233-cbdd4e78c912 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:16.994298 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a4aeb-990b-4210-a233-cbdd4e78c912 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:16.994298 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a4aeb-990b-4210-a233-cbdd4e78c912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:17.012558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-352a4aeb-990b-4210-a233-cbdd4e78c912 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:17.013777 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-352a4aeb-990b-4210-a233-cbdd4e78c912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:17.021594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:17.059896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f2305-267a-4860-b05f-36b810ff19a2 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:17.072166 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f2305-267a-4860-b05f-36b810ff19a2 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:17.075692 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcb212-8008-4437-a738-39dcfdd5c3b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:17.076325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcb212-8008-4437-a738-39dcfdd5c3b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:17.076638 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcb212-8008-4437-a738-39dcfdd5c3b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:17.076918 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcb212-8008-4437-a738-39dcfdd5c3b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:17.085674 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcb212-8008-4437-a738-39dcfdd5c3b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:17.087095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcb212-8008-4437-a738-39dcfdd5c3b8 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:17.096417 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 726/1446] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:19.680530 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d1d0b-8bbf-42f4-a2a1-acc2e37b8d46 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:19.681180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d1d0b-8bbf-42f4-a2a1-acc2e37b8d46 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:19.681180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d1d0b-8bbf-42f4-a2a1-acc2e37b8d46 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:19.682381 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:19.687860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b885f-a28b-432a-ac24-36c0f43a3a4d None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:19.688333 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b885f-a28b-432a-ac24-36c0f43a3a4d None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:19.688454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b885f-a28b-432a-ac24-36c0f43a3a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:19.707006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-b97b885f-a28b-432a-ac24-36c0f43a3a4d None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:19.708177 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-b97b885f-a28b-432a-ac24-36c0f43a3a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:19.715895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:19.754560 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d1d0b-8bbf-42f4-a2a1-acc2e37b8d46 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:19.765155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d1d0b-8bbf-42f4-a2a1-acc2e37b8d46 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:19.769407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aa993-ab84-40cf-ad5c-a9d355dc8db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:19.770039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aa993-ab84-40cf-ad5c-a9d355dc8db7 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:19.770314 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aa993-ab84-40cf-ad5c-a9d355dc8db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:19.770586 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aa993-ab84-40cf-ad5c-a9d355dc8db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:19.779641 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aa993-ab84-40cf-ad5c-a9d355dc8db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:19.781093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aa993-ab84-40cf-ad5c-a9d355dc8db7 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:19.790415 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 722/1449] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:22.123833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22449e-859c-4fc3-8770-388d7f30ff21 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:22.124369 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22449e-859c-4fc3-8770-388d7f30ff21 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:22.124369 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22449e-859c-4fc3-8770-388d7f30ff21 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:22.125782 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:22.131096 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58a397-7fbf-4d4f-913a-bb94061737ea None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:22.131548 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58a397-7fbf-4d4f-913a-bb94061737ea None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:22.131651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58a397-7fbf-4d4f-913a-bb94061737ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:22.148849 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-bb58a397-7fbf-4d4f-913a-bb94061737ea None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:22.150041 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-bb58a397-7fbf-4d4f-913a-bb94061737ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:22.157684 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:22.197569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22449e-859c-4fc3-8770-388d7f30ff21 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:22.208817 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22449e-859c-4fc3-8770-388d7f30ff21 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:22.212545 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efab515-a19c-4032-a089-aa2d112bd778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:22.213208 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efab515-a19c-4032-a089-aa2d112bd778 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:22.213503 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efab515-a19c-4032-a089-aa2d112bd778 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:22.213772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efab515-a19c-4032-a089-aa2d112bd778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:22.223227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efab515-a19c-4032-a089-aa2d112bd778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:22.224677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efab515-a19c-4032-a089-aa2d112bd778 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:22.233925 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 729/1452] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:24.473828 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80d3fd-cf6a-4c93-8d4f-fe905cc9f85d None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:24.474379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80d3fd-cf6a-4c93-8d4f-fe905cc9f85d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:24.474379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80d3fd-cf6a-4c93-8d4f-fe905cc9f85d None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:24.475799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:24.481292 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2664c-8299-431c-9277-1c373783cca0 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:24.481757 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2664c-8299-431c-9277-1c373783cca0 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:24.481875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2664c-8299-431c-9277-1c373783cca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:24.499626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-49e2664c-8299-431c-9277-1c373783cca0 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:24.500858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-49e2664c-8299-431c-9277-1c373783cca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:24.509579 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:24.546901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80d3fd-cf6a-4c93-8d4f-fe905cc9f85d None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:24.558509 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80d3fd-cf6a-4c93-8d4f-fe905cc9f85d None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:24.562216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405b2a6-6170-4d97-97ed-74829c3efff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:24.562856 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405b2a6-6170-4d97-97ed-74829c3efff6 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:24.563136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405b2a6-6170-4d97-97ed-74829c3efff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:24.563437 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405b2a6-6170-4d97-97ed-74829c3efff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:24.573168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405b2a6-6170-4d97-97ed-74829c3efff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:24.574906 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405b2a6-6170-4d97-97ed-74829c3efff6 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:24.584191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 725/1455] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:26.829602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a16d1-9bea-45d6-9049-07cc7cbdd449 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:26.830147 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a16d1-9bea-45d6-9049-07cc7cbdd449 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:26.830147 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a16d1-9bea-45d6-9049-07cc7cbdd449 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:26.832237 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:26.837964 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf2528-0a67-405a-a963-71f22d303c20 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:26.838359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf2528-0a67-405a-a963-71f22d303c20 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:26.838550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf2528-0a67-405a-a963-71f22d303c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:26.856277 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-badf2528-0a67-405a-a963-71f22d303c20 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:26.857513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-badf2528-0a67-405a-a963-71f22d303c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:26.865224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:26.902776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a16d1-9bea-45d6-9049-07cc7cbdd449 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:26.913924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a16d1-9bea-45d6-9049-07cc7cbdd449 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:26.917416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44a583-7a9d-4b63-8785-61dbef2cc2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:26.918046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44a583-7a9d-4b63-8785-61dbef2cc2db service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:26.918329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44a583-7a9d-4b63-8785-61dbef2cc2db service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:26.918603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44a583-7a9d-4b63-8785-61dbef2cc2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:26.927605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44a583-7a9d-4b63-8785-61dbef2cc2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:26.929054 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44a583-7a9d-4b63-8785-61dbef2cc2db service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:26.938504 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 732/1458] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:29.192428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc21293-1e1c-495b-b23e-712350914f3e None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:29.193021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc21293-1e1c-495b-b23e-712350914f3e None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:29.193021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc21293-1e1c-495b-b23e-712350914f3e None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:29.194369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:29.199978 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f636c4-05c1-45dd-b169-c8e3019f5e02 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:29.204974 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f636c4-05c1-45dd-b169-c8e3019f5e02 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:29.204974 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f636c4-05c1-45dd-b169-c8e3019f5e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:29.207388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=70 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:29.219452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-13f636c4-05c1-45dd-b169-c8e3019f5e02 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:29.220684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-13f636c4-05c1-45dd-b169-c8e3019f5e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:29.229246 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:29.265650 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc21293-1e1c-495b-b23e-712350914f3e None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:29.271486 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=73 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:29.276989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc21293-1e1c-495b-b23e-712350914f3e None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:29.280410 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd20563-7f45-43d1-858e-92a4bd70aed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:29.281074 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd20563-7f45-43d1-858e-92a4bd70aed3 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:29.281351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd20563-7f45-43d1-858e-92a4bd70aed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:29.281622 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd20563-7f45-43d1-858e-92a4bd70aed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:29.291333 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd20563-7f45-43d1-858e-92a4bd70aed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:29.292792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd20563-7f45-43d1-858e-92a4bd70aed3 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:29.302865 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 728/1461] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:14:31.561234 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a73b74-3003-4618-b89c-dbd3cc5f0091 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:31.561661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a73b74-3003-4618-b89c-dbd3cc5f0091 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:31.561821 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a73b74-3003-4618-b89c-dbd3cc5f0091 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:31.563190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:31.569286 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de19d0-5ad6-46d9-959f-205b64682ec8 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:31.569741 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de19d0-5ad6-46d9-959f-205b64682ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:31.569844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de19d0-5ad6-46d9-959f-205b64682ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:31.587245 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-04de19d0-5ad6-46d9-959f-205b64682ec8 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:31.588430 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-04de19d0-5ad6-46d9-959f-205b64682ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:31.596758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:31.634977 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a73b74-3003-4618-b89c-dbd3cc5f0091 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:31.645433 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a73b74-3003-4618-b89c-dbd3cc5f0091 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:31.648906 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b142a-d994-41e1-b952-85e8c115e62c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:31.649544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b142a-d994-41e1-b952-85e8c115e62c service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:31.649828 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b142a-d994-41e1-b952-85e8c115e62c service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:31.650105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b142a-d994-41e1-b952-85e8c115e62c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:31.659298 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b142a-d994-41e1-b952-85e8c115e62c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:31.660728 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b142a-d994-41e1-b952-85e8c115e62c service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:31.670143 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 735/1464] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:33.904342 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9c1b7-c5c7-420d-ad72-4c6c723b7473 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:33.904926 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9c1b7-c5c7-420d-ad72-4c6c723b7473 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:33.904926 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9c1b7-c5c7-420d-ad72-4c6c723b7473 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:33.906193 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:33.911582 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d267a8-bd47-4b47-b41d-b08ca7db1060 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:33.912073 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d267a8-bd47-4b47-b41d-b08ca7db1060 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:33.912173 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d267a8-bd47-4b47-b41d-b08ca7db1060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:33.929963 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-62d267a8-bd47-4b47-b41d-b08ca7db1060 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:33.931155 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-62d267a8-bd47-4b47-b41d-b08ca7db1060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:33.938823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:33.975242 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9c1b7-c5c7-420d-ad72-4c6c723b7473 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:33.985682 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9c1b7-c5c7-420d-ad72-4c6c723b7473 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:33.989212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e01026-e8ea-429a-a841-1f06a1669d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:33.989841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e01026-e8ea-429a-a841-1f06a1669d06 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:33.990120 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e01026-e8ea-429a-a841-1f06a1669d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:33.990389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e01026-e8ea-429a-a841-1f06a1669d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:33.999199 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e01026-e8ea-429a-a841-1f06a1669d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:34.000646 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e01026-e8ea-429a-a841-1f06a1669d06 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:34.010393 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 731/1467] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:36.222188 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b5292-5b9a-48e0-9ee4-fbaca7580b34 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:36.222769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b5292-5b9a-48e0-9ee4-fbaca7580b34 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:36.222769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b5292-5b9a-48e0-9ee4-fbaca7580b34 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:36.224269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:14:36.230090 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccbc93-d24b-4605-bf40-624de76acf4c None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:36.230724 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccbc93-d24b-4605-bf40-624de76acf4c None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:36.230724 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccbc93-d24b-4605-bf40-624de76acf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:36.248717 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-32ccbc93-d24b-4605-bf40-624de76acf4c None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:36.249909 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-32ccbc93-d24b-4605-bf40-624de76acf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:36.257582 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:36.293944 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b5292-5b9a-48e0-9ee4-fbaca7580b34 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:36.305493 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b5292-5b9a-48e0-9ee4-fbaca7580b34 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:36.309095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730291d-f221-429a-bcb2-6a7c4fa62dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:36.309733 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730291d-f221-429a-bcb2-6a7c4fa62dbf service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:36.310017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730291d-f221-429a-bcb2-6a7c4fa62dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:36.310294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730291d-f221-429a-bcb2-6a7c4fa62dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:36.319234 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730291d-f221-429a-bcb2-6a7c4fa62dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:36.320679 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730291d-f221-429a-bcb2-6a7c4fa62dbf service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:36.330099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 738/1470] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:46.243957 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=17 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:46.325992 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=17 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:15:09.704710 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1da0e9-537f-42b6-ab4a-1eacc14013f8 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:09.705332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1da0e9-537f-42b6-ab4a-1eacc14013f8 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:09.705332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1da0e9-537f-42b6-ab4a-1eacc14013f8 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:09.706628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 733/1471] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:15:09.712120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5fcd2-0a80-411c-9117-0b2f67d9938c None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:09.712633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5fcd2-0a80-411c-9117-0b2f67d9938c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:09.712735 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5fcd2-0a80-411c-9117-0b2f67d9938c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:09.732912 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-e4e5fcd2-0a80-411c-9117-0b2f67d9938c None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:09.734110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e4e5fcd2-0a80-411c-9117-0b2f67d9938c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:09.742506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 739/1472] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:15:09.789307 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26162e13-85ae-4692-8e6c-29958aff5952 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:09.789591 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26162e13-85ae-4692-8e6c-29958aff5952 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:09.789863 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26162e13-85ae-4692-8e6c-29958aff5952 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:09.791324 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 734/1473] 10.222.0.66 () {54 vars in 962 bytes} [Thu May 26 21:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:15:09.796491 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2d1c0-5e2e-40fd-a1e5-afdf2a6a54c5 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:09.796807 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2d1c0-5e2e-40fd-a1e5-afdf2a6a54c5 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:09.797091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2d1c0-5e2e-40fd-a1e5-afdf2a6a54c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:09.816209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-a9a2d1c0-5e2e-40fd-a1e5-afdf2a6a54c5 None None] MFA Rules not processed for user `4561bdb2d75e4025a5d73ea713c690b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:09.817450 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-a9a2d1c0-5e2e-40fd-a1e5-afdf2a6a54c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:09.823899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 740/1474] 10.222.0.66 () {58 vars in 1059 bytes} [Thu May 26 21:15:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:15:09.831080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26162e13-85ae-4692-8e6c-29958aff5952 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:09.841736 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26162e13-85ae-4692-8e6c-29958aff5952 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:09.845769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57669d43-1b90-4cf0-904b-0ea87b89d091 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdb2d75e4025a5d73ea713c690b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:09.846387 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57669d43-1b90-4cf0-904b-0ea87b89d091 service glance] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:09.846664 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57669d43-1b90-4cf0-904b-0ea87b89d091 service glance] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:09.846935 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57669d43-1b90-4cf0-904b-0ea87b89d091 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:09.855685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57669d43-1b90-4cf0-904b-0ea87b89d091 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:09.857124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57669d43-1b90-4cf0-904b-0ea87b89d091 service glance] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:09.867023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 735/1475] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:15:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:15:12.162418 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff44a79-4560-4b5b-9192-5cbb513c4814 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:12.162979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff44a79-4560-4b5b-9192-5cbb513c4814 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:12.162979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff44a79-4560-4b5b-9192-5cbb513c4814 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:12.164447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 741/1476] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:15:12.170085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234b121-28f0-482b-b091-f329f1358267 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:12.170483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234b121-28f0-482b-b091-f329f1358267 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:12.170631 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234b121-28f0-482b-b091-f329f1358267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:12.188922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-4234b121-28f0-482b-b091-f329f1358267 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:12.190142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-4234b121-28f0-482b-b091-f329f1358267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:12.197912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 736/1477] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:15:12.221434 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff44a79-4560-4b5b-9192-5cbb513c4814 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:12.234120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff44a79-4560-4b5b-9192-5cbb513c4814 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:12.238846 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d832f0-47ff-4aac-9c95-e62124bb0de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:12.239490 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d832f0-47ff-4aac-9c95-e62124bb0de9 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:12.240253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d832f0-47ff-4aac-9c95-e62124bb0de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:12.240539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d832f0-47ff-4aac-9c95-e62124bb0de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:12.241309 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d832f0-47ff-4aac-9c95-e62124bb0de9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:12.243071 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: WARNING py.warnings [None req-92d832f0-47ff-4aac-9c95-e62124bb0de9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:15:12.243071 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: warnings.warn(msg) May 26 21:15:12.243071 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: May 26 21:15:12.244301 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d832f0-47ff-4aac-9c95-e62124bb0de9 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:12.264090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 742/1478] 10.222.0.66 () {56 vars in 1108 bytes} [Thu May 26 21:15:12 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:15:14.491562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ef1d4-63d6-4563-ab7f-b7a78020654c None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:14.492088 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ef1d4-63d6-4563-ab7f-b7a78020654c None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:14.492206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ef1d4-63d6-4563-ab7f-b7a78020654c None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:14.493543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 737/1479] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:15:14.498743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65ff31-31c9-448e-b1b1-6dcc595bbd18 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:14.499175 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65ff31-31c9-448e-b1b1-6dcc595bbd18 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:14.499296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65ff31-31c9-448e-b1b1-6dcc595bbd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:14.517571 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-da65ff31-31c9-448e-b1b1-6dcc595bbd18 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:14.518790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-da65ff31-31c9-448e-b1b1-6dcc595bbd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:14.526843 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 743/1480] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:15:14.572348 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ef1d4-63d6-4563-ab7f-b7a78020654c None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:14.589104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ef1d4-63d6-4563-ab7f-b7a78020654c None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:14.594389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb2410-e8cd-40db-a4d5-c92951919059 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:14.595622 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb2410-e8cd-40db-a4d5-c92951919059 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:14.595909 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb2410-e8cd-40db-a4d5-c92951919059 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:14.596187 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb2410-e8cd-40db-a4d5-c92951919059 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:14.604355 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb2410-e8cd-40db-a4d5-c92951919059 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:14.605970 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb2410-e8cd-40db-a4d5-c92951919059 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:14.615889 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 738/1481] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:15:17.002131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186767f-4ba3-4697-bc02-310ebf7e5c9a None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:17.002668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186767f-4ba3-4697-bc02-310ebf7e5c9a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:17.002668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186767f-4ba3-4697-bc02-310ebf7e5c9a None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:17.004084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 744/1482] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:15:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:15:17.009885 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62861d7-967d-408b-8955-3e256d63d582 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:17.010390 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62861d7-967d-408b-8955-3e256d63d582 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:17.010501 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62861d7-967d-408b-8955-3e256d63d582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:17.027734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-c62861d7-967d-408b-8955-3e256d63d582 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:17.028959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-c62861d7-967d-408b-8955-3e256d63d582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:17.036784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 739/1483] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:15:17.073626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186767f-4ba3-4697-bc02-310ebf7e5c9a None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:17.084287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186767f-4ba3-4697-bc02-310ebf7e5c9a None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:17.087784 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b53ec-2bc3-4e38-b388-f013be388e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:17.088418 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b53ec-2bc3-4e38-b388-f013be388e68 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:17.088745 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b53ec-2bc3-4e38-b388-f013be388e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:17.089029 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b53ec-2bc3-4e38-b388-f013be388e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:17.097797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b53ec-2bc3-4e38-b388-f013be388e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:17.099218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b53ec-2bc3-4e38-b388-f013be388e68 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:17.108462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 745/1484] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:15:19.389955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e51d2a-00c5-491e-ad0b-e63ead1802b4 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:19.390532 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e51d2a-00c5-491e-ad0b-e63ead1802b4 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:19.390532 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e51d2a-00c5-491e-ad0b-e63ead1802b4 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:19.391877 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 740/1485] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:15:19.397207 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddcb22-9e79-490c-9312-2d9ef4867a1c None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:19.397668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddcb22-9e79-490c-9312-2d9ef4867a1c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:19.397769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddcb22-9e79-490c-9312-2d9ef4867a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:19.417562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-10ddcb22-9e79-490c-9312-2d9ef4867a1c None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:19.419024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-10ddcb22-9e79-490c-9312-2d9ef4867a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:19.427587 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 746/1486] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:15:19.468680 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e51d2a-00c5-491e-ad0b-e63ead1802b4 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:19.479199 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e51d2a-00c5-491e-ad0b-e63ead1802b4 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:19.482685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fad818-c278-43a3-96d6-f34d19d83d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:19.483308 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fad818-c278-43a3-96d6-f34d19d83d93 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:19.483587 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fad818-c278-43a3-96d6-f34d19d83d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:19.483986 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fad818-c278-43a3-96d6-f34d19d83d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:19.493739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fad818-c278-43a3-96d6-f34d19d83d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:19.496869 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fad818-c278-43a3-96d6-f34d19d83d93 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:19.505048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 741/1487] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:15:21.810991 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570591c-ef36-4cb8-a1d2-b740f8f4dcb4 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:21.811563 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570591c-ef36-4cb8-a1d2-b740f8f4dcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:21.811563 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570591c-ef36-4cb8-a1d2-b740f8f4dcb4 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:21.812875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 747/1488] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:15:21.818762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe67615-22af-4a39-8b6a-348da745ae82 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:21.819302 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe67615-22af-4a39-8b6a-348da745ae82 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:21.819302 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe67615-22af-4a39-8b6a-348da745ae82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:21.839703 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-6fe67615-22af-4a39-8b6a-348da745ae82 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:21.840918 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-6fe67615-22af-4a39-8b6a-348da745ae82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:21.849073 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 742/1489] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:15:21.889529 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570591c-ef36-4cb8-a1d2-b740f8f4dcb4 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:21.900187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570591c-ef36-4cb8-a1d2-b740f8f4dcb4 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:21.903694 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16064c6-1f7f-4e66-8541-23854e35ebb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:21.904326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16064c6-1f7f-4e66-8541-23854e35ebb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:21.904632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16064c6-1f7f-4e66-8541-23854e35ebb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:21.904914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16064c6-1f7f-4e66-8541-23854e35ebb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:21.914241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16064c6-1f7f-4e66-8541-23854e35ebb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:21.915661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16064c6-1f7f-4e66-8541-23854e35ebb8 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:21.926143 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 748/1490] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:15:24.587196 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d0c36-4e7f-4861-9805-861ce04f888c None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:24.587755 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d0c36-4e7f-4861-9805-861ce04f888c None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:24.587755 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d0c36-4e7f-4861-9805-861ce04f888c None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:24.589190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 743/1491] 10.222.0.66 () {54 vars in 926 bytes} [Thu May 26 21:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:15:24.595318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e492776-a11b-44f9-89fe-53bb21e9c81f None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:24.595789 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e492776-a11b-44f9-89fe-53bb21e9c81f None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:24.595902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e492776-a11b-44f9-89fe-53bb21e9c81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:24.614528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-2e492776-a11b-44f9-89fe-53bb21e9c81f None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:24.615722 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-2e492776-a11b-44f9-89fe-53bb21e9c81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:24.623584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 749/1492] 10.222.0.66 () {58 vars in 1023 bytes} [Thu May 26 21:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:15:24.662641 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d0c36-4e7f-4861-9805-861ce04f888c None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:24.673741 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d0c36-4e7f-4861-9805-861ce04f888c None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:24.677297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd94af0-5a64-450a-8c9c-f1286dbd108e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:24.677934 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd94af0-5a64-450a-8c9c-f1286dbd108e service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:24.678210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd94af0-5a64-450a-8c9c-f1286dbd108e service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:24.678480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd94af0-5a64-450a-8c9c-f1286dbd108e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:24.687711 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd94af0-5a64-450a-8c9c-f1286dbd108e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:24.689265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd94af0-5a64-450a-8c9c-f1286dbd108e service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:24.698414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 744/1493] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:15:34.608330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=33 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:15:34.694283 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=33 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:17:15.245615 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab71a0-4da0-459d-80d1-6d6eb8f51989 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:15.246318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab71a0-4da0-459d-80d1-6d6eb8f51989 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:15.246318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab71a0-4da0-459d-80d1-6d6eb8f51989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:15.264681 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-3aab71a0-4da0-459d-80d1-6d6eb8f51989 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:17:15.265887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3aab71a0-4da0-459d-80d1-6d6eb8f51989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:17:15.273673 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 750/1494] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:17:15.283768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41034b1-3429-46ac-b7ec-27f28b2a6484 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:15.284339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41034b1-3429-46ac-b7ec-27f28b2a6484 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:15.284441 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41034b1-3429-46ac-b7ec-27f28b2a6484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:15.302567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-e41034b1-3429-46ac-b7ec-27f28b2a6484 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:17:15.303808 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-e41034b1-3429-46ac-b7ec-27f28b2a6484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:17:15.311504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 745/1495] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:17:15.316270 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab71a0-4da0-459d-80d1-6d6eb8f51989 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:17:15.326748 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab71a0-4da0-459d-80d1-6d6eb8f51989 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:17:15.331332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fddfb-0ae0-46b8-99e0-3e3eea2d2d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:17:15.332002 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fddfb-0ae0-46b8-99e0-3e3eea2d2d4e admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:15.332286 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fddfb-0ae0-46b8-99e0-3e3eea2d2d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:15.332563 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fddfb-0ae0-46b8-99e0-3e3eea2d2d4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:15.333324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fddfb-0ae0-46b8-99e0-3e3eea2d2d4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:17:15.333639 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fddfb-0ae0-46b8-99e0-3e3eea2d2d4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:17:15.334650 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: WARNING py.warnings [None req-008fddfb-0ae0-46b8-99e0-3e3eea2d2d4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:17:15.334650 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: warnings.warn(msg) May 26 21:17:15.334650 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: May 26 21:17:15.335532 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fddfb-0ae0-46b8-99e0-3e3eea2d2d4e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:17:15.347971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 751/1496] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:17:15.356408 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41034b1-3429-46ac-b7ec-27f28b2a6484 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:17:15.365681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41034b1-3429-46ac-b7ec-27f28b2a6484 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:17:15.370266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaf9d9-a612-4649-8148-ea02d376a55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:17:15.370911 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaf9d9-a612-4649-8148-ea02d376a55e admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:15.371192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaf9d9-a612-4649-8148-ea02d376a55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:15.371463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaf9d9-a612-4649-8148-ea02d376a55e admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:15.372152 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faaf9d9-a612-4649-8148-ea02d376a55e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:17:15.374427 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: WARNING py.warnings [None req-3faaf9d9-a612-4649-8148-ea02d376a55e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:17:15.374427 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: warnings.warn(msg) May 26 21:17:15.374427 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: May 26 21:17:15.375599 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faaf9d9-a612-4649-8148-ea02d376a55e admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:17:15.567793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 746/1497] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:17:15 2022] POST /identity/v3/projects => generated 379 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:17:15.572177 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fddfb-0ae0-46b8-99e0-3e3eea2d2d4e admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:17:15.582959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fddfb-0ae0-46b8-99e0-3e3eea2d2d4e admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:17:15.641748 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33eb8a-e6e0-45a5-9b64-ddb736550702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:17:15.642571 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33eb8a-e6e0-45a5-9b64-ddb736550702 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:15.642927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33eb8a-e6e0-45a5-9b64-ddb736550702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:15.643278 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33eb8a-e6e0-45a5-9b64-ddb736550702 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:15.643993 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33eb8a-e6e0-45a5-9b64-ddb736550702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:17:15.645112 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: WARNING py.warnings [None req-3e33eb8a-e6e0-45a5-9b64-ddb736550702 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:17:15.645112 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: warnings.warn(msg) May 26 21:17:15.645112 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: May 26 21:17:15.646415 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33eb8a-e6e0-45a5-9b64-ddb736550702 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:17:15.755957 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 752/1498] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:17:15 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:17:15.760122 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaf9d9-a612-4649-8148-ea02d376a55e admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:17:15.771129 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaf9d9-a612-4649-8148-ea02d376a55e admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:17:15.775759 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df0d83-bbab-4a1f-9c3e-8145074085cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:17:15.776474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df0d83-bbab-4a1f-9c3e-8145074085cc admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:15.776790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df0d83-bbab-4a1f-9c3e-8145074085cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:15.778760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df0d83-bbab-4a1f-9c3e-8145074085cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:15.778760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df0d83-bbab-4a1f-9c3e-8145074085cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:17:15.778952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: WARNING py.warnings [None req-46df0d83-bbab-4a1f-9c3e-8145074085cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:17:15.778952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: warnings.warn(msg) May 26 21:17:15.778952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: May 26 21:17:15.780397 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df0d83-bbab-4a1f-9c3e-8145074085cc admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:17:15.795125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 747/1499] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:17:15.799441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33eb8a-e6e0-45a5-9b64-ddb736550702 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:17:15.809864 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33eb8a-e6e0-45a5-9b64-ddb736550702 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:17:15.814447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d180d3-f3c2-47ed-a039-85f89c69a16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:17:15.815255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d180d3-f3c2-47ed-a039-85f89c69a16f admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:15.815539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d180d3-f3c2-47ed-a039-85f89c69a16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:15.815816 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d180d3-f3c2-47ed-a039-85f89c69a16f admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:15.816547 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d180d3-f3c2-47ed-a039-85f89c69a16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:17:15.817604 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: WARNING py.warnings [None req-53d180d3-f3c2-47ed-a039-85f89c69a16f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:17:15.817604 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: warnings.warn(msg) May 26 21:17:15.817604 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: May 26 21:17:15.818505 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d180d3-f3c2-47ed-a039-85f89c69a16f admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:17:15.833001 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 753/1500] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:17:15.837459 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df0d83-bbab-4a1f-9c3e-8145074085cc admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:17:15.848079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df0d83-bbab-4a1f-9c3e-8145074085cc admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:17:15.852692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cd6a9-2c89-4526-be0c-4828688a8eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:17:15.853573 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd6a9-2c89-4526-be0c-4828688a8eab admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:15.853849 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd6a9-2c89-4526-be0c-4828688a8eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:15.854122 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd6a9-2c89-4526-be0c-4828688a8eab admin admin] PATH_INFO: `/v3/projects/ad7c6934657443f18d1d52c87206344e/users/779ea37d3aa540a9950c0e14bb744a3c/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:15.869248 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cd6a9-2c89-4526-be0c-4828688a8eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad7c6934657443f18d1d52c87206344e, user_id=779ea37d3aa540a9950c0e14bb744a3c, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:17:15.870306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: WARNING py.warnings [None req-de1cd6a9-2c89-4526-be0c-4828688a8eab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:17:15.870306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: warnings.warn(msg) May 26 21:17:15.870306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: May 26 21:17:15.872272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cd6a9-2c89-4526-be0c-4828688a8eab admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:17:15.939195 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 748/1501] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:17:15 2022] PUT /identity/v3/projects/ad7c6934657443f18d1d52c87206344e/users/779ea37d3aa540a9950c0e14bb744a3c/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:17:15.951911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e615bfc-3c72-4ec3-ae9e-8ee2c40c5003 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:15.952191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e615bfc-3c72-4ec3-ae9e-8ee2c40c5003 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:15.952468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e615bfc-3c72-4ec3-ae9e-8ee2c40c5003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:15.983091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-0e615bfc-3c72-4ec3-ae9e-8ee2c40c5003 None None] MFA Rules not processed for user `779ea37d3aa540a9950c0e14bb744a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:17:15.984314 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0e615bfc-3c72-4ec3-ae9e-8ee2c40c5003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:17:16.052223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 754/1502] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:17:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:17:16.065817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecabee2-1704-45d0-9948-e4f1e8292252 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:16.066023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecabee2-1704-45d0-9948-e4f1e8292252 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:16.066292 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecabee2-1704-45d0-9948-e4f1e8292252 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:16.067677 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 749/1503] 10.222.0.66 () {54 vars in 963 bytes} [Thu May 26 21:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:17:16.073075 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be477d0-97b4-4e05-9e06-6d4017250a44 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:16.073437 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be477d0-97b4-4e05-9e06-6d4017250a44 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:16.073819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be477d0-97b4-4e05-9e06-6d4017250a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:16.093867 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-3be477d0-97b4-4e05-9e06-6d4017250a44 None None] MFA Rules not processed for user `628bac94f0c54ac7a14ff19287efd8df`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:17:16.095181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3be477d0-97b4-4e05-9e06-6d4017250a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:17:16.142659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:17:16.150273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 755/1504] 10.222.0.66 () {58 vars in 1060 bytes} [Thu May 26 21:17:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:17:16.262939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecabee2-1704-45d0-9948-e4f1e8292252 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:17:16.276059 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecabee2-1704-45d0-9948-e4f1e8292252 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:17:16.279613 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5946cc-245b-4008-98f5-68a30e842386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:17:16.280257 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5946cc-245b-4008-98f5-68a30e842386 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:16.280536 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5946cc-245b-4008-98f5-68a30e842386 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:16.280840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5946cc-245b-4008-98f5-68a30e842386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:16.289931 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5946cc-245b-4008-98f5-68a30e842386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:17:16.291371 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5946cc-245b-4008-98f5-68a30e842386 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:17:16.300955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 750/1505] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:17:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:17:16.346529 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb5523-03fb-4cf4-9b87-1929fc13f2f0 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:16.347012 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb5523-03fb-4cf4-9b87-1929fc13f2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:16.347122 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb5523-03fb-4cf4-9b87-1929fc13f2f0 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:16.348439 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 756/1506] 10.222.0.66 () {52 vars in 829 bytes} [Thu May 26 21:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:17:16.352272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5946cc-245b-4008-98f5-68a30e842386 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:17:16.416659 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5946cc-245b-4008-98f5-68a30e842386 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:17:16.421159 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4043933-d2ce-4e3a-9b45-fb706b979436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:17:16.422029 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4043933-d2ce-4e3a-9b45-fb706b979436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:16.422307 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4043933-d2ce-4e3a-9b45-fb706b979436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:16.422572 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4043933-d2ce-4e3a-9b45-fb706b979436 admin admin] PATH_INFO: `/v3/users/779ea37d3aa540a9950c0e14bb744a3c` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:16.423775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4043933-d2ce-4e3a-9b45-fb706b979436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=779ea37d3aa540a9950c0e14bb744a3c)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:17:16.424894 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: WARNING py.warnings [None req-a4043933-d2ce-4e3a-9b45-fb706b979436 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:17:16.424894 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: warnings.warn(msg) May 26 21:17:16.424894 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: May 26 21:17:16.426087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4043933-d2ce-4e3a-9b45-fb706b979436 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:17:16.620639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-a4043933-d2ce-4e3a-9b45-fb706b979436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '779ea37d3aa540a9950c0e14bb744a3c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:17:16.621300 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-a4043933-d2ce-4e3a-9b45-fb706b979436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '779ea37d3aa540a9950c0e14bb744a3c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:17:16.621915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-a4043933-d2ce-4e3a-9b45-fb706b979436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '779ea37d3aa540a9950c0e14bb744a3c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:17:16.640690 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-a4043933-d2ce-4e3a-9b45-fb706b979436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '779ea37d3aa540a9950c0e14bb744a3c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:17:16.661218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-a4043933-d2ce-4e3a-9b45-fb706b979436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '779ea37d3aa540a9950c0e14bb744a3c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:17:16.666147 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:17:16.756154 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 751/1507] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:17:16 2022] DELETE /identity/v3/users/779ea37d3aa540a9950c0e14bb744a3c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:17:16.760861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d017b0d-2def-484b-9431-83c46d956707 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:16.761149 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d017b0d-2def-484b-9431-83c46d956707 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:16.761431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d017b0d-2def-484b-9431-83c46d956707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:16.779001 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-7d017b0d-2def-484b-9431-83c46d956707 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:17:16.780205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-7d017b0d-2def-484b-9431-83c46d956707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:17:16.840153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 757/1508] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:17:16.849826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4043933-d2ce-4e3a-9b45-fb706b979436 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:17:16.851234 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a4043933-d2ce-4e3a-9b45-fb706b979436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:17:16.908103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4043933-d2ce-4e3a-9b45-fb706b979436 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:17:16.911602 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cce0dc-757d-4176-bb71-28c0acee4fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:17:16.912308 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cce0dc-757d-4176-bb71-28c0acee4fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:16.912602 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cce0dc-757d-4176-bb71-28c0acee4fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:16.912887 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cce0dc-757d-4176-bb71-28c0acee4fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:16.923275 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cce0dc-757d-4176-bb71-28c0acee4fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:17:16.924738 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cce0dc-757d-4176-bb71-28c0acee4fc3 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:17:16.934016 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 752/1509] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:17:17.419475 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d017b0d-2def-484b-9431-83c46d956707 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:17:17.426677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-7d017b0d-2def-484b-9431-83c46d956707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:17:17.433980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d017b0d-2def-484b-9431-83c46d956707 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:17:17.441143 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f3167-3856-437e-91b4-b67c9e3c0963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:17:17.442156 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f3167-3856-437e-91b4-b67c9e3c0963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:17.442504 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f3167-3856-437e-91b4-b67c9e3c0963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:17.442880 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f3167-3856-437e-91b4-b67c9e3c0963 admin admin] PATH_INFO: `/v3/projects/ad7c6934657443f18d1d52c87206344e` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:17.444881 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f3167-3856-437e-91b4-b67c9e3c0963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad7c6934657443f18d1d52c87206344e)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:17:17.445779 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: WARNING py.warnings [None req-f65f3167-3856-437e-91b4-b67c9e3c0963 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:17:17.445779 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: warnings.warn(msg) May 26 21:17:17.445779 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: May 26 21:17:17.447267 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f3167-3856-437e-91b4-b67c9e3c0963 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:17:17.574794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f65f3167-3856-437e-91b4-b67c9e3c0963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad7c6934657443f18d1d52c87206344e', 'request_id': 'req-f65f3167-3856-437e-91b4-b67c9e3c0963'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:17:17.581712 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f65f3167-3856-437e-91b4-b67c9e3c0963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad7c6934657443f18d1d52c87206344e', 'request_id': 'req-f65f3167-3856-437e-91b4-b67c9e3c0963'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:17:17.669075 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f65f3167-3856-437e-91b4-b67c9e3c0963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad7c6934657443f18d1d52c87206344e', 'request_id': 'req-f65f3167-3856-437e-91b4-b67c9e3c0963'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:17:17.690937 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f65f3167-3856-437e-91b4-b67c9e3c0963 admin admin] The token cache is being invalidate because project ad7c6934657443f18d1d52c87206344e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:17:17.691224 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f65f3167-3856-437e-91b4-b67c9e3c0963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:17:17.692000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f65f3167-3856-437e-91b4-b67c9e3c0963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:17:17.693717 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 758/1510] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:17:17 2022] DELETE /identity/v3/projects/ad7c6934657443f18d1d52c87206344e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:17:26.929980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:17:27.687490 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:18:55.817343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b00ee7-5375-4b08-a690-30e84a32bede None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:18:55.818008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b00ee7-5375-4b08-a690-30e84a32bede None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:18:55.818008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b00ee7-5375-4b08-a690-30e84a32bede None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:18:55.819205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:18:55.827176 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6915f69-ef7d-4e8c-b6e4-715f1bff2b1a None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:18:55.827732 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6915f69-ef7d-4e8c-b6e4-715f1bff2b1a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:18:55.827732 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6915f69-ef7d-4e8c-b6e4-715f1bff2b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:18:55.846720 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-c6915f69-ef7d-4e8c-b6e4-715f1bff2b1a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:18:55.847928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-c6915f69-ef7d-4e8c-b6e4-715f1bff2b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:18:55.910868 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:18:56.082258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b00ee7-5375-4b08-a690-30e84a32bede None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:18:56.084048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a2b00ee7-5375-4b08-a690-30e84a32bede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:18:56.171682 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b00ee7-5375-4b08-a690-30e84a32bede None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:18:56.178171 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76e085-8d59-4d95-9264-69f200d7db08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:18:56.178938 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76e085-8d59-4d95-9264-69f200d7db08 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:18:56.179225 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76e085-8d59-4d95-9264-69f200d7db08 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:18:56.179592 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76e085-8d59-4d95-9264-69f200d7db08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:18:56.191885 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76e085-8d59-4d95-9264-69f200d7db08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:18:56.194373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76e085-8d59-4d95-9264-69f200d7db08 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:18:56.206279 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 754/1513] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:18:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:18:57.112755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e66379-ddbc-47cc-af5d-4120b9878be3 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:18:57.113379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e66379-ddbc-47cc-af5d-4120b9878be3 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:18:57.113379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e66379-ddbc-47cc-af5d-4120b9878be3 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:18:57.114937 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:18:57.120144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ccad8-bce5-4416-a50b-c85ead4dc0f8 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:18:57.120687 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ccad8-bce5-4416-a50b-c85ead4dc0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:18:57.120807 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ccad8-bce5-4416-a50b-c85ead4dc0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:18:57.142707 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-f06ccad8-bce5-4416-a50b-c85ead4dc0f8 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:18:57.144703 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f06ccad8-bce5-4416-a50b-c85ead4dc0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:18:57.153584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:18:57.309378 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e66379-ddbc-47cc-af5d-4120b9878be3 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:18:57.326391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e66379-ddbc-47cc-af5d-4120b9878be3 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:18:57.332468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425efbd9-4850-465c-bfe8-19785b2731cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:18:57.335576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425efbd9-4850-465c-bfe8-19785b2731cd service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:18:57.335576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425efbd9-4850-465c-bfe8-19785b2731cd service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:18:57.335576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425efbd9-4850-465c-bfe8-19785b2731cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:18:57.344037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425efbd9-4850-465c-bfe8-19785b2731cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:18:57.345752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425efbd9-4850-465c-bfe8-19785b2731cd service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:18:57.356761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 761/1516] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:18:57.528337 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71483478-ae96-4a39-b08d-b7e4f2ad9c51 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:18:57.528829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71483478-ae96-4a39-b08d-b7e4f2ad9c51 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:18:57.529196 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71483478-ae96-4a39-b08d-b7e4f2ad9c51 None None] PATH_INFO: `/v3` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:18:57.530501 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 756/1517] 10.222.0.50 () {54 vars in 925 bytes} [Thu May 26 21:18:57 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:18:57.537529 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082af90e-9939-4764-874f-a3e466139480 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:18:57.537769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082af90e-9939-4764-874f-a3e466139480 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:18:57.538049 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082af90e-9939-4764-874f-a3e466139480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:18:57.556125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-082af90e-9939-4764-874f-a3e466139480 None None] MFA Rules not processed for user `2d68ccb9b89843078c40b13f79a72dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:18:57.557906 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-082af90e-9939-4764-874f-a3e466139480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:18:57.624362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 762/1518] 10.222.0.50 () {58 vars in 1015 bytes} [Thu May 26 21:18:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:02.001321 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b17d9-8829-4719-bdca-0857b2d4d027 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:02.001984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b17d9-8829-4719-bdca-0857b2d4d027 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:02.001984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b17d9-8829-4719-bdca-0857b2d4d027 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:02.003217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 757/1519] 10.222.0.66 () {54 vars in 960 bytes} [Thu May 26 21:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:19:02.009095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1636a-ed2d-4299-a8bb-47051ebeaf88 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:02.009605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1636a-ed2d-4299-a8bb-47051ebeaf88 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:02.009727 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1636a-ed2d-4299-a8bb-47051ebeaf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:02.037944 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-b6d1636a-ed2d-4299-a8bb-47051ebeaf88 None None] MFA Rules not processed for user `2d68ccb9b89843078c40b13f79a72dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:02.039468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-b6d1636a-ed2d-4299-a8bb-47051ebeaf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:02.048935 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 763/1520] 10.222.0.66 () {58 vars in 1057 bytes} [Thu May 26 21:19:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:02.056735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b17d9-8829-4719-bdca-0857b2d4d027 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:02.070297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b17d9-8829-4719-bdca-0857b2d4d027 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:02.075506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39e84c-38f9-4919-a4c2-6ed2f8d152d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:02.076156 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39e84c-38f9-4919-a4c2-6ed2f8d152d9 service placement] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:02.076439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39e84c-38f9-4919-a4c2-6ed2f8d152d9 service placement] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:02.076744 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39e84c-38f9-4919-a4c2-6ed2f8d152d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:02.085706 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39e84c-38f9-4919-a4c2-6ed2f8d152d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:02.087298 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39e84c-38f9-4919-a4c2-6ed2f8d152d9 service placement] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:02.098093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 758/1521] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:19:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:08.701447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4541281-a2eb-42a8-b4dd-50d1814c20c8 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:08.702018 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4541281-a2eb-42a8-b4dd-50d1814c20c8 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:08.702241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4541281-a2eb-42a8-b4dd-50d1814c20c8 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:08.703698 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:19:08.709124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255203cf-c8af-4574-a632-24d20a21210e None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:08.709662 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255203cf-c8af-4574-a632-24d20a21210e None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:08.709662 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255203cf-c8af-4574-a632-24d20a21210e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:08.728155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-255203cf-c8af-4574-a632-24d20a21210e None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:08.729489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-255203cf-c8af-4574-a632-24d20a21210e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:08.737482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:08.895238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4541281-a2eb-42a8-b4dd-50d1814c20c8 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:08.910479 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4541281-a2eb-42a8-b4dd-50d1814c20c8 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:08.916281 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87ae9e-976f-4901-b5ee-1f3671a2e724 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:08.916983 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87ae9e-976f-4901-b5ee-1f3671a2e724 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:08.917264 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87ae9e-976f-4901-b5ee-1f3671a2e724 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:08.917592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87ae9e-976f-4901-b5ee-1f3671a2e724 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:08.926674 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87ae9e-976f-4901-b5ee-1f3671a2e724 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:08.928299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87ae9e-976f-4901-b5ee-1f3671a2e724 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:08.939084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 765/1524] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:09.824041 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357db5a-af03-404a-9dc9-775ef94ce7cc None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:09.824658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357db5a-af03-404a-9dc9-775ef94ce7cc None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:09.824658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357db5a-af03-404a-9dc9-775ef94ce7cc None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:09.826017 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:19:09.830926 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593f35c-32bf-4427-ac80-7b2a79a6ded5 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:09.831417 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593f35c-32bf-4427-ac80-7b2a79a6ded5 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:09.831538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593f35c-32bf-4427-ac80-7b2a79a6ded5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:09.850048 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-6593f35c-32bf-4427-ac80-7b2a79a6ded5 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:09.851266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6593f35c-32bf-4427-ac80-7b2a79a6ded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:09.860295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:10.016354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357db5a-af03-404a-9dc9-775ef94ce7cc None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:10.037391 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357db5a-af03-404a-9dc9-775ef94ce7cc None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:10.044696 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb02be-cb09-4afa-93f5-3d0129df1861 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:10.045529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb02be-cb09-4afa-93f5-3d0129df1861 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:10.045977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb02be-cb09-4afa-93f5-3d0129df1861 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:10.046344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb02be-cb09-4afa-93f5-3d0129df1861 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:10.060000 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb02be-cb09-4afa-93f5-3d0129df1861 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:10.063035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb02be-cb09-4afa-93f5-3d0129df1861 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:10.083445 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 761/1527] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:14.393916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa82c34-07c9-4291-acae-de99d39cbfa4 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:14.394538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa82c34-07c9-4291-acae-de99d39cbfa4 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:14.394538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa82c34-07c9-4291-acae-de99d39cbfa4 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:14.395984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:19:14.401966 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0f084-8a04-4843-9167-9f8cdb295d81 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:14.402457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0f084-8a04-4843-9167-9f8cdb295d81 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:14.402570 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0f084-8a04-4843-9167-9f8cdb295d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:14.421770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-42c0f084-8a04-4843-9167-9f8cdb295d81 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:14.423003 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-42c0f084-8a04-4843-9167-9f8cdb295d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:14.430896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:14.468208 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa82c34-07c9-4291-acae-de99d39cbfa4 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:14.469949 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3fa82c34-07c9-4291-acae-de99d39cbfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:14.529326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa82c34-07c9-4291-acae-de99d39cbfa4 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:14.532814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc602479-ad82-4758-b8aa-2493bb6d3021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:14.533474 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc602479-ad82-4758-b8aa-2493bb6d3021 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:14.533759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc602479-ad82-4758-b8aa-2493bb6d3021 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:14.534033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc602479-ad82-4758-b8aa-2493bb6d3021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:14.544258 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc602479-ad82-4758-b8aa-2493bb6d3021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:14.545733 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc602479-ad82-4758-b8aa-2493bb6d3021 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:14.550994 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:14.555990 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 768/1530] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:16.832064 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918b734-83ac-486e-8357-dc981107995c None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:16.832677 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918b734-83ac-486e-8357-dc981107995c None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:16.832677 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918b734-83ac-486e-8357-dc981107995c None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:16.833952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:19:16.840123 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e44659-7642-4ad5-8f0b-abe0e92e1c9c None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:16.840706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e44659-7642-4ad5-8f0b-abe0e92e1c9c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:16.840706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e44659-7642-4ad5-8f0b-abe0e92e1c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:16.858885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-a2e44659-7642-4ad5-8f0b-abe0e92e1c9c None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:16.860117 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-a2e44659-7642-4ad5-8f0b-abe0e92e1c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:16.868297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:16.905050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918b734-83ac-486e-8357-dc981107995c None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:16.917837 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918b734-83ac-486e-8357-dc981107995c None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:16.923118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d460535-f41f-415d-81e4-0879dcf4127c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:16.923795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d460535-f41f-415d-81e4-0879dcf4127c service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:16.924111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d460535-f41f-415d-81e4-0879dcf4127c service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:16.924385 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d460535-f41f-415d-81e4-0879dcf4127c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:16.936264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d460535-f41f-415d-81e4-0879dcf4127c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:16.937772 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d460535-f41f-415d-81e4-0879dcf4127c service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:16.949107 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 764/1533] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:20.641065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b4e11-bb96-4dc4-b57c-ae2af136038c None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:20.641668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b4e11-bb96-4dc4-b57c-ae2af136038c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:20.642055 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b4e11-bb96-4dc4-b57c-ae2af136038c None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:20.645170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:19:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:19:20.654111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f0838-60ab-4b87-8974-ad28242ed2f9 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:20.654762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f0838-60ab-4b87-8974-ad28242ed2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:20.654762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f0838-60ab-4b87-8974-ad28242ed2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:20.661892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=62 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:20.677469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-491f0838-60ab-4b87-8974-ad28242ed2f9 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:20.679833 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-491f0838-60ab-4b87-8974-ad28242ed2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:20.689560 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:21.003446 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b4e11-bb96-4dc4-b57c-ae2af136038c None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:21.005362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1f5b4e11-bb96-4dc4-b57c-ae2af136038c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:21.071490 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b4e11-bb96-4dc4-b57c-ae2af136038c None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:21.075102 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227df42-2bd2-408d-992b-9d1f5b39d2ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:21.075762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227df42-2bd2-408d-992b-9d1f5b39d2ca service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:21.076045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227df42-2bd2-408d-992b-9d1f5b39d2ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:21.076355 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227df42-2bd2-408d-992b-9d1f5b39d2ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:21.086640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227df42-2bd2-408d-992b-9d1f5b39d2ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:21.088109 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227df42-2bd2-408d-992b-9d1f5b39d2ca service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:21.097871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 771/1536] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:23.391687 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e5c9f-69b4-438d-be58-715a4eb33f59 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:23.392287 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e5c9f-69b4-438d-be58-715a4eb33f59 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:23.392287 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e5c9f-69b4-438d-be58-715a4eb33f59 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:23.393675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:19:23.401061 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757651b9-6646-4f05-b88b-1f9c767749c8 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:23.401642 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757651b9-6646-4f05-b88b-1f9c767749c8 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:23.402014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757651b9-6646-4f05-b88b-1f9c767749c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:23.421538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-757651b9-6646-4f05-b88b-1f9c767749c8 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:23.422757 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-757651b9-6646-4f05-b88b-1f9c767749c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:23.430842 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:23.706740 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e5c9f-69b4-438d-be58-715a4eb33f59 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:23.708426 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-721e5c9f-69b4-438d-be58-715a4eb33f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:23.721401 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e5c9f-69b4-438d-be58-715a4eb33f59 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:23.724950 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2465f-75f4-41ec-aad9-1344f9b76020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:23.725607 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2465f-75f4-41ec-aad9-1344f9b76020 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:23.725888 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2465f-75f4-41ec-aad9-1344f9b76020 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:23.726161 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2465f-75f4-41ec-aad9-1344f9b76020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:23.736104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2465f-75f4-41ec-aad9-1344f9b76020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:23.737579 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2465f-75f4-41ec-aad9-1344f9b76020 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:23.748060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 767/1539] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:33.416011 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=32 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:33.743066 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=8 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:53.762424 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e3ea9-45ec-4195-9fc4-7c9473463de3 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:53.763092 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e3ea9-45ec-4195-9fc4-7c9473463de3 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:53.763092 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e3ea9-45ec-4195-9fc4-7c9473463de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:53.790521 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-ea5e3ea9-45ec-4195-9fc4-7c9473463de3 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:53.792128 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ea5e3ea9-45ec-4195-9fc4-7c9473463de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:53.806392 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 773/1540] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:53.818200 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f94bb-d0cf-43cc-8c58-13a04bc3a0a8 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:53.818827 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f94bb-d0cf-43cc-8c58-13a04bc3a0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:53.818827 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f94bb-d0cf-43cc-8c58-13a04bc3a0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:53.843624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-052f94bb-d0cf-43cc-8c58-13a04bc3a0a8 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:53.844917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-052f94bb-d0cf-43cc-8c58-13a04bc3a0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:53.857642 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 768/1541] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:53.862512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e3ea9-45ec-4195-9fc4-7c9473463de3 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:53.876417 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e3ea9-45ec-4195-9fc4-7c9473463de3 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:53.882201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ac976-3bc5-4ff3-8d48-75ba30e5522d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:53.882890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ac976-3bc5-4ff3-8d48-75ba30e5522d admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:53.883176 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ac976-3bc5-4ff3-8d48-75ba30e5522d admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:53.883453 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ac976-3bc5-4ff3-8d48-75ba30e5522d admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:53.884195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ac976-3bc5-4ff3-8d48-75ba30e5522d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:20:53.884510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ac976-3bc5-4ff3-8d48-75ba30e5522d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:53.886167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ac976-3bc5-4ff3-8d48-75ba30e5522d admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:53.903253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 774/1542] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:20:53.908853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a225e7-3475-4b40-809a-c94f01106d14 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:53.909150 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a225e7-3475-4b40-809a-c94f01106d14 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:53.909437 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a225e7-3475-4b40-809a-c94f01106d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:53.917407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ac976-3bc5-4ff3-8d48-75ba30e5522d admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:53.934216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ac976-3bc5-4ff3-8d48-75ba30e5522d admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:53.936425 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-11a225e7-3475-4b40-809a-c94f01106d14 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:53.941909 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-11a225e7-3475-4b40-809a-c94f01106d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:53.945600 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e51a6c-6369-4dda-ada1-3da5862bf38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:53.946346 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e51a6c-6369-4dda-ada1-3da5862bf38c admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:53.946641 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e51a6c-6369-4dda-ada1-3da5862bf38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:53.946921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e51a6c-6369-4dda-ada1-3da5862bf38c admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:53.947756 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e51a6c-6369-4dda-ada1-3da5862bf38c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:53.949023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: WARNING py.warnings [None req-b2e51a6c-6369-4dda-ada1-3da5862bf38c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:20:53.949023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: warnings.warn(msg) May 26 21:20:53.949023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: May 26 21:20:53.950226 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e51a6c-6369-4dda-ada1-3da5862bf38c admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:53.957762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 769/1543] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:53.968044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72705d18-e1b5-467f-a373-3ffbdef82072 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:53.968365 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72705d18-e1b5-467f-a373-3ffbdef82072 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:53.968624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72705d18-e1b5-467f-a373-3ffbdef82072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:53.996708 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-72705d18-e1b5-467f-a373-3ffbdef82072 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:53.997928 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-72705d18-e1b5-467f-a373-3ffbdef82072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:54.014988 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 770/1544] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:20:54.019881 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72705d18-e1b5-467f-a373-3ffbdef82072 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:54.031131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72705d18-e1b5-467f-a373-3ffbdef82072 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:54.045116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7566f1-f211-44ba-9686-981b5f9d2a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:54.046296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7566f1-f211-44ba-9686-981b5f9d2a44 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.048793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7566f1-f211-44ba-9686-981b5f9d2a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.048793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7566f1-f211-44ba-9686-981b5f9d2a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.048793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7566f1-f211-44ba-9686-981b5f9d2a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:20:54.048793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7566f1-f211-44ba-9686-981b5f9d2a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:54.050007 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: WARNING py.warnings [None req-8b7566f1-f211-44ba-9686-981b5f9d2a44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:20:54.050007 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: warnings.warn(msg) May 26 21:20:54.050007 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: May 26 21:20:54.051953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 775/1545] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:20:53 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:54.052557 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7566f1-f211-44ba-9686-981b5f9d2a44 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:54.060666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e51a6c-6369-4dda-ada1-3da5862bf38c admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:54.077012 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 771/1546] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:20:54.085611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7566f1-f211-44ba-9686-981b5f9d2a44 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:54.105469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7566f1-f211-44ba-9686-981b5f9d2a44 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:54.218804 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e51a6c-6369-4dda-ada1-3da5862bf38c admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:54.232827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2515d-c116-4119-b8e9-ef4a96864947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:54.233551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2515d-c116-4119-b8e9-ef4a96864947 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.233841 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2515d-c116-4119-b8e9-ef4a96864947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.234124 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2515d-c116-4119-b8e9-ef4a96864947 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.234877 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2515d-c116-4119-b8e9-ef4a96864947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:54.236846 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2515d-c116-4119-b8e9-ef4a96864947 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:54.237386 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce4ab1-141d-4100-bc66-725e7699d770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:54.238422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce4ab1-141d-4100-bc66-725e7699d770 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.238944 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce4ab1-141d-4100-bc66-725e7699d770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.239453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce4ab1-141d-4100-bc66-725e7699d770 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.240615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce4ab1-141d-4100-bc66-725e7699d770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:54.243595 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce4ab1-141d-4100-bc66-725e7699d770 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:54.332998 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 776/1547] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:20:54 2022] POST /identity/v3/users => generated 290 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:54.338281 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2515d-c116-4119-b8e9-ef4a96864947 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:54.352105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2515d-c116-4119-b8e9-ef4a96864947 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:54.362766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 772/1548] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:20:54 2022] POST /identity/v3/projects => generated 365 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:20:54.364924 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945f81d-86a8-437b-a9b9-d6b0095e426c None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.365689 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945f81d-86a8-437b-a9b9-d6b0095e426c None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.367841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945f81d-86a8-437b-a9b9-d6b0095e426c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.368008 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b312b94-104b-4000-86ab-8aba40e4224b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:54.368692 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b312b94-104b-4000-86ab-8aba40e4224b admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.368984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b312b94-104b-4000-86ab-8aba40e4224b admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.369275 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b312b94-104b-4000-86ab-8aba40e4224b admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.370017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b312b94-104b-4000-86ab-8aba40e4224b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:54.373720 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b312b94-104b-4000-86ab-8aba40e4224b admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:54.401310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 777/1549] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:54.402232 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b312b94-104b-4000-86ab-8aba40e4224b admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:54.409457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-d945f81d-86a8-437b-a9b9-d6b0095e426c None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:54.411424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d945f81d-86a8-437b-a9b9-d6b0095e426c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:54.420221 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b312b94-104b-4000-86ab-8aba40e4224b admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:54.522632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6679e-43f0-441e-8ff7-1a46890dede8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:54.523820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6679e-43f0-441e-8ff7-1a46890dede8 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.524336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6679e-43f0-441e-8ff7-1a46890dede8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.525110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6679e-43f0-441e-8ff7-1a46890dede8 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.526369 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6679e-43f0-441e-8ff7-1a46890dede8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:54.529452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6679e-43f0-441e-8ff7-1a46890dede8 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:54.543568 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 773/1550] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:54.543568 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8db63-eb62-42f3-9070-d2e26e630431 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.543568 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8db63-eb62-42f3-9070-d2e26e630431 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.543568 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8db63-eb62-42f3-9070-d2e26e630431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.576272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-c6a8db63-eb62-42f3-9070-d2e26e630431 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:54.576272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-c6a8db63-eb62-42f3-9070-d2e26e630431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:54.588278 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 774/1551] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:54.589639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8db63-eb62-42f3-9070-d2e26e630431 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:54.599244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8db63-eb62-42f3-9070-d2e26e630431 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:54.604889 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cccf2-59dd-48b4-b35d-5aa3067dabea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:54.605724 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cccf2-59dd-48b4-b35d-5aa3067dabea admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.606110 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cccf2-59dd-48b4-b35d-5aa3067dabea admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.606488 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cccf2-59dd-48b4-b35d-5aa3067dabea admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.607370 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cccf2-59dd-48b4-b35d-5aa3067dabea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:54.609311 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cccf2-59dd-48b4-b35d-5aa3067dabea admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:54.620193 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 775/1552] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:54.621770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f104024-141d-4725-a09f-c25fa4705338 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.622163 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f104024-141d-4725-a09f-c25fa4705338 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.622538 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f104024-141d-4725-a09f-c25fa4705338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.643047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-6f104024-141d-4725-a09f-c25fa4705338 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:54.644391 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-6f104024-141d-4725-a09f-c25fa4705338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:54.653514 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 778/1553] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:20:54 2022] POST /identity/v3/users => generated 283 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:54.653514 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bd35c-33e5-4466-8720-304f4690269e None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.653514 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bd35c-33e5-4466-8720-304f4690269e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.653514 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bd35c-33e5-4466-8720-304f4690269e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.657086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 776/1554] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:54.658953 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4910445-1cb0-429e-adab-9a188a0b92eb None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.659410 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4910445-1cb0-429e-adab-9a188a0b92eb None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.659983 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4910445-1cb0-429e-adab-9a188a0b92eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.681943 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-0a1bd35c-33e5-4466-8720-304f4690269e None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:54.683396 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0a1bd35c-33e5-4466-8720-304f4690269e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:54.685981 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-a4910445-1cb0-429e-adab-9a188a0b92eb None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:54.687203 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a4910445-1cb0-429e-adab-9a188a0b92eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:54.692989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 779/1555] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:54.695136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a57244-4021-4945-9305-62ef9def2229 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.695507 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 777/1556] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:54.695944 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a57244-4021-4945-9305-62ef9def2229 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.696435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a57244-4021-4945-9305-62ef9def2229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.696788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfcb08-545a-44d3-b396-249eda94e585 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.697204 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfcb08-545a-44d3-b396-249eda94e585 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.697486 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfcb08-545a-44d3-b396-249eda94e585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.720819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-b4dfcb08-545a-44d3-b396-249eda94e585 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:54.722043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b4dfcb08-545a-44d3-b396-249eda94e585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:54.722353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-e3a57244-4021-4945-9305-62ef9def2229 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:54.723580 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e3a57244-4021-4945-9305-62ef9def2229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:54.730847 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 778/1557] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:54.731621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfcb08-545a-44d3-b396-249eda94e585 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:54.736000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 780/1558] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:54.737157 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a57244-4021-4945-9305-62ef9def2229 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:54.741492 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfcb08-545a-44d3-b396-249eda94e585 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:54.746360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316e471-a5b6-44e9-bd90-36a795f00b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:54.747344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316e471-a5b6-44e9-bd90-36a795f00b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.748776 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316e471-a5b6-44e9-bd90-36a795f00b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.748776 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316e471-a5b6-44e9-bd90-36a795f00b92 admin admin] PATH_INFO: `/v3/projects/90703a330f8940989ec1fa3b82fe4976/users/ce2de523c23948c8b9b652c9263b9240/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.749045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a57244-4021-4945-9305-62ef9def2229 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:54.752938 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f94e70-cb3c-4509-b5bc-5b158f2446f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:54.753611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f94e70-cb3c-4509-b5bc-5b158f2446f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.753889 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f94e70-cb3c-4509-b5bc-5b158f2446f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.754166 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f94e70-cb3c-4509-b5bc-5b158f2446f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.754896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f94e70-cb3c-4509-b5bc-5b158f2446f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:54.757153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f94e70-cb3c-4509-b5bc-5b158f2446f8 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:54.761290 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:54.764368 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316e471-a5b6-44e9-bd90-36a795f00b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90703a330f8940989ec1fa3b82fe4976, user_id=ce2de523c23948c8b9b652c9263b9240, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:54.767087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316e471-a5b6-44e9-bd90-36a795f00b92 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:54.767221 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 781/1559] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:54.768640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1517d9e-67c2-4e1f-a588-05e91fc58174 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.772989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1517d9e-67c2-4e1f-a588-05e91fc58174 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.772989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1517d9e-67c2-4e1f-a588-05e91fc58174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.777059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:54.789349 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-c1517d9e-67c2-4e1f-a588-05e91fc58174 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:54.790538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-c1517d9e-67c2-4e1f-a588-05e91fc58174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:54.798298 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 782/1560] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:54.799677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7615dce-1c28-4fc2-8450-79acf908a670 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.799958 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7615dce-1c28-4fc2-8450-79acf908a670 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.800234 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7615dce-1c28-4fc2-8450-79acf908a670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.818300 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-a7615dce-1c28-4fc2-8450-79acf908a670 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:54.820089 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-a7615dce-1c28-4fc2-8450-79acf908a670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:54.827951 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 783/1561] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:54.828697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7615dce-1c28-4fc2-8450-79acf908a670 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:54.838689 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7615dce-1c28-4fc2-8450-79acf908a670 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:54.843310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfa9fd-65dc-4edc-9d3b-4bdb0c96154f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:54.843969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfa9fd-65dc-4edc-9d3b-4bdb0c96154f admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.844245 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfa9fd-65dc-4edc-9d3b-4bdb0c96154f admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.844513 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfa9fd-65dc-4edc-9d3b-4bdb0c96154f admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.845276 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfa9fd-65dc-4edc-9d3b-4bdb0c96154f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:20:54.845579 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfa9fd-65dc-4edc-9d3b-4bdb0c96154f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:54.847188 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfa9fd-65dc-4edc-9d3b-4bdb0c96154f admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:54.849189 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 779/1562] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:20:54 2022] PUT /identity/v3/projects/90703a330f8940989ec1fa3b82fe4976/users/ce2de523c23948c8b9b652c9263b9240/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:54.850689 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec03d4-9a97-4d7f-a6e5-dae253dbf15b None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.850982 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec03d4-9a97-4d7f-a6e5-dae253dbf15b None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.851263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec03d4-9a97-4d7f-a6e5-dae253dbf15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.860616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 784/1563] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:20:54.861545 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfa9fd-65dc-4edc-9d3b-4bdb0c96154f admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:54.870474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-e9ec03d4-9a97-4d7f-a6e5-dae253dbf15b None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:54.871691 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-e9ec03d4-9a97-4d7f-a6e5-dae253dbf15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:54.874208 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfa9fd-65dc-4edc-9d3b-4bdb0c96154f admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:54.934346 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 780/1564] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:54.935721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae99035-3a21-4b50-b9f6-3110069114b1 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.936013 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae99035-3a21-4b50-b9f6-3110069114b1 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.936237 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a357147-5f60-4a13-9a7f-aa17b3bd1d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:54.936434 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae99035-3a21-4b50-b9f6-3110069114b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.937242 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a357147-5f60-4a13-9a7f-aa17b3bd1d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.937762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a357147-5f60-4a13-9a7f-aa17b3bd1d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.938345 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a357147-5f60-4a13-9a7f-aa17b3bd1d6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.939187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a357147-5f60-4a13-9a7f-aa17b3bd1d6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:20:54.939670 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a357147-5f60-4a13-9a7f-aa17b3bd1d6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:54.941462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a357147-5f60-4a13-9a7f-aa17b3bd1d6c admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:54.955363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-cae99035-3a21-4b50-b9f6-3110069114b1 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:54.961591 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-cae99035-3a21-4b50-b9f6-3110069114b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:54.961744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 785/1565] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:20:54.961744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a357147-5f60-4a13-9a7f-aa17b3bd1d6c admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:54.964795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 781/1566] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:54.965624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae99035-3a21-4b50-b9f6-3110069114b1 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:54.971169 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a357147-5f60-4a13-9a7f-aa17b3bd1d6c admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:54.976205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae99035-3a21-4b50-b9f6-3110069114b1 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:54.976745 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b26bd7-03b6-4cf4-9ffa-93191879e412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:54.977428 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b26bd7-03b6-4cf4-9ffa-93191879e412 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.977719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b26bd7-03b6-4cf4-9ffa-93191879e412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.977999 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b26bd7-03b6-4cf4-9ffa-93191879e412 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.978731 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b26bd7-03b6-4cf4-9ffa-93191879e412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:54.980378 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b26bd7-03b6-4cf4-9ffa-93191879e412 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:54.981275 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f44ed-9edb-4a20-8e5a-fb471d09dbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:54.981969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f44ed-9edb-4a20-8e5a-fb471d09dbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.982378 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f44ed-9edb-4a20-8e5a-fb471d09dbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.982662 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f44ed-9edb-4a20-8e5a-fb471d09dbd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.983405 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f44ed-9edb-4a20-8e5a-fb471d09dbd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:20:54.983739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f44ed-9edb-4a20-8e5a-fb471d09dbd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:54.985450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f44ed-9edb-4a20-8e5a-fb471d09dbd7 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:54.992399 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 786/1567] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:54.993839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425017e7-1ce9-4184-80ac-597f79e5f907 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:54.993971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425017e7-1ce9-4184-80ac-597f79e5f907 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:54.994146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425017e7-1ce9-4184-80ac-597f79e5f907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:54.998867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 782/1568] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:20:55.004086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b58c67-1079-4bd0-8246-8e3f0d318eb7 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:55.004086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b58c67-1079-4bd0-8246-8e3f0d318eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:55.004086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b58c67-1079-4bd0-8246-8e3f0d318eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:55.013726 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-425017e7-1ce9-4184-80ac-597f79e5f907 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:55.014951 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-425017e7-1ce9-4184-80ac-597f79e5f907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:55.018768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-a3b58c67-1079-4bd0-8246-8e3f0d318eb7 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:55.020173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a3b58c67-1079-4bd0-8246-8e3f0d318eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:55.024295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 787/1569] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:55.025238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425017e7-1ce9-4184-80ac-597f79e5f907 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:55.029790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 783/1570] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:55.031059 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b58c67-1079-4bd0-8246-8e3f0d318eb7 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:55.037709 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425017e7-1ce9-4184-80ac-597f79e5f907 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:55.042332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b58c67-1079-4bd0-8246-8e3f0d318eb7 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:55.043080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84e0d4-7e4c-4313-8f90-375cc9ea0209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:55.047600 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84e0d4-7e4c-4313-8f90-375cc9ea0209 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:55.047600 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84e0d4-7e4c-4313-8f90-375cc9ea0209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:55.047600 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84e0d4-7e4c-4313-8f90-375cc9ea0209 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:55.047600 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84e0d4-7e4c-4313-8f90-375cc9ea0209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:55.047600 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84e0d4-7e4c-4313-8f90-375cc9ea0209 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:55.048076 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da957e36-bb2d-4053-9b45-5794ab348d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:55.048076 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da957e36-bb2d-4053-9b45-5794ab348d0a admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:55.048076 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da957e36-bb2d-4053-9b45-5794ab348d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:55.048340 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da957e36-bb2d-4053-9b45-5794ab348d0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:55.048981 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da957e36-bb2d-4053-9b45-5794ab348d0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:20:55.049294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da957e36-bb2d-4053-9b45-5794ab348d0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:55.050908 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da957e36-bb2d-4053-9b45-5794ab348d0a admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:55.064151 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 784/1571] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:20:55.065022 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da957e36-bb2d-4053-9b45-5794ab348d0a admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:55.074854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da957e36-bb2d-4053-9b45-5794ab348d0a admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:55.079714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf25b02-5a5e-4787-a25b-4f14cbb47fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:55.080305 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf25b02-5a5e-4787-a25b-4f14cbb47fed admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:55.080901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf25b02-5a5e-4787-a25b-4f14cbb47fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:55.082949 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf25b02-5a5e-4787-a25b-4f14cbb47fed admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:55.083661 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf25b02-5a5e-4787-a25b-4f14cbb47fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:55.085694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf25b02-5a5e-4787-a25b-4f14cbb47fed admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:55.159388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 788/1572] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:20:55 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:55.160276 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84e0d4-7e4c-4313-8f90-375cc9ea0209 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:55.176114 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 785/1573] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:20:55 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:55.177456 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf25b02-5a5e-4787-a25b-4f14cbb47fed admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:55.229180 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84e0d4-7e4c-4313-8f90-375cc9ea0209 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:55.241576 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf25b02-5a5e-4787-a25b-4f14cbb47fed admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:55.246118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841f22a-5635-4b28-924a-93400a4240dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:55.247009 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841f22a-5635-4b28-924a-93400a4240dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:55.247286 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841f22a-5635-4b28-924a-93400a4240dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:55.247570 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841f22a-5635-4b28-924a-93400a4240dd admin admin] PATH_INFO: `/v3/projects/667ed286168b4d9fa15e6ac3dd774085/users/61ca0566d1ba43868e4500c92403f89a/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:55.263039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841f22a-5635-4b28-924a-93400a4240dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=667ed286168b4d9fa15e6ac3dd774085, user_id=61ca0566d1ba43868e4500c92403f89a, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:55.264371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:55.265805 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841f22a-5635-4b28-924a-93400a4240dd admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:55.287082 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf486b0d-c844-463d-84a4-d0d01b673b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:55.287820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf486b0d-c844-463d-84a4-d0d01b673b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:55.288446 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf486b0d-c844-463d-84a4-d0d01b673b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:55.289037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf486b0d-c844-463d-84a4-d0d01b673b43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:55.290156 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf486b0d-c844-463d-84a4-d0d01b673b43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:20:55.290516 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf486b0d-c844-463d-84a4-d0d01b673b43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:55.292280 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf486b0d-c844-463d-84a4-d0d01b673b43 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:55.304140 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 789/1574] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:20:55.305116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf486b0d-c844-463d-84a4-d0d01b673b43 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:55.314683 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf486b0d-c844-463d-84a4-d0d01b673b43 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:55.319973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0ee2b-a895-4b1a-bced-1b1b95997086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:55.320725 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0ee2b-a895-4b1a-bced-1b1b95997086 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:55.321021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0ee2b-a895-4b1a-bced-1b1b95997086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:55.321303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0ee2b-a895-4b1a-bced-1b1b95997086 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:55.322012 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0ee2b-a895-4b1a-bced-1b1b95997086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:55.323929 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0ee2b-a895-4b1a-bced-1b1b95997086 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:55.328408 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 786/1575] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:20:55 2022] PUT /identity/v3/projects/667ed286168b4d9fa15e6ac3dd774085/users/61ca0566d1ba43868e4500c92403f89a/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:55.342653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841f22a-5635-4b28-924a-93400a4240dd admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:55.344144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:55.391899 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841f22a-5635-4b28-924a-93400a4240dd admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:55.396853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c61e13-5324-4538-a4c1-14adcd227020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:55.397581 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c61e13-5324-4538-a4c1-14adcd227020 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:55.397859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c61e13-5324-4538-a4c1-14adcd227020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:55.398130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c61e13-5324-4538-a4c1-14adcd227020 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:55.398858 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c61e13-5324-4538-a4c1-14adcd227020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:20:55.399163 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c61e13-5324-4538-a4c1-14adcd227020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:55.400789 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c61e13-5324-4538-a4c1-14adcd227020 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:55.412489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 790/1576] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:20:55 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:55.413779 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0ee2b-a895-4b1a-bced-1b1b95997086 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:55.421638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 787/1577] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:20:55.421638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c61e13-5324-4538-a4c1-14adcd227020 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:55.425102 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3dc0ee2b-a895-4b1a-bced-1b1b95997086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:55.428534 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c61e13-5324-4538-a4c1-14adcd227020 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:55.490939 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0ee2b-a895-4b1a-bced-1b1b95997086 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:55.494285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cd2af-876a-4c2b-bab2-e11d9b37e9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:55.494967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cd2af-876a-4c2b-bab2-e11d9b37e9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:55.495244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cd2af-876a-4c2b-bab2-e11d9b37e9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:55.495533 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cd2af-876a-4c2b-bab2-e11d9b37e9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:55.495782 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f33e2e-b4c6-4d77-9257-5d735c7b27f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:55.496217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cd2af-876a-4c2b-bab2-e11d9b37e9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:55.497710 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f33e2e-b4c6-4d77-9257-5d735c7b27f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:55.498208 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f33e2e-b4c6-4d77-9257-5d735c7b27f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:55.498357 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cd2af-876a-4c2b-bab2-e11d9b37e9e8 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:55.498664 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f33e2e-b4c6-4d77-9257-5d735c7b27f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:55.510725 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f33e2e-b4c6-4d77-9257-5d735c7b27f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:55.512602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f33e2e-b4c6-4d77-9257-5d735c7b27f6 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:55.524924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 791/1578] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:20:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:20:55.525814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f33e2e-b4c6-4d77-9257-5d735c7b27f6 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:55.536999 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f33e2e-b4c6-4d77-9257-5d735c7b27f6 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:55.542794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36caeebb-1a72-4853-9462-35ebf2360c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:55.543481 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caeebb-1a72-4853-9462-35ebf2360c71 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:55.543768 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caeebb-1a72-4853-9462-35ebf2360c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:55.544047 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caeebb-1a72-4853-9462-35ebf2360c71 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:55.544783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36caeebb-1a72-4853-9462-35ebf2360c71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:55.546764 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36caeebb-1a72-4853-9462-35ebf2360c71 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:55.634020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 788/1579] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:20:55 2022] POST /identity/v3/projects => generated 373 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:55.634788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cd2af-876a-4c2b-bab2-e11d9b37e9e8 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:55.665775 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 792/1580] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:20:55 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:55.669366 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36caeebb-1a72-4853-9462-35ebf2360c71 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:55.686538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36caeebb-1a72-4853-9462-35ebf2360c71 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:55.726886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cd2af-876a-4c2b-bab2-e11d9b37e9e8 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:55.734439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4fb6e-1e9d-4e1d-a0f1-9121918eb688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:55.734755 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4fb6e-1e9d-4e1d-a0f1-9121918eb688 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:55.735218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4fb6e-1e9d-4e1d-a0f1-9121918eb688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:55.735634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4fb6e-1e9d-4e1d-a0f1-9121918eb688 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:55.737061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4fb6e-1e9d-4e1d-a0f1-9121918eb688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:55.738345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: WARNING py.warnings [None req-91e4fb6e-1e9d-4e1d-a0f1-9121918eb688 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:20:55.738345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: warnings.warn(msg) May 26 21:20:55.738345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: May 26 21:20:55.740332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4fb6e-1e9d-4e1d-a0f1-9121918eb688 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:55.763378 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785aaa3-7844-4e04-a2c0-d8750915b5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:55.764195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785aaa3-7844-4e04-a2c0-d8750915b5bb admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:55.764575 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785aaa3-7844-4e04-a2c0-d8750915b5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:55.764976 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785aaa3-7844-4e04-a2c0-d8750915b5bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:55.765762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785aaa3-7844-4e04-a2c0-d8750915b5bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:55.767743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785aaa3-7844-4e04-a2c0-d8750915b5bb admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:55.847861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 789/1581] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:20:55 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:55.849208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3436caa-b08b-4950-969e-a2fa3ac8dcac None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:55.849824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3436caa-b08b-4950-969e-a2fa3ac8dcac None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:55.849824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3436caa-b08b-4950-969e-a2fa3ac8dcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:55.876631 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-c3436caa-b08b-4950-969e-a2fa3ac8dcac None None] MFA Rules not processed for user `61ca0566d1ba43868e4500c92403f89a`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:55.877952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-c3436caa-b08b-4950-969e-a2fa3ac8dcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:55.881952 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 793/1582] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:20:55 2022] POST /identity/v3/projects => generated 393 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:55.881952 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785aaa3-7844-4e04-a2c0-d8750915b5bb admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:55.892323 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:55.910988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:55.972353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785aaa3-7844-4e04-a2c0-d8750915b5bb admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:55.973535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 790/1583] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:55.974257 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3436caa-b08b-4950-969e-a2fa3ac8dcac None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:55.983561 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad90ce0-b5d0-4c22-99f9-c250736f41f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:55.983561 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad90ce0-b5d0-4c22-99f9-c250736f41f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:55.983561 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad90ce0-b5d0-4c22-99f9-c250736f41f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:55.983935 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad90ce0-b5d0-4c22-99f9-c250736f41f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:55.984677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad90ce0-b5d0-4c22-99f9-c250736f41f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:55.986615 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad90ce0-b5d0-4c22-99f9-c250736f41f4 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:55.987263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3436caa-b08b-4950-969e-a2fa3ac8dcac None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:55.993168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc0f8d-0bfe-406b-8e72-5d258f5f3d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:55.994024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc0f8d-0bfe-406b-8e72-5d258f5f3d39 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:55.994296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc0f8d-0bfe-406b-8e72-5d258f5f3d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:55.994683 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc0f8d-0bfe-406b-8e72-5d258f5f3d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:55.995442 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc0f8d-0bfe-406b-8e72-5d258f5f3d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:55.997517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc0f8d-0bfe-406b-8e72-5d258f5f3d39 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.110387 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 794/1584] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:20:55 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:56.110387 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad90ce0-b5d0-4c22-99f9-c250736f41f4 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.111384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 791/1585] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:20:55 2022] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:56.111384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc0f8d-0bfe-406b-8e72-5d258f5f3d39 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.120303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad90ce0-b5d0-4c22-99f9-c250736f41f4 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.184809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc0f8d-0bfe-406b-8e72-5d258f5f3d39 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.187057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74479ebb-ef4f-4d36-9160-855d4bf09798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.187300 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74479ebb-ef4f-4d36-9160-855d4bf09798 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.187580 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74479ebb-ef4f-4d36-9160-855d4bf09798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.187855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74479ebb-ef4f-4d36-9160-855d4bf09798 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.188646 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74479ebb-ef4f-4d36-9160-855d4bf09798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.190854 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74479ebb-ef4f-4d36-9160-855d4bf09798 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.190984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a848203-2fc3-4226-8074-b7d4a0c878b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.191853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a848203-2fc3-4226-8074-b7d4a0c878b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.192134 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a848203-2fc3-4226-8074-b7d4a0c878b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.192419 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a848203-2fc3-4226-8074-b7d4a0c878b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.193226 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a848203-2fc3-4226-8074-b7d4a0c878b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.194837 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a848203-2fc3-4226-8074-b7d4a0c878b0 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.206714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 792/1586] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:56.207809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a848203-2fc3-4226-8074-b7d4a0c878b0 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.219657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a848203-2fc3-4226-8074-b7d4a0c878b0 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.225809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2845e9-2f18-4b67-b70e-39df3c320d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.230815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2845e9-2f18-4b67-b70e-39df3c320d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.230815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2845e9-2f18-4b67-b70e-39df3c320d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.230815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2845e9-2f18-4b67-b70e-39df3c320d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.230815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2845e9-2f18-4b67-b70e-39df3c320d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.230815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2845e9-2f18-4b67-b70e-39df3c320d01 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.240870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 793/1587] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:56.241646 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2845e9-2f18-4b67-b70e-39df3c320d01 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.253641 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2845e9-2f18-4b67-b70e-39df3c320d01 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.259190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a05035-7e3a-41b6-80c6-2dbdf8b83356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.260756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a05035-7e3a-41b6-80c6-2dbdf8b83356 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.261056 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a05035-7e3a-41b6-80c6-2dbdf8b83356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.261509 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a05035-7e3a-41b6-80c6-2dbdf8b83356 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.262455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a05035-7e3a-41b6-80c6-2dbdf8b83356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.264495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a05035-7e3a-41b6-80c6-2dbdf8b83356 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.272655 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 795/1588] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:20:56 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:56.273740 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74479ebb-ef4f-4d36-9160-855d4bf09798 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.283846 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74479ebb-ef4f-4d36-9160-855d4bf09798 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.288843 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67645803-998e-4d88-af01-3cfa4919eda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.289509 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67645803-998e-4d88-af01-3cfa4919eda5 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.289791 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67645803-998e-4d88-af01-3cfa4919eda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.290073 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67645803-998e-4d88-af01-3cfa4919eda5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.290783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67645803-998e-4d88-af01-3cfa4919eda5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.292700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67645803-998e-4d88-af01-3cfa4919eda5 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.341501 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 794/1589] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:20:56 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:56.345783 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a05035-7e3a-41b6-80c6-2dbdf8b83356 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.352836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a05035-7e3a-41b6-80c6-2dbdf8b83356 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.357708 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1cf81-c6b5-49d1-81f1-4d4eeaae3e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.358384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1cf81-c6b5-49d1-81f1-4d4eeaae3e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.358662 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1cf81-c6b5-49d1-81f1-4d4eeaae3e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.358933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1cf81-c6b5-49d1-81f1-4d4eeaae3e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.359653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1cf81-c6b5-49d1-81f1-4d4eeaae3e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.361302 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1cf81-c6b5-49d1-81f1-4d4eeaae3e2f admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.371698 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 795/1590] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:56.372702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1cf81-c6b5-49d1-81f1-4d4eeaae3e2f admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.384947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1cf81-c6b5-49d1-81f1-4d4eeaae3e2f admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.391041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 796/1591] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:20:56 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:56.395050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38296b0-4cd7-4790-b0eb-09557d659efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.395181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67645803-998e-4d88-af01-3cfa4919eda5 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.395287 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38296b0-4cd7-4790-b0eb-09557d659efb admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.395287 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38296b0-4cd7-4790-b0eb-09557d659efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.395287 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38296b0-4cd7-4790-b0eb-09557d659efb admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.395287 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38296b0-4cd7-4790-b0eb-09557d659efb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.396494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38296b0-4cd7-4790-b0eb-09557d659efb admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.462217 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67645803-998e-4d88-af01-3cfa4919eda5 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.466773 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81891e4a-ff21-43bd-ba07-eab7f12349fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.467458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81891e4a-ff21-43bd-ba07-eab7f12349fd admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.467858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81891e4a-ff21-43bd-ba07-eab7f12349fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.468141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81891e4a-ff21-43bd-ba07-eab7f12349fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.468911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81891e4a-ff21-43bd-ba07-eab7f12349fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.470522 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81891e4a-ff21-43bd-ba07-eab7f12349fd admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.481538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 797/1592] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:56.485778 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 796/1593] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:20:56 2022] POST /identity/v3/users => generated 282 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:56.485778 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38296b0-4cd7-4790-b0eb-09557d659efb admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.487087 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81891e4a-ff21-43bd-ba07-eab7f12349fd admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.495733 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81891e4a-ff21-43bd-ba07-eab7f12349fd admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.495925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38296b0-4cd7-4790-b0eb-09557d659efb admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.500281 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e86e7-7a54-4f97-968d-8d12c5d22048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.500976 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e86e7-7a54-4f97-968d-8d12c5d22048 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.501256 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e86e7-7a54-4f97-968d-8d12c5d22048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.501529 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e86e7-7a54-4f97-968d-8d12c5d22048 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.501876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063cd02-80b9-412a-a2bd-b3a82a99cc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.502249 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e86e7-7a54-4f97-968d-8d12c5d22048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.502772 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063cd02-80b9-412a-a2bd-b3a82a99cc9d admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.503160 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063cd02-80b9-412a-a2bd-b3a82a99cc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.503537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063cd02-80b9-412a-a2bd-b3a82a99cc9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.503825 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e86e7-7a54-4f97-968d-8d12c5d22048 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.504403 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063cd02-80b9-412a-a2bd-b3a82a99cc9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.506632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063cd02-80b9-412a-a2bd-b3a82a99cc9d admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.515096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 798/1594] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:56.518299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e86e7-7a54-4f97-968d-8d12c5d22048 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.518411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 797/1595] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:56.518733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063cd02-80b9-412a-a2bd-b3a82a99cc9d admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.524233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:56.529762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063cd02-80b9-412a-a2bd-b3a82a99cc9d admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.530127 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e86e7-7a54-4f97-968d-8d12c5d22048 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.534586 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3f4f6-0a9e-4492-a685-74c2cb1d6810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.535362 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3f4f6-0a9e-4492-a685-74c2cb1d6810 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.535607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52288e15-6506-4440-b063-f3bc84418652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.535744 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3f4f6-0a9e-4492-a685-74c2cb1d6810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.535903 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3f4f6-0a9e-4492-a685-74c2cb1d6810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.536277 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52288e15-6506-4440-b063-f3bc84418652 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.536565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52288e15-6506-4440-b063-f3bc84418652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.536703 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3f4f6-0a9e-4492-a685-74c2cb1d6810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.536885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52288e15-6506-4440-b063-f3bc84418652 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.538175 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52288e15-6506-4440-b063-f3bc84418652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.538764 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3f4f6-0a9e-4492-a685-74c2cb1d6810 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.539857 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52288e15-6506-4440-b063-f3bc84418652 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.552636 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 798/1596] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:56.552636 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3f4f6-0a9e-4492-a685-74c2cb1d6810 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.553487 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 799/1597] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:56.553487 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52288e15-6506-4440-b063-f3bc84418652 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.564606 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3f4f6-0a9e-4492-a685-74c2cb1d6810 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.568074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52288e15-6506-4440-b063-f3bc84418652 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.569868 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093a9ce-c8eb-4f9e-b9cb-cc3608750408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.570852 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a9ce-c8eb-4f9e-b9cb-cc3608750408 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.571132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a9ce-c8eb-4f9e-b9cb-cc3608750408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.572450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a9ce-c8eb-4f9e-b9cb-cc3608750408 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.572450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093a9ce-c8eb-4f9e-b9cb-cc3608750408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.572999 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8bf4d-3173-46ac-91f3-8fcb7c7c2826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.574471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093a9ce-c8eb-4f9e-b9cb-cc3608750408 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.577581 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8bf4d-3173-46ac-91f3-8fcb7c7c2826 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.577942 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8bf4d-3173-46ac-91f3-8fcb7c7c2826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.578227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8bf4d-3173-46ac-91f3-8fcb7c7c2826 admin admin] PATH_INFO: `/v3/projects/4f08b4e75498402eb658938f61de1244/users/46e692bef3e3484ebac5d1563e489e03/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.582382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:56.596230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8bf4d-3173-46ac-91f3-8fcb7c7c2826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f08b4e75498402eb658938f61de1244, user_id=46e692bef3e3484ebac5d1563e489e03, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.597781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: WARNING py.warnings [None req-37b8bf4d-3173-46ac-91f3-8fcb7c7c2826 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:20:56.597781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: warnings.warn(msg) May 26 21:20:56.597781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: May 26 21:20:56.601407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8bf4d-3173-46ac-91f3-8fcb7c7c2826 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.651088 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 799/1598] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:20:56 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:56.655126 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093a9ce-c8eb-4f9e-b9cb-cc3608750408 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.666271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093a9ce-c8eb-4f9e-b9cb-cc3608750408 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.671507 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6b696-7bcc-4657-b326-05c0d1907794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.672197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6b696-7bcc-4657-b326-05c0d1907794 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.672475 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6b696-7bcc-4657-b326-05c0d1907794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.672795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6b696-7bcc-4657-b326-05c0d1907794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.673528 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6b696-7bcc-4657-b326-05c0d1907794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.675172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6b696-7bcc-4657-b326-05c0d1907794 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.680071 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 800/1599] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:20:56 2022] PUT /identity/v3/projects/4f08b4e75498402eb658938f61de1244/users/46e692bef3e3484ebac5d1563e489e03/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:56.681026 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8bf4d-3173-46ac-91f3-8fcb7c7c2826 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.690266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 800/1600] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:56.690266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6b696-7bcc-4657-b326-05c0d1907794 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.698224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6b696-7bcc-4657-b326-05c0d1907794 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.750028 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8bf4d-3173-46ac-91f3-8fcb7c7c2826 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.755193 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fba8f-2246-4dec-8a82-37d6a1b4b88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.756138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fba8f-2246-4dec-8a82-37d6a1b4b88c admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.756457 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fba8f-2246-4dec-8a82-37d6a1b4b88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.756711 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fba8f-2246-4dec-8a82-37d6a1b4b88c admin admin] PATH_INFO: `/v3/projects/7bf89680201948a69270b2c1d8d59a74/users/b5c38bac14d846a698af265cf50fd6a2/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.757127 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9306a8b-bdca-4e40-8a63-fa2382c0963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.757806 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9306a8b-bdca-4e40-8a63-fa2382c0963a admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.758092 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9306a8b-bdca-4e40-8a63-fa2382c0963a admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.758395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9306a8b-bdca-4e40-8a63-fa2382c0963a admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.759131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9306a8b-bdca-4e40-8a63-fa2382c0963a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.760897 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9306a8b-bdca-4e40-8a63-fa2382c0963a admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.772731 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fba8f-2246-4dec-8a82-37d6a1b4b88c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf89680201948a69270b2c1d8d59a74, user_id=b5c38bac14d846a698af265cf50fd6a2, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.776639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 801/1601] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:56.776639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9306a8b-bdca-4e40-8a63-fa2382c0963a admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.778361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fba8f-2246-4dec-8a82-37d6a1b4b88c admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.795823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9306a8b-bdca-4e40-8a63-fa2382c0963a admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.800730 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfec07-f5a9-4412-a041-aa7d21161ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.801683 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfec07-f5a9-4412-a041-aa7d21161ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.801963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfec07-f5a9-4412-a041-aa7d21161ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.802239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfec07-f5a9-4412-a041-aa7d21161ed9 admin admin] PATH_INFO: `/v3/projects/28874954ef9f45c78ad761ed4a1719cb/users/7d524a8208354c2099eb3b41b0f53de2/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.817396 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfec07-f5a9-4412-a041-aa7d21161ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28874954ef9f45c78ad761ed4a1719cb, user_id=7d524a8208354c2099eb3b41b0f53de2, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.820238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfec07-f5a9-4412-a041-aa7d21161ed9 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:56.860894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 801/1602] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:20:56 2022] PUT /identity/v3/projects/7bf89680201948a69270b2c1d8d59a74/users/b5c38bac14d846a698af265cf50fd6a2/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:56.861757 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fba8f-2246-4dec-8a82-37d6a1b4b88c admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.892941 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 802/1603] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:20:56 2022] PUT /identity/v3/projects/28874954ef9f45c78ad761ed4a1719cb/users/7d524a8208354c2099eb3b41b0f53de2/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:56.894364 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfec07-f5a9-4412-a041-aa7d21161ed9 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:56.937789 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fba8f-2246-4dec-8a82-37d6a1b4b88c admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.983636 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfec07-f5a9-4412-a041-aa7d21161ed9 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:56.988601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28190dcf-10eb-43f5-83d5-9e1e83041f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:56.989281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28190dcf-10eb-43f5-83d5-9e1e83041f5f admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:56.989836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28190dcf-10eb-43f5-83d5-9e1e83041f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:56.990257 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28190dcf-10eb-43f5-83d5-9e1e83041f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:56.991002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28190dcf-10eb-43f5-83d5-9e1e83041f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:56.992685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28190dcf-10eb-43f5-83d5-9e1e83041f5f admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:57.000645 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:57.003202 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 803/1604] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:57.006718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599062a2-9594-42f4-ab4f-cc99db63058f None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.007068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab1a50-53d6-4eab-b009-ff3e116920d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:57.007223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599062a2-9594-42f4-ab4f-cc99db63058f None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.007515 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599062a2-9594-42f4-ab4f-cc99db63058f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.007762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab1a50-53d6-4eab-b009-ff3e116920d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.008037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab1a50-53d6-4eab-b009-ff3e116920d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.008314 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab1a50-53d6-4eab-b009-ff3e116920d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.009091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab1a50-53d6-4eab-b009-ff3e116920d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:57.010701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab1a50-53d6-4eab-b009-ff3e116920d8 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:57.020751 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 802/1605] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:57.025158 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab1a50-53d6-4eab-b009-ff3e116920d8 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:57.026305 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-599062a2-9594-42f4-ab4f-cc99db63058f None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:57.027594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-599062a2-9594-42f4-ab4f-cc99db63058f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:57.032165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab1a50-53d6-4eab-b009-ff3e116920d8 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:57.035890 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 804/1606] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:57.036738 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599062a2-9594-42f4-ab4f-cc99db63058f None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:57.037968 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d68d0-6dab-4cc6-8fc9-5efb83f4e42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:57.038630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d68d0-6dab-4cc6-8fc9-5efb83f4e42c admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.040901 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d68d0-6dab-4cc6-8fc9-5efb83f4e42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.041283 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d68d0-6dab-4cc6-8fc9-5efb83f4e42c admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.042121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d68d0-6dab-4cc6-8fc9-5efb83f4e42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:57.044024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d68d0-6dab-4cc6-8fc9-5efb83f4e42c admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:57.047634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599062a2-9594-42f4-ab4f-cc99db63058f None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:57.052341 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe167e1-c301-4648-96e7-ac2c60da5142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:57.053321 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe167e1-c301-4648-96e7-ac2c60da5142 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.053598 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe167e1-c301-4648-96e7-ac2c60da5142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.053869 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe167e1-c301-4648-96e7-ac2c60da5142 admin admin] PATH_INFO: `/v3/projects/8e24cfce792042e2b665ef2cca91b752/users/388330e61ade4f188c40c11c4ac46fd0/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.054582 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 803/1607] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:57.055750 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0cd17-dbbc-4534-9c37-49e7be9438a1 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.056039 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0cd17-dbbc-4534-9c37-49e7be9438a1 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.056315 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0cd17-dbbc-4534-9c37-49e7be9438a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.072562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe167e1-c301-4648-96e7-ac2c60da5142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e24cfce792042e2b665ef2cca91b752, user_id=388330e61ade4f188c40c11c4ac46fd0, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:57.078535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe167e1-c301-4648-96e7-ac2c60da5142 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:57.083881 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-f1c0cd17-dbbc-4534-9c37-49e7be9438a1 None None] MFA Rules not processed for user `b5c38bac14d846a698af265cf50fd6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:57.085761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f1c0cd17-dbbc-4534-9c37-49e7be9438a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:57.150837 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 804/1608] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:57.152159 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f1a4e-87fc-42f6-acc9-893110a9dc71 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.152446 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f1a4e-87fc-42f6-acc9-893110a9dc71 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.152762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f1a4e-87fc-42f6-acc9-893110a9dc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.168152 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 805/1609] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:20:57 2022] PUT /identity/v3/projects/8e24cfce792042e2b665ef2cca91b752/users/388330e61ade4f188c40c11c4ac46fd0/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:57.169219 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607164e8-4d6f-412a-b4f6-42a187900e96 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.169512 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607164e8-4d6f-412a-b4f6-42a187900e96 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.169793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607164e8-4d6f-412a-b4f6-42a187900e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.188912 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-ef0f1a4e-87fc-42f6-acc9-893110a9dc71 None None] MFA Rules not processed for user `ce2de523c23948c8b9b652c9263b9240`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:57.189380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-607164e8-4d6f-412a-b4f6-42a187900e96 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:57.190578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-607164e8-4d6f-412a-b4f6-42a187900e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:57.190706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ef0f1a4e-87fc-42f6-acc9-893110a9dc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:57.203043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:57.255024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 806/1610] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:57.256392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607164e8-4d6f-412a-b4f6-42a187900e96 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:57.275360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 805/1611] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:57.275360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f1a4e-87fc-42f6-acc9-893110a9dc71 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:57.275705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607164e8-4d6f-412a-b4f6-42a187900e96 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:57.275705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201e658-c280-4fd6-bf4b-e0acbc10e57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:57.275705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201e658-c280-4fd6-bf4b-e0acbc10e57f admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.275705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201e658-c280-4fd6-bf4b-e0acbc10e57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.276056 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201e658-c280-4fd6-bf4b-e0acbc10e57f admin admin] PATH_INFO: `/v3/projects/6a0ea57d56ba4c90bb65392f4bb3d7be/users/6970ed55fe3b418aab7c15235ba6a634/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.283190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f1a4e-87fc-42f6-acc9-893110a9dc71 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:57.288014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36b927-a978-47eb-8ae4-4fc138e9e7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:57.288950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36b927-a978-47eb-8ae4-4fc138e9e7e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.289237 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36b927-a978-47eb-8ae4-4fc138e9e7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.289408 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201e658-c280-4fd6-bf4b-e0acbc10e57f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0ea57d56ba4c90bb65392f4bb3d7be, user_id=6970ed55fe3b418aab7c15235ba6a634, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:57.289688 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36b927-a978-47eb-8ae4-4fc138e9e7e6 admin admin] PATH_INFO: `/v3/projects/9be77e3090ea4348b5686ebf62749f38/users/23ed95370bfd46e3a1c6946701e66065/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.292250 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201e658-c280-4fd6-bf4b-e0acbc10e57f admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:57.305002 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36b927-a978-47eb-8ae4-4fc138e9e7e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be77e3090ea4348b5686ebf62749f38, user_id=23ed95370bfd46e3a1c6946701e66065, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:57.307775 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36b927-a978-47eb-8ae4-4fc138e9e7e6 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:57.361722 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 807/1612] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:20:57 2022] PUT /identity/v3/projects/6a0ea57d56ba4c90bb65392f4bb3d7be/users/6970ed55fe3b418aab7c15235ba6a634/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:57.362651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201e658-c280-4fd6-bf4b-e0acbc10e57f admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:57.390569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 806/1613] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:20:57 2022] PUT /identity/v3/projects/9be77e3090ea4348b5686ebf62749f38/users/23ed95370bfd46e3a1c6946701e66065/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:57.391539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36b927-a978-47eb-8ae4-4fc138e9e7e6 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:57.420172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201e658-c280-4fd6-bf4b-e0acbc10e57f admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:57.436938 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:57.458303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36b927-a978-47eb-8ae4-4fc138e9e7e6 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:57.463847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459b7ea-2c3c-4231-afbc-e58af59ccc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:57.464822 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459b7ea-2c3c-4231-afbc-e58af59ccc6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.465105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459b7ea-2c3c-4231-afbc-e58af59ccc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.465377 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459b7ea-2c3c-4231-afbc-e58af59ccc6a admin admin] PATH_INFO: `/v3/projects/b8e15d0caedd4cde9d21103c926fccc8/users/d21c9a8cc55442a8a7c6a0a77b3eac05/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.473187 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff08225-2d6b-4a5a-84b8-bb17c85d73bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:57.473859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff08225-2d6b-4a5a-84b8-bb17c85d73bf service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.474166 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff08225-2d6b-4a5a-84b8-bb17c85d73bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.475112 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff08225-2d6b-4a5a-84b8-bb17c85d73bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.481805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459b7ea-2c3c-4231-afbc-e58af59ccc6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e15d0caedd4cde9d21103c926fccc8, user_id=d21c9a8cc55442a8a7c6a0a77b3eac05, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:57.484473 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459b7ea-2c3c-4231-afbc-e58af59ccc6a admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:57.485335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff08225-2d6b-4a5a-84b8-bb17c85d73bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:57.491522 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff08225-2d6b-4a5a-84b8-bb17c85d73bf service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:57.497469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 808/1614] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:20:57.502167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3d123-6f70-4357-ba3d-70f1526b20fd None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.502455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3d123-6f70-4357-ba3d-70f1526b20fd None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.502902 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3d123-6f70-4357-ba3d-70f1526b20fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.521018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-6de3d123-6f70-4357-ba3d-70f1526b20fd None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:57.522636 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-6de3d123-6f70-4357-ba3d-70f1526b20fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:57.530623 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 809/1615] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:57.531916 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9962fd-eff2-4644-9d2b-2a2cacb093da None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.532228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9962fd-eff2-4644-9d2b-2a2cacb093da None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.532506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9962fd-eff2-4644-9d2b-2a2cacb093da None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.534116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 810/1616] 10.222.0.66 () {54 vars in 961 bytes} [Thu May 26 21:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:20:57.534789 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9962fd-eff2-4644-9d2b-2a2cacb093da None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:57.545984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9962fd-eff2-4644-9d2b-2a2cacb093da None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:57.549631 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98241f-a402-4179-b231-846e3006d3a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:57.550280 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98241f-a402-4179-b231-846e3006d3a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.550559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98241f-a402-4179-b231-846e3006d3a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.550831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98241f-a402-4179-b231-846e3006d3a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.562112 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98241f-a402-4179-b231-846e3006d3a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:57.563597 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98241f-a402-4179-b231-846e3006d3a9 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:57.574353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 811/1617] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:20:57.575873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af915fb7-1fe2-464d-a0ea-7007862fbf2f None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.576163 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af915fb7-1fe2-464d-a0ea-7007862fbf2f None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.576444 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af915fb7-1fe2-464d-a0ea-7007862fbf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.596502 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-af915fb7-1fe2-464d-a0ea-7007862fbf2f None None] MFA Rules not processed for user `ce2de523c23948c8b9b652c9263b9240`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:57.598126 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-af915fb7-1fe2-464d-a0ea-7007862fbf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:57.624497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:57.625255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 807/1618] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:20:57 2022] PUT /identity/v3/projects/b8e15d0caedd4cde9d21103c926fccc8/users/d21c9a8cc55442a8a7c6a0a77b3eac05/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:57.635873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459b7ea-2c3c-4231-afbc-e58af59ccc6a admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:57.667240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 812/1619] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:57.672344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e759f63-2ae3-496a-9414-8d6e606db543 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.672344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e759f63-2ae3-496a-9414-8d6e606db543 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.672344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e759f63-2ae3-496a-9414-8d6e606db543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.690149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-4e759f63-2ae3-496a-9414-8d6e606db543 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:57.695282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-4e759f63-2ae3-496a-9414-8d6e606db543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:57.725942 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459b7ea-2c3c-4231-afbc-e58af59ccc6a admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:57.731734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ac22d-7c99-494f-a481-6624f273f46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:57.732525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ac22d-7c99-494f-a481-6624f273f46a admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.732958 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ac22d-7c99-494f-a481-6624f273f46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.733239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ac22d-7c99-494f-a481-6624f273f46a admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.733970 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ac22d-7c99-494f-a481-6624f273f46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:57.735590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ac22d-7c99-494f-a481-6624f273f46a admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:57.746943 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 808/1620] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:57.751375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32f4cc-4c01-4b82-b45e-092532d5db27 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.751661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32f4cc-4c01-4b82-b45e-092532d5db27 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.751936 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32f4cc-4c01-4b82-b45e-092532d5db27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.764295 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 813/1621] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:57.765372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e759f63-2ae3-496a-9414-8d6e606db543 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:57.777544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-2d32f4cc-4c01-4b82-b45e-092532d5db27 None None] MFA Rules not processed for user `df008eed25464be387741ee7a1e5ce80`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:57.778224 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-2d32f4cc-4c01-4b82-b45e-092532d5db27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:57.830090 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e759f63-2ae3-496a-9414-8d6e606db543 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:57.834924 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbbbcc-5cb4-4b83-be25-47ac42d22ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:57.835604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbbbcc-5cb4-4b83-be25-47ac42d22ffc service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.836225 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbbbcc-5cb4-4b83-be25-47ac42d22ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.836512 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbbbcc-5cb4-4b83-be25-47ac42d22ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.846910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbbbcc-5cb4-4b83-be25-47ac42d22ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:57.848325 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbbbcc-5cb4-4b83-be25-47ac42d22ffc service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:57.858607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 809/1622] 10.222.0.66 () {58 vars in 1058 bytes} [Thu May 26 21:20:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:57.862080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 814/1623] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:20:57.862216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f33d9-4e37-49da-a0ab-da2d307e80e1 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.862350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bba8b3-7505-42ae-9f97-241a51b04494 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.862454 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f33d9-4e37-49da-a0ab-da2d307e80e1 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.862543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bba8b3-7505-42ae-9f97-241a51b04494 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.862628 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f33d9-4e37-49da-a0ab-da2d307e80e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.862725 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bba8b3-7505-42ae-9f97-241a51b04494 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.862991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 815/1624] 10.222.0.66 () {54 vars in 961 bytes} [Thu May 26 21:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:20:57.863747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bba8b3-7505-42ae-9f97-241a51b04494 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:57.880115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bba8b3-7505-42ae-9f97-241a51b04494 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:57.886757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ae19f-a290-41ba-9eaf-9c75f53e9d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:57.887887 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ae19f-a290-41ba-9eaf-9c75f53e9d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.888180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ae19f-a290-41ba-9eaf-9c75f53e9d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.888627 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ae19f-a290-41ba-9eaf-9c75f53e9d35 admin admin] PATH_INFO: `/v3/projects/6a0ea57d56ba4c90bb65392f4bb3d7be/users/6970ed55fe3b418aab7c15235ba6a634/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:57.891365 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ae19f-a290-41ba-9eaf-9c75f53e9d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0ea57d56ba4c90bb65392f4bb3d7be, user_id=6970ed55fe3b418aab7c15235ba6a634, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:57.895098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ae19f-a290-41ba-9eaf-9c75f53e9d35 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:57.902958 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-3a7f33d9-4e37-49da-a0ab-da2d307e80e1 None None] MFA Rules not processed for user `d21c9a8cc55442a8a7c6a0a77b3eac05`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:57.904771 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3a7f33d9-4e37-49da-a0ab-da2d307e80e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:57.909796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 816/1625] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:20:57 2022] PUT /identity/v3/projects/6a0ea57d56ba4c90bb65392f4bb3d7be/users/6970ed55fe3b418aab7c15235ba6a634/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:57.911058 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ae19f-a290-41ba-9eaf-9c75f53e9d35 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:57.953758 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:57.981961 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ae19f-a290-41ba-9eaf-9c75f53e9d35 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:57.986673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa21959-15ab-4932-b9b9-84e9e7070c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:57.987336 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa21959-15ab-4932-b9b9-84e9e7070c50 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:57.987619 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa21959-15ab-4932-b9b9-84e9e7070c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:57.987897 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa21959-15ab-4932-b9b9-84e9e7070c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:58.003561 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 810/1626] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:57 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:58.003561 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4c2af-fe55-46c2-8ac9-c056648527a7 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:58.003561 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4c2af-fe55-46c2-8ac9-c056648527a7 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:58.003561 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4c2af-fe55-46c2-8ac9-c056648527a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:58.028204 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-72e4c2af-fe55-46c2-8ac9-c056648527a7 None None] MFA Rules not processed for user `df008eed25464be387741ee7a1e5ce80`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:58.029452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-72e4c2af-fe55-46c2-8ac9-c056648527a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:58.078262 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa21959-15ab-4932-b9b9-84e9e7070c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:58.079895 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa21959-15ab-4932-b9b9-84e9e7070c50 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:58.098193 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 817/1627] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:20:58.099962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa21959-15ab-4932-b9b9-84e9e7070c50 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:58.147583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 811/1628] 10.222.0.66 () {58 vars in 1058 bytes} [Thu May 26 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:58.149879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32565db5-6c71-406b-ab87-20710e215072 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:58.150148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32565db5-6c71-406b-ab87-20710e215072 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:58.150432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32565db5-6c71-406b-ab87-20710e215072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:58.184780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-32565db5-6c71-406b-ab87-20710e215072 None None] MFA Rules not processed for user `6970ed55fe3b418aab7c15235ba6a634`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:58.186362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-32565db5-6c71-406b-ab87-20710e215072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:58.192236 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:58.225080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa21959-15ab-4932-b9b9-84e9e7070c50 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:58.231624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fd600-bcdc-4bfe-9e42-c755f7b5acb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:58.232306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fd600-bcdc-4bfe-9e42-c755f7b5acb1 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:58.232603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fd600-bcdc-4bfe-9e42-c755f7b5acb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:58.233682 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fd600-bcdc-4bfe-9e42-c755f7b5acb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:58.347856 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2fd600-bcdc-4bfe-9e42-c755f7b5acb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:58.352170 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2fd600-bcdc-4bfe-9e42-c755f7b5acb1 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:58.368664 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 812/1629] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:58.370105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32565db5-6c71-406b-ab87-20710e215072 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:58.377080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 818/1630] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:20:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:20:58.378079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fd600-bcdc-4bfe-9e42-c755f7b5acb1 service nova] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:58.381908 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32565db5-6c71-406b-ab87-20710e215072 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:58.388461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9099f3-c1ed-46d4-9069-d726bafcba34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:58.389644 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9099f3-c1ed-46d4-9069-d726bafcba34 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:58.394505 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9099f3-c1ed-46d4-9069-d726bafcba34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:58.394505 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9099f3-c1ed-46d4-9069-d726bafcba34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:58.394505 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9099f3-c1ed-46d4-9069-d726bafcba34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:58.394814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fd600-bcdc-4bfe-9e42-c755f7b5acb1 service nova] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:58.394934 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9099f3-c1ed-46d4-9069-d726bafcba34 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:58.401312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d532ca-7cbc-4054-bcc1-4f56b7158d81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:58.402279 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d532ca-7cbc-4054-bcc1-4f56b7158d81 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:58.402680 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d532ca-7cbc-4054-bcc1-4f56b7158d81 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:58.403027 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d532ca-7cbc-4054-bcc1-4f56b7158d81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:58.509284 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 813/1631] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:20:58 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:58.509625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9099f3-c1ed-46d4-9069-d726bafcba34 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:58.529704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d532ca-7cbc-4054-bcc1-4f56b7158d81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:58.534599 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d532ca-7cbc-4054-bcc1-4f56b7158d81 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:58.563541 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 819/1632] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:20:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:20:58.564738 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d532ca-7cbc-4054-bcc1-4f56b7158d81 service nova] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:58.576796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d532ca-7cbc-4054-bcc1-4f56b7158d81 service nova] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:58.627463 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9099f3-c1ed-46d4-9069-d726bafcba34 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:58.634624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43755f-9efd-4f88-a783-2725f9900e83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:58.635290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43755f-9efd-4f88-a783-2725f9900e83 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:58.635570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43755f-9efd-4f88-a783-2725f9900e83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:58.635843 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43755f-9efd-4f88-a783-2725f9900e83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:58.653293 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896683c-2d28-4afb-b04b-b87c2d67e53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:58.654679 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896683c-2d28-4afb-b04b-b87c2d67e53e admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:58.655722 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896683c-2d28-4afb-b04b-b87c2d67e53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:58.656196 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896683c-2d28-4afb-b04b-b87c2d67e53e admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:58.657146 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896683c-2d28-4afb-b04b-b87c2d67e53e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:58.660110 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896683c-2d28-4afb-b04b-b87c2d67e53e admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:58.742259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43755f-9efd-4f88-a783-2725f9900e83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:58.746105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43755f-9efd-4f88-a783-2725f9900e83 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:58.771576 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 820/1633] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:20:58 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:58.773191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3821f-7c0d-4b60-ac44-c04d96794b01 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:58.773637 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3821f-7c0d-4b60-ac44-c04d96794b01 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:58.774381 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3821f-7c0d-4b60-ac44-c04d96794b01 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:58.778633 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 821/1634] 10.222.0.66 () {54 vars in 912 bytes} [Thu May 26 21:20:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:20:58.782327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3821f-7c0d-4b60-ac44-c04d96794b01 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:58.783207 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 814/1635] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:20:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:20:58.786450 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc464a-20be-46f8-9671-02c8d3945289 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:58.787615 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc464a-20be-46f8-9671-02c8d3945289 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:58.787897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc464a-20be-46f8-9671-02c8d3945289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:58.812696 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3821f-7c0d-4b60-ac44-c04d96794b01 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:58.826670 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c84c2c-565e-43d0-8058-7162bee13b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:58.827562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c84c2c-565e-43d0-8058-7162bee13b4c admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:58.827886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c84c2c-565e-43d0-8058-7162bee13b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:58.828236 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c84c2c-565e-43d0-8058-7162bee13b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:58.829104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c84c2c-565e-43d0-8058-7162bee13b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:58.833959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-efdc464a-20be-46f8-9671-02c8d3945289 None None] MFA Rules not processed for user `df008eed25464be387741ee7a1e5ce80`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:58.834294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c84c2c-565e-43d0-8058-7162bee13b4c admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:58.834407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-efdc464a-20be-46f8-9671-02c8d3945289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:58.861829 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:58.872416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 822/1636] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:58.873990 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c84c2c-565e-43d0-8058-7162bee13b4c admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:58.890398 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c84c2c-565e-43d0-8058-7162bee13b4c admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:58.907880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0a5a2-62a4-4e4c-8f11-c866973a5e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:58.908833 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0a5a2-62a4-4e4c-8f11-c866973a5e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:58.909115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0a5a2-62a4-4e4c-8f11-c866973a5e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:58.909537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0a5a2-62a4-4e4c-8f11-c866973a5e17 admin admin] PATH_INFO: `/v3/projects/40ab3957f7884fbcb4add7902edc4b42/users/59ca4f2d55d540f2ac30a4b5b28b6bfb/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:58.941207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:58.946385 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0a5a2-62a4-4e4c-8f11-c866973a5e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ab3957f7884fbcb4add7902edc4b42, user_id=59ca4f2d55d540f2ac30a4b5b28b6bfb, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:58.949363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0a5a2-62a4-4e4c-8f11-c866973a5e17 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:58.980205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 815/1637] 10.222.0.66 () {58 vars in 1009 bytes} [Thu May 26 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:58.991146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc464a-20be-46f8-9671-02c8d3945289 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:59.010076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc464a-20be-46f8-9671-02c8d3945289 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:59.022248 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df84feb-1408-4dca-9561-da637b9bdce0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:59.022928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df84feb-1408-4dca-9561-da637b9bdce0 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:59.026069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df84feb-1408-4dca-9561-da637b9bdce0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:59.026069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df84feb-1408-4dca-9561-da637b9bdce0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:59.042815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df84feb-1408-4dca-9561-da637b9bdce0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:59.044687 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df84feb-1408-4dca-9561-da637b9bdce0 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:59.053307 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 823/1638] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:20:58 2022] PUT /identity/v3/projects/40ab3957f7884fbcb4add7902edc4b42/users/59ca4f2d55d540f2ac30a4b5b28b6bfb/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:59.054252 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0a5a2-62a4-4e4c-8f11-c866973a5e17 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:59.064697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 816/1639] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:20:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:20:59.069554 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f32bf-ea0f-4f89-867c-856da7f629a4 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:59.070009 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f32bf-ea0f-4f89-867c-856da7f629a4 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:59.070637 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f32bf-ea0f-4f89-867c-856da7f629a4 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:59.073143 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 817/1640] 10.222.0.66 () {54 vars in 912 bytes} [Thu May 26 21:20:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:20:59.079991 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a0622-43b9-43ea-abd2-16cb7afb29c9 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:59.080182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a0622-43b9-43ea-abd2-16cb7afb29c9 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:59.080499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a0622-43b9-43ea-abd2-16cb7afb29c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:59.110141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-f11a0622-43b9-43ea-abd2-16cb7afb29c9 None None] MFA Rules not processed for user `df008eed25464be387741ee7a1e5ce80`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:59.112730 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f11a0622-43b9-43ea-abd2-16cb7afb29c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:59.187139 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0a5a2-62a4-4e4c-8f11-c866973a5e17 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:59.193395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004ca7f-b740-4cbe-956b-9952ff874337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:59.194306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004ca7f-b740-4cbe-956b-9952ff874337 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:59.194687 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004ca7f-b740-4cbe-956b-9952ff874337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:59.195061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004ca7f-b740-4cbe-956b-9952ff874337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:59.195907 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004ca7f-b740-4cbe-956b-9952ff874337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:59.197715 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004ca7f-b740-4cbe-956b-9952ff874337 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:59.217611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 824/1641] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:59.222045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004ca7f-b740-4cbe-956b-9952ff874337 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:59.235199 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004ca7f-b740-4cbe-956b-9952ff874337 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:59.241766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c548e24-8d7f-4867-afa4-c5ea4d6a46d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:59.243033 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c548e24-8d7f-4867-afa4-c5ea4d6a46d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:59.243455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c548e24-8d7f-4867-afa4-c5ea4d6a46d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:59.243886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c548e24-8d7f-4867-afa4-c5ea4d6a46d8 admin admin] PATH_INFO: `/v3/projects/40ab3957f7884fbcb4add7902edc4b42/users/59ca4f2d55d540f2ac30a4b5b28b6bfb/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:59.246570 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c548e24-8d7f-4867-afa4-c5ea4d6a46d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ab3957f7884fbcb4add7902edc4b42, user_id=59ca4f2d55d540f2ac30a4b5b28b6bfb, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:59.249884 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c548e24-8d7f-4867-afa4-c5ea4d6a46d8 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:59.275277 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 825/1642] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:20:59 2022] PUT /identity/v3/projects/40ab3957f7884fbcb4add7902edc4b42/users/59ca4f2d55d540f2ac30a4b5b28b6bfb/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:59.296042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 818/1643] 10.222.0.66 () {58 vars in 1009 bytes} [Thu May 26 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:59.297907 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c548e24-8d7f-4867-afa4-c5ea4d6a46d8 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:59.299587 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2c548e24-8d7f-4867-afa4-c5ea4d6a46d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:59.303393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04198b1-618d-4c2d-b902-4343f70e3bea None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:59.304667 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04198b1-618d-4c2d-b902-4343f70e3bea None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:59.307191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04198b1-618d-4c2d-b902-4343f70e3bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:59.358405 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-e04198b1-618d-4c2d-b902-4343f70e3bea None None] MFA Rules not processed for user `59ca4f2d55d540f2ac30a4b5b28b6bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:59.359517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e04198b1-618d-4c2d-b902-4343f70e3bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:59.361985 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:59.397453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c548e24-8d7f-4867-afa4-c5ea4d6a46d8 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:59.400744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:59.407809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc9769-44e0-4260-ab8d-ab88e9ad20e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdb2d75e4025a5d73ea713c690b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:59.407809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc9769-44e0-4260-ab8d-ab88e9ad20e2 service glance] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:59.407809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc9769-44e0-4260-ab8d-ab88e9ad20e2 service glance] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:59.408476 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc9769-44e0-4260-ab8d-ab88e9ad20e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:59.547781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 819/1644] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:59.557581 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc9769-44e0-4260-ab8d-ab88e9ad20e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:59.559892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc9769-44e0-4260-ab8d-ab88e9ad20e2 service glance] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:59.579566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 826/1645] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:20:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:20:59.641442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04198b1-618d-4c2d-b902-4343f70e3bea None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:59.745175 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04198b1-618d-4c2d-b902-4343f70e3bea None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:59.750291 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d320c7-b375-41d1-998e-b6603aae985e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:59.751897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d320c7-b375-41d1-998e-b6603aae985e service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:59.752254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d320c7-b375-41d1-998e-b6603aae985e service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:59.752627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d320c7-b375-41d1-998e-b6603aae985e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:59.764429 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d320c7-b375-41d1-998e-b6603aae985e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:59.766172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d320c7-b375-41d1-998e-b6603aae985e service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:59.778400 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 820/1646] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:20:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:00.138063 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc9769-44e0-4260-ab8d-ab88e9ad20e2 service glance] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:00.156791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc9769-44e0-4260-ab8d-ab88e9ad20e2 service glance] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:00.161681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2d9fc-db77-4671-a127-2d62f2633762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:00.162923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2d9fc-db77-4671-a127-2d62f2633762 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:00.163260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2d9fc-db77-4671-a127-2d62f2633762 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:00.163590 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2d9fc-db77-4671-a127-2d62f2633762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:00.179338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b41e40-34b3-4686-bdea-1a078be064ae None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:00.180308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b41e40-34b3-4686-bdea-1a078be064ae None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:00.181422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b41e40-34b3-4686-bdea-1a078be064ae None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:00.183994 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 821/1647] 10.222.0.66 () {54 vars in 912 bytes} [Thu May 26 21:21:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:21:00.189281 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12616638-cdfa-408f-bfe1-692cd134017b None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:00.189465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12616638-cdfa-408f-bfe1-692cd134017b None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:00.189729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12616638-cdfa-408f-bfe1-692cd134017b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:00.234677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-12616638-cdfa-408f-bfe1-692cd134017b None None] MFA Rules not processed for user `98ec4e37c2714729afec6ad805ed775a`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:00.235920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-12616638-cdfa-408f-bfe1-692cd134017b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:00.244038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2d9fc-db77-4671-a127-2d62f2633762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:00.245797 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2d9fc-db77-4671-a127-2d62f2633762 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:00.259059 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 827/1648] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:00 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:00.300188 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 822/1649] 10.222.0.66 () {58 vars in 1009 bytes} [Thu May 26 21:21:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:21:00.398633 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2d9fc-db77-4671-a127-2d62f2633762 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:00.419436 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2d9fc-db77-4671-a127-2d62f2633762 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:00.424207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43b3d6-11ba-4131-b0d0-185fc86eb878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:00.425117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43b3d6-11ba-4131-b0d0-185fc86eb878 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:00.427363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43b3d6-11ba-4131-b0d0-185fc86eb878 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:00.428295 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43b3d6-11ba-4131-b0d0-185fc86eb878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:00.440845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43b3d6-11ba-4131-b0d0-185fc86eb878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:00.443992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43b3d6-11ba-4131-b0d0-185fc86eb878 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:00.457038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 828/1650] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:01.126166 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12616638-cdfa-408f-bfe1-692cd134017b None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:01.155878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:01.211966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12616638-cdfa-408f-bfe1-692cd134017b None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:01.234819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8799d81-e7de-4b80-9e50-b8ff2599c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:01.236085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8799d81-e7de-4b80-9e50-b8ff2599c5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:01.236376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8799d81-e7de-4b80-9e50-b8ff2599c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:01.238279 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8799d81-e7de-4b80-9e50-b8ff2599c5f0 admin admin] PATH_INFO: `/v3/users/61ca0566d1ba43868e4500c92403f89a` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:01.242707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8799d81-e7de-4b80-9e50-b8ff2599c5f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ca0566d1ba43868e4500c92403f89a)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:01.245930 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: WARNING py.warnings [None req-e8799d81-e7de-4b80-9e50-b8ff2599c5f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:21:01.245930 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: warnings.warn(msg) May 26 21:21:01.245930 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: May 26 21:21:01.247340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8799d81-e7de-4b80-9e50-b8ff2599c5f0 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:01.586929 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-e8799d81-e7de-4b80-9e50-b8ff2599c5f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ca0566d1ba43868e4500c92403f89a'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:01.677084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-e8799d81-e7de-4b80-9e50-b8ff2599c5f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ca0566d1ba43868e4500c92403f89a'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:01.677760 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-e8799d81-e7de-4b80-9e50-b8ff2599c5f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ca0566d1ba43868e4500c92403f89a'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:01.687111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8175f87-b83a-46ba-a727-207c6ccbc50e None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:01.687601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8175f87-b83a-46ba-a727-207c6ccbc50e None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:01.687880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8175f87-b83a-46ba-a727-207c6ccbc50e None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:01.689527 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 829/1651] 10.222.0.66 () {54 vars in 960 bytes} [Thu May 26 21:21:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:21:01.695815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7a8c-7310-4b97-bf4c-00d70b3140d5 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:01.696395 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7a8c-7310-4b97-bf4c-00d70b3140d5 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:01.696911 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7a8c-7310-4b97-bf4c-00d70b3140d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:01.730748 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-047c7a8c-7310-4b97-bf4c-00d70b3140d5 None None] MFA Rules not processed for user `2d68ccb9b89843078c40b13f79a72dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:01.731730 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-e8799d81-e7de-4b80-9e50-b8ff2599c5f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ca0566d1ba43868e4500c92403f89a'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:01.732610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-047c7a8c-7310-4b97-bf4c-00d70b3140d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:01.733635 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-e8799d81-e7de-4b80-9e50-b8ff2599c5f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ca0566d1ba43868e4500c92403f89a'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:01.759716 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 823/1652] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:21:01 2022] DELETE /identity/v3/users/61ca0566d1ba43868e4500c92403f89a => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:01.768036 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb080ba-4e9c-4fe9-94af-d084d358006e None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:01.768547 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb080ba-4e9c-4fe9-94af-d084d358006e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:01.770768 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb080ba-4e9c-4fe9-94af-d084d358006e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:01.802046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-8bb080ba-4e9c-4fe9-94af-d084d358006e None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:01.804225 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8bb080ba-4e9c-4fe9-94af-d084d358006e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:01.865197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:01.904524 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 830/1653] 10.222.0.66 () {58 vars in 1057 bytes} [Thu May 26 21:21:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:21:01.913188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c7a8c-7310-4b97-bf4c-00d70b3140d5 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:01.926439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c7a8c-7310-4b97-bf4c-00d70b3140d5 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:01.977051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 824/1654] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:02.007214 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb080ba-4e9c-4fe9-94af-d084d358006e None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:02.009131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8bb080ba-4e9c-4fe9-94af-d084d358006e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:02.068604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c12767-9b20-4b87-8d14-41fe75a40f90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:02.086979 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c12767-9b20-4b87-8d14-41fe75a40f90 service placement] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:02.086979 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c12767-9b20-4b87-8d14-41fe75a40f90 service placement] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:02.086979 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c12767-9b20-4b87-8d14-41fe75a40f90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:02.089688 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-67c12767-9b20-4b87-8d14-41fe75a40f90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:02.102219 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:02.113291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c12767-9b20-4b87-8d14-41fe75a40f90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:02.115100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c12767-9b20-4b87-8d14-41fe75a40f90 service placement] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:02.135150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb080ba-4e9c-4fe9-94af-d084d358006e None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:02.136508 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 831/1655] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:02.152448 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fe746-d2fa-4d86-b60a-d10bc482f5ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:02.153172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fe746-d2fa-4d86-b60a-d10bc482f5ab service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:02.153905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fe746-d2fa-4d86-b60a-d10bc482f5ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:02.154206 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fe746-d2fa-4d86-b60a-d10bc482f5ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:02.177144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fe746-d2fa-4d86-b60a-d10bc482f5ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:02.179824 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fe746-d2fa-4d86-b60a-d10bc482f5ab service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:02.200071 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 825/1656] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:21:03.736553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c12767-9b20-4b87-8d14-41fe75a40f90 service placement] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:03.743238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-67c12767-9b20-4b87-8d14-41fe75a40f90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:03.773316 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c12767-9b20-4b87-8d14-41fe75a40f90 service placement] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:03.797652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:03.799153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:03.799644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:03.800154 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83 admin admin] PATH_INFO: `/v3/projects/667ed286168b4d9fa15e6ac3dd774085` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:03.801861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=667ed286168b4d9fa15e6ac3dd774085)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:03.803390 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: WARNING py.warnings [None req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:21:03.803390 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: warnings.warn(msg) May 26 21:21:03.803390 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: May 26 21:21:03.805313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:04.053378 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '667ed286168b4d9fa15e6ac3dd774085', 'request_id': 'req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:04.174078 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '667ed286168b4d9fa15e6ac3dd774085', 'request_id': 'req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:04.202000 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '667ed286168b4d9fa15e6ac3dd774085', 'request_id': 'req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:04.249711 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83 admin admin] The token cache is being invalidate because project 667ed286168b4d9fa15e6ac3dd774085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:21:04.250062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:04.250774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:04.256013 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 832/1657] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:21:03 2022] DELETE /identity/v3/projects/667ed286168b4d9fa15e6ac3dd774085 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:04.256888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fe746-d2fa-4d86-b60a-d10bc482f5ab service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:04.275061 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fe746-d2fa-4d86-b60a-d10bc482f5ab service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:04.545248 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506a45c-4fed-4c79-a20a-ee2e3f74dcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:04.551768 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506a45c-4fed-4c79-a20a-ee2e3f74dcfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:04.551768 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506a45c-4fed-4c79-a20a-ee2e3f74dcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:04.551768 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506a45c-4fed-4c79-a20a-ee2e3f74dcfe admin admin] PATH_INFO: `/v3/users/6970ed55fe3b418aab7c15235ba6a634` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:04.551768 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506a45c-4fed-4c79-a20a-ee2e3f74dcfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6970ed55fe3b418aab7c15235ba6a634)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:04.555499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506a45c-4fed-4c79-a20a-ee2e3f74dcfe admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:04.899791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:04.901908 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:04.930019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dcd67-a85e-4c28-8b6e-2cae5bdcee83 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:04.936649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f048e7-2556-45c6-bdf2-ada781fba502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:04.938062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f048e7-2556-45c6-bdf2-ada781fba502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:04.939105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f048e7-2556-45c6-bdf2-ada781fba502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:04.946550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f048e7-2556-45c6-bdf2-ada781fba502 admin admin] PATH_INFO: `/v3/users/b5c38bac14d846a698af265cf50fd6a2` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:04.948798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f048e7-2556-45c6-bdf2-ada781fba502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5c38bac14d846a698af265cf50fd6a2)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:04.951266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f048e7-2556-45c6-bdf2-ada781fba502 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:05.104238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-1506a45c-4fed-4c79-a20a-ee2e3f74dcfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6970ed55fe3b418aab7c15235ba6a634'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:05.197451 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-46f048e7-2556-45c6-bdf2-ada781fba502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5c38bac14d846a698af265cf50fd6a2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:05.198312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-46f048e7-2556-45c6-bdf2-ada781fba502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5c38bac14d846a698af265cf50fd6a2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:05.198853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-46f048e7-2556-45c6-bdf2-ada781fba502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5c38bac14d846a698af265cf50fd6a2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:05.220155 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-1506a45c-4fed-4c79-a20a-ee2e3f74dcfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6970ed55fe3b418aab7c15235ba6a634'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:05.220903 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-1506a45c-4fed-4c79-a20a-ee2e3f74dcfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6970ed55fe3b418aab7c15235ba6a634'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:05.228021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:05.251748 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-46f048e7-2556-45c6-bdf2-ada781fba502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5c38bac14d846a698af265cf50fd6a2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:05.256681 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-1506a45c-4fed-4c79-a20a-ee2e3f74dcfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6970ed55fe3b418aab7c15235ba6a634'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:05.257928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-1506a45c-4fed-4c79-a20a-ee2e3f74dcfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6970ed55fe3b418aab7c15235ba6a634'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:05.278862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-46f048e7-2556-45c6-bdf2-ada781fba502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5c38bac14d846a698af265cf50fd6a2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:05.295555 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 826/1658] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:21:04 2022] DELETE /identity/v3/users/6970ed55fe3b418aab7c15235ba6a634 => generated 0 bytes in 1036 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:05.295555 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506a45c-4fed-4c79-a20a-ee2e3f74dcfe admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:05.297188 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1506a45c-4fed-4c79-a20a-ee2e3f74dcfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:05.359801 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 833/1659] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:21:04 2022] DELETE /identity/v3/users/b5c38bac14d846a698af265cf50fd6a2 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:21:05.370995 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e775f-5d68-47a0-a446-34a94f79cfd1 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:05.371497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e775f-5d68-47a0-a446-34a94f79cfd1 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:05.372286 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e775f-5d68-47a0-a446-34a94f79cfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:05.431439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-620e775f-5d68-47a0-a446-34a94f79cfd1 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:05.436243 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-620e775f-5d68-47a0-a446-34a94f79cfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:05.465055 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506a45c-4fed-4c79-a20a-ee2e3f74dcfe admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:05.473476 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:05.671083 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a43ca-6012-436b-bd36-1c5c20f66471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:05.678498 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a43ca-6012-436b-bd36-1c5c20f66471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:05.678498 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a43ca-6012-436b-bd36-1c5c20f66471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:05.678498 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a43ca-6012-436b-bd36-1c5c20f66471 admin admin] PATH_INFO: `/v3/users/d21c9a8cc55442a8a7c6a0a77b3eac05` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:05.678783 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 834/1660] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:05.678868 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a43ca-6012-436b-bd36-1c5c20f66471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d21c9a8cc55442a8a7c6a0a77b3eac05)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:05.681961 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a43ca-6012-436b-bd36-1c5c20f66471 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:05.703148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e775f-5d68-47a0-a446-34a94f79cfd1 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:05.705215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-620e775f-5d68-47a0-a446-34a94f79cfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:05.815512 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e775f-5d68-47a0-a446-34a94f79cfd1 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:05.821114 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a15960-6359-469b-a729-5976df91fc61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:05.821958 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a15960-6359-469b-a729-5976df91fc61 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:05.822492 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a15960-6359-469b-a729-5976df91fc61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:05.822884 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a15960-6359-469b-a729-5976df91fc61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:05.838625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a15960-6359-469b-a729-5976df91fc61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:05.841136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a15960-6359-469b-a729-5976df91fc61 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:05.862375 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 835/1661] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:06.175961 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-747a43ca-6012-436b-bd36-1c5c20f66471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd21c9a8cc55442a8a7c6a0a77b3eac05'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:06.313335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-747a43ca-6012-436b-bd36-1c5c20f66471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd21c9a8cc55442a8a7c6a0a77b3eac05'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:06.316224 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-747a43ca-6012-436b-bd36-1c5c20f66471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd21c9a8cc55442a8a7c6a0a77b3eac05'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:06.361259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-747a43ca-6012-436b-bd36-1c5c20f66471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd21c9a8cc55442a8a7c6a0a77b3eac05'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:06.362623 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-747a43ca-6012-436b-bd36-1c5c20f66471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd21c9a8cc55442a8a7c6a0a77b3eac05'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:06.399159 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 827/1662] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:21:05 2022] DELETE /identity/v3/users/d21c9a8cc55442a8a7c6a0a77b3eac05 => generated 0 bytes in 1106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:06.406036 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148370-b729-468d-9991-13aa2f8c0fa7 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:06.407814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148370-b729-468d-9991-13aa2f8c0fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:06.408276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148370-b729-468d-9991-13aa2f8c0fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:06.435877 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-c6148370-b729-468d-9991-13aa2f8c0fa7 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:06.441703 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-c6148370-b729-468d-9991-13aa2f8c0fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:06.644825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 836/1663] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:06.651642 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a43ca-6012-436b-bd36-1c5c20f66471 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:06.653351 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-747a43ca-6012-436b-bd36-1c5c20f66471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:06.812714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6148370-b729-468d-9991-13aa2f8c0fa7 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:06.814898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a43ca-6012-436b-bd36-1c5c20f66471 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:06.819225 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-c6148370-b729-468d-9991-13aa2f8c0fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:06.832055 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954c819-34e6-416d-a54d-76a7b8919621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:06.832791 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954c819-34e6-416d-a54d-76a7b8919621 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:06.833084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954c819-34e6-416d-a54d-76a7b8919621 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:06.833373 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954c819-34e6-416d-a54d-76a7b8919621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:06.859123 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6148370-b729-468d-9991-13aa2f8c0fa7 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:06.863172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954c819-34e6-416d-a54d-76a7b8919621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:06.867762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954c819-34e6-416d-a54d-76a7b8919621 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:06.873334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeb91c-c108-4480-bc96-586de2b2aa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:06.875854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeb91c-c108-4480-bc96-586de2b2aa3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:06.878129 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeb91c-c108-4480-bc96-586de2b2aa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:06.878524 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeb91c-c108-4480-bc96-586de2b2aa3b admin admin] PATH_INFO: `/v3/projects/6a0ea57d56ba4c90bb65392f4bb3d7be` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:06.882807 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eeb91c-c108-4480-bc96-586de2b2aa3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0ea57d56ba4c90bb65392f4bb3d7be)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:06.888092 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eeb91c-c108-4480-bc96-586de2b2aa3b admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:06.893364 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 828/1664] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:07.024320 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:07.171752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c4eeb91c-c108-4480-bc96-586de2b2aa3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0ea57d56ba4c90bb65392f4bb3d7be', 'request_id': 'req-c4eeb91c-c108-4480-bc96-586de2b2aa3b'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:07.242132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c4eeb91c-c108-4480-bc96-586de2b2aa3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0ea57d56ba4c90bb65392f4bb3d7be', 'request_id': 'req-c4eeb91c-c108-4480-bc96-586de2b2aa3b'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:07.251949 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c4eeb91c-c108-4480-bc96-586de2b2aa3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0ea57d56ba4c90bb65392f4bb3d7be', 'request_id': 'req-c4eeb91c-c108-4480-bc96-586de2b2aa3b'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:07.312468 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c4eeb91c-c108-4480-bc96-586de2b2aa3b admin admin] The token cache is being invalidate because project 6a0ea57d56ba4c90bb65392f4bb3d7be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:21:07.313034 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c4eeb91c-c108-4480-bc96-586de2b2aa3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:07.315330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c4eeb91c-c108-4480-bc96-586de2b2aa3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:07.334036 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 837/1665] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:21:06 2022] DELETE /identity/v3/projects/6a0ea57d56ba4c90bb65392f4bb3d7be => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:07.339241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e9a3d-ccea-4ad9-a0d3-4b98a4f1ad1a None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:07.339722 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e9a3d-ccea-4ad9-a0d3-4b98a4f1ad1a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:07.339818 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e9a3d-ccea-4ad9-a0d3-4b98a4f1ad1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:07.389829 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-656e9a3d-ccea-4ad9-a0d3-4b98a4f1ad1a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:07.391082 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-656e9a3d-ccea-4ad9-a0d3-4b98a4f1ad1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:07.442626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:07.570646 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 829/1666] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:07.575797 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910811b-538d-4377-9802-0d2e53b8daeb None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:07.575797 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910811b-538d-4377-9802-0d2e53b8daeb None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:07.575797 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910811b-538d-4377-9802-0d2e53b8daeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:07.629498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-9910811b-538d-4377-9802-0d2e53b8daeb None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:07.631687 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-9910811b-538d-4377-9802-0d2e53b8daeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:07.642406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 838/1667] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:21:07.647055 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e9a3d-ccea-4ad9-a0d3-4b98a4f1ad1a None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:07.669777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e9a3d-ccea-4ad9-a0d3-4b98a4f1ad1a None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:07.674242 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb576b-2080-466b-8b1e-d118702dabb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:07.675381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb576b-2080-466b-8b1e-d118702dabb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:07.676073 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb576b-2080-466b-8b1e-d118702dabb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:07.676494 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb576b-2080-466b-8b1e-d118702dabb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:07.677876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb576b-2080-466b-8b1e-d118702dabb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:21:07.678519 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb576b-2080-466b-8b1e-d118702dabb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:07.681026 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb576b-2080-466b-8b1e-d118702dabb9 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:07.695113 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39714ab-fc77-4702-a29f-ca9c8f845814 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:07.695653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39714ab-fc77-4702-a29f-ca9c8f845814 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:07.696039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39714ab-fc77-4702-a29f-ca9c8f845814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:07.700989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 830/1668] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:21:07.702320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb576b-2080-466b-8b1e-d118702dabb9 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:07.715720 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb576b-2080-466b-8b1e-d118702dabb9 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:07.723220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2380072-9898-42ff-8c04-92b8635b14b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:07.724269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2380072-9898-42ff-8c04-92b8635b14b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:07.728744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2380072-9898-42ff-8c04-92b8635b14b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:07.728744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2380072-9898-42ff-8c04-92b8635b14b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:07.728744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2380072-9898-42ff-8c04-92b8635b14b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:07.728744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2380072-9898-42ff-8c04-92b8635b14b0 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:07.730178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-f39714ab-fc77-4702-a29f-ca9c8f845814 None None] MFA Rules not processed for user `5890e1e70ffd4e33a812691e9c43b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:07.733812 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f39714ab-fc77-4702-a29f-ca9c8f845814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:07.825089 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 839/1669] 10.222.0.66 () {58 vars in 1009 bytes} [Thu May 26 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:07.864065 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39714ab-fc77-4702-a29f-ca9c8f845814 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:07.864741 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 831/1670] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:21:07 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:07.884107 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39714ab-fc77-4702-a29f-ca9c8f845814 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:08.043045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a750ba-af0a-4b65-a3cb-4f1f06ac5e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:08.043742 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a750ba-af0a-4b65-a3cb-4f1f06ac5e8a admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:08.044025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a750ba-af0a-4b65-a3cb-4f1f06ac5e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:08.044298 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a750ba-af0a-4b65-a3cb-4f1f06ac5e8a admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:08.045047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a750ba-af0a-4b65-a3cb-4f1f06ac5e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:08.047064 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a750ba-af0a-4b65-a3cb-4f1f06ac5e8a admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:08.197837 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 840/1671] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:21:07 2022] POST /identity/v3/users => generated 289 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:21:08.203649 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2380072-9898-42ff-8c04-92b8635b14b0 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:08.219548 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2380072-9898-42ff-8c04-92b8635b14b0 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:08.235856 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118260c-a612-43f4-b614-0fb47e63a64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:08.240598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118260c-a612-43f4-b614-0fb47e63a64a admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:08.240598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118260c-a612-43f4-b614-0fb47e63a64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:08.240598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118260c-a612-43f4-b614-0fb47e63a64a admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:08.240598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118260c-a612-43f4-b614-0fb47e63a64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:08.240598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118260c-a612-43f4-b614-0fb47e63a64a admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:08.272754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a750ba-af0a-4b65-a3cb-4f1f06ac5e8a admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:08.272944 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 832/1672] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:08.288817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a750ba-af0a-4b65-a3cb-4f1f06ac5e8a admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:08.300989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2d762-e9c9-4415-af75-f13cc04d77a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:08.301696 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2d762-e9c9-4415-af75-f13cc04d77a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:08.301982 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2d762-e9c9-4415-af75-f13cc04d77a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:08.302292 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2d762-e9c9-4415-af75-f13cc04d77a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:08.303032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2d762-e9c9-4415-af75-f13cc04d77a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:08.304890 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2d762-e9c9-4415-af75-f13cc04d77a8 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:08.329902 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 841/1673] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:21:08.335111 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118260c-a612-43f4-b614-0fb47e63a64a admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:08.352244 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118260c-a612-43f4-b614-0fb47e63a64a admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:08.366826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd41870-c7da-4c21-9648-aca6a8d31493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:08.366826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd41870-c7da-4c21-9648-aca6a8d31493 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:08.366826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd41870-c7da-4c21-9648-aca6a8d31493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:08.368294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd41870-c7da-4c21-9648-aca6a8d31493 admin admin] PATH_INFO: `/v3/projects/4e3c9b3d15e746f7b1ca34dc55cb67b4/users/756bc3312d1444fea516963bb6a0018e/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:08.369423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2d762-e9c9-4415-af75-f13cc04d77a8 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:08.371674 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-80b2d762-e9c9-4415-af75-f13cc04d77a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:08.402602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd41870-c7da-4c21-9648-aca6a8d31493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3c9b3d15e746f7b1ca34dc55cb67b4, user_id=756bc3312d1444fea516963bb6a0018e, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:08.406658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd41870-c7da-4c21-9648-aca6a8d31493 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:08.514263 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 833/1674] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:08 2022] PUT /identity/v3/projects/4e3c9b3d15e746f7b1ca34dc55cb67b4/users/756bc3312d1444fea516963bb6a0018e/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:21:08.528093 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ecee-99a9-4025-8d52-408c2fb27d4d None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:08.528633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ecee-99a9-4025-8d52-408c2fb27d4d None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:08.529060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ecee-99a9-4025-8d52-408c2fb27d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:08.596000 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2d762-e9c9-4415-af75-f13cc04d77a8 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:08.623489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-4e91ecee-99a9-4025-8d52-408c2fb27d4d None None] MFA Rules not processed for user `756bc3312d1444fea516963bb6a0018e`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:08.625080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4e91ecee-99a9-4025-8d52-408c2fb27d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:08.732996 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c08192-8940-4d0d-bb45-12d497cf04a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6304e47844214d2db0acfae11e4714ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:08.735032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c08192-8940-4d0d-bb45-12d497cf04a2 service swift] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:08.735483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c08192-8940-4d0d-bb45-12d497cf04a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:08.736073 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c08192-8940-4d0d-bb45-12d497cf04a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:08.813904 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 834/1675] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:08.828893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91ecee-99a9-4025-8d52-408c2fb27d4d None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:08.842726 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:08.916815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c08192-8940-4d0d-bb45-12d497cf04a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:08.921306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c08192-8940-4d0d-bb45-12d497cf04a2 service swift] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:08.948866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 842/1676] 10.222.0.66 () {60 vars in 1384 bytes} [Thu May 26 21:21:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 21:21:08.975206 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91ecee-99a9-4025-8d52-408c2fb27d4d None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:08.981365 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2d915-8ad5-461c-b15b-753c6200eb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:08.982229 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2d915-8ad5-461c-b15b-753c6200eb08 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:08.982817 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2d915-8ad5-461c-b15b-753c6200eb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:08.983540 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2d915-8ad5-461c-b15b-753c6200eb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:08.984534 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2d915-8ad5-461c-b15b-753c6200eb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:08.986733 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2d915-8ad5-461c-b15b-753c6200eb08 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:09.025380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:09.196147 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 835/1677] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:21:08 2022] POST /identity/v3/projects => generated 375 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:21:09.198579 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c08192-8940-4d0d-bb45-12d497cf04a2 service swift] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:09.221348 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c08192-8940-4d0d-bb45-12d497cf04a2 service swift] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:09.488416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10862d15-d064-481c-bbe3-2336a3b4d68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:09.492215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10862d15-d064-481c-bbe3-2336a3b4d68d admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:09.492475 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10862d15-d064-481c-bbe3-2336a3b4d68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:09.495482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10862d15-d064-481c-bbe3-2336a3b4d68d admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:09.501037 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10862d15-d064-481c-bbe3-2336a3b4d68d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:09.509413 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10862d15-d064-481c-bbe3-2336a3b4d68d admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:09.579677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2d915-8ad5-461c-b15b-753c6200eb08 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:09.582244 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f6b2d915-8ad5-461c-b15b-753c6200eb08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:09.620732 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2d915-8ad5-461c-b15b-753c6200eb08 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:09.640564 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dce123-d36a-4ae3-ba58-e1e11bfc2f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:09.641972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dce123-d36a-4ae3-ba58-e1e11bfc2f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:09.642634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dce123-d36a-4ae3-ba58-e1e11bfc2f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:09.643179 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dce123-d36a-4ae3-ba58-e1e11bfc2f36 admin admin] PATH_INFO: `/v3/projects/7bf89680201948a69270b2c1d8d59a74` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:09.645145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dce123-d36a-4ae3-ba58-e1e11bfc2f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf89680201948a69270b2c1d8d59a74)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:09.659710 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dce123-d36a-4ae3-ba58-e1e11bfc2f36 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:09.711597 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 843/1678] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:21:09 2022] POST /identity/v3/users => generated 294 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:09.713482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10862d15-d064-481c-bbe3-2336a3b4d68d admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:09.755700 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10862d15-d064-481c-bbe3-2336a3b4d68d admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:09.780981 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee49b6a-a37a-4627-bf13-ac967c57a4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:09.781975 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee49b6a-a37a-4627-bf13-ac967c57a4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:09.782474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee49b6a-a37a-4627-bf13-ac967c57a4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:09.782946 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee49b6a-a37a-4627-bf13-ac967c57a4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:09.784190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee49b6a-a37a-4627-bf13-ac967c57a4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:09.786256 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee49b6a-a37a-4627-bf13-ac967c57a4e5 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:09.816289 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 844/1679] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:09.821542 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee49b6a-a37a-4627-bf13-ac967c57a4e5 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:09.837399 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee49b6a-a37a-4627-bf13-ac967c57a4e5 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:09.858419 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962d9d2-8c45-4877-9c2c-5801993f2e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:09.860850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962d9d2-8c45-4877-9c2c-5801993f2e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:09.861031 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962d9d2-8c45-4877-9c2c-5801993f2e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:09.861347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962d9d2-8c45-4877-9c2c-5801993f2e0f admin admin] PATH_INFO: `/v3/projects/def3f9de42ec48b59a2732f190587eda/users/0f28c6832c194464be4f22dcf3c4b953/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:09.922481 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-65dce123-d36a-4ae3-ba58-e1e11bfc2f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf89680201948a69270b2c1d8d59a74', 'request_id': 'req-65dce123-d36a-4ae3-ba58-e1e11bfc2f36'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:09.936476 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962d9d2-8c45-4877-9c2c-5801993f2e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=def3f9de42ec48b59a2732f190587eda, user_id=0f28c6832c194464be4f22dcf3c4b953, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:09.944088 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962d9d2-8c45-4877-9c2c-5801993f2e0f admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:09.969970 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-65dce123-d36a-4ae3-ba58-e1e11bfc2f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf89680201948a69270b2c1d8d59a74', 'request_id': 'req-65dce123-d36a-4ae3-ba58-e1e11bfc2f36'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:10.089101 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 845/1680] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:09 2022] PUT /identity/v3/projects/def3f9de42ec48b59a2732f190587eda/users/0f28c6832c194464be4f22dcf3c4b953/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:10.090362 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962d9d2-8c45-4877-9c2c-5801993f2e0f admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:10.100944 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-65dce123-d36a-4ae3-ba58-e1e11bfc2f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf89680201948a69270b2c1d8d59a74', 'request_id': 'req-65dce123-d36a-4ae3-ba58-e1e11bfc2f36'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:10.145728 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-65dce123-d36a-4ae3-ba58-e1e11bfc2f36 admin admin] The token cache is being invalidate because project 7bf89680201948a69270b2c1d8d59a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:21:10.148057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-65dce123-d36a-4ae3-ba58-e1e11bfc2f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:10.152696 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-65dce123-d36a-4ae3-ba58-e1e11bfc2f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:10.160394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 836/1681] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:21:09 2022] DELETE /identity/v3/projects/7bf89680201948a69270b2c1d8d59a74 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:10.164894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d9488-4725-4f75-9493-681145fdf0e7 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:10.165216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d9488-4725-4f75-9493-681145fdf0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:10.165489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d9488-4725-4f75-9493-681145fdf0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:10.248442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-624d9488-4725-4f75-9493-681145fdf0e7 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:10.256965 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-624d9488-4725-4f75-9493-681145fdf0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:10.334349 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962d9d2-8c45-4877-9c2c-5801993f2e0f admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:10.350421 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052cf25-5c92-414d-b9ea-3d03a0c445ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:10.352206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052cf25-5c92-414d-b9ea-3d03a0c445ec admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:10.352566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052cf25-5c92-414d-b9ea-3d03a0c445ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:10.352889 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052cf25-5c92-414d-b9ea-3d03a0c445ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:10.361880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052cf25-5c92-414d-b9ea-3d03a0c445ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:10.370642 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052cf25-5c92-414d-b9ea-3d03a0c445ec admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:10.379824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:10.439915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 846/1682] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:10.443140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052cf25-5c92-414d-b9ea-3d03a0c445ec admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:10.450712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-4052cf25-5c92-414d-b9ea-3d03a0c445ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:10.495531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052cf25-5c92-414d-b9ea-3d03a0c445ec admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:10.517668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf022e-9439-4349-9131-c85a8858054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:10.519023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf022e-9439-4349-9131-c85a8858054c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:10.519497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf022e-9439-4349-9131-c85a8858054c admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:10.519916 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf022e-9439-4349-9131-c85a8858054c admin admin] PATH_INFO: `/v3/projects/b8e15d0caedd4cde9d21103c926fccc8` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:10.525564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf022e-9439-4349-9131-c85a8858054c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e15d0caedd4cde9d21103c926fccc8)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:10.528960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf022e-9439-4349-9131-c85a8858054c admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:10.563231 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 837/1683] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:10.565961 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d9488-4725-4f75-9493-681145fdf0e7 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:10.569991 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-624d9488-4725-4f75-9493-681145fdf0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:10.605848 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d9488-4725-4f75-9493-681145fdf0e7 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:10.620259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec2efc-568d-4b9c-ae05-0953e52ef01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:10.623336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec2efc-568d-4b9c-ae05-0953e52ef01e admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:10.623882 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec2efc-568d-4b9c-ae05-0953e52ef01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:10.624512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec2efc-568d-4b9c-ae05-0953e52ef01e admin admin] PATH_INFO: `/v3/projects/def3f9de42ec48b59a2732f190587eda/users/0f28c6832c194464be4f22dcf3c4b953/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:10.629137 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec2efc-568d-4b9c-ae05-0953e52ef01e admin admin] RBAC: Authorizing `identity:create_grant(project_id=def3f9de42ec48b59a2732f190587eda, user_id=0f28c6832c194464be4f22dcf3c4b953, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:10.635680 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec2efc-568d-4b9c-ae05-0953e52ef01e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:10.685916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 838/1684] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:10 2022] PUT /identity/v3/projects/def3f9de42ec48b59a2732f190587eda/users/0f28c6832c194464be4f22dcf3c4b953/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:10.691558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b6ce4-3d4d-4d28-ad3c-d68ab30a08ec None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:10.692359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b6ce4-3d4d-4d28-ad3c-d68ab30a08ec None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:10.693744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b6ce4-3d4d-4d28-ad3c-d68ab30a08ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:10.722855 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-afbf022e-9439-4349-9131-c85a8858054c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e15d0caedd4cde9d21103c926fccc8', 'request_id': 'req-afbf022e-9439-4349-9131-c85a8858054c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:10.787345 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-081b6ce4-3d4d-4d28-ad3c-d68ab30a08ec None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:10.794005 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-081b6ce4-3d4d-4d28-ad3c-d68ab30a08ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:10.929984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:10.947638 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 839/1685] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:10.949216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1c90c-d636-454d-b8df-855081b81c7f None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:10.949563 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1c90c-d636-454d-b8df-855081b81c7f None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:10.949837 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1c90c-d636-454d-b8df-855081b81c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:11.001135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-afbf022e-9439-4349-9131-c85a8858054c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e15d0caedd4cde9d21103c926fccc8', 'request_id': 'req-afbf022e-9439-4349-9131-c85a8858054c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:11.011162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-afbf022e-9439-4349-9131-c85a8858054c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e15d0caedd4cde9d21103c926fccc8', 'request_id': 'req-afbf022e-9439-4349-9131-c85a8858054c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:11.030747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-e6a1c90c-d636-454d-b8df-855081b81c7f None None] MFA Rules not processed for user `0f28c6832c194464be4f22dcf3c4b953`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:11.032127 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e6a1c90c-d636-454d-b8df-855081b81c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:11.048090 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-afbf022e-9439-4349-9131-c85a8858054c admin admin] The token cache is being invalidate because project b8e15d0caedd4cde9d21103c926fccc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:21:11.048455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-afbf022e-9439-4349-9131-c85a8858054c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:11.049693 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-afbf022e-9439-4349-9131-c85a8858054c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:11.055002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 847/1686] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:21:10 2022] DELETE /identity/v3/projects/b8e15d0caedd4cde9d21103c926fccc8 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:11.116830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf022e-9439-4349-9131-c85a8858054c admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:11.116830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-afbf022e-9439-4349-9131-c85a8858054c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:11.116830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf022e-9439-4349-9131-c85a8858054c admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:11.126596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c73629-57c5-4d81-970f-eee5190ea280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:11.127444 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c73629-57c5-4d81-970f-eee5190ea280 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:11.127731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c73629-57c5-4d81-970f-eee5190ea280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:11.128011 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c73629-57c5-4d81-970f-eee5190ea280 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:11.132025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c73629-57c5-4d81-970f-eee5190ea280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:21:11.132356 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c73629-57c5-4d81-970f-eee5190ea280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:11.134176 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c73629-57c5-4d81-970f-eee5190ea280 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:11.165202 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 848/1687] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:21:11.166272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c73629-57c5-4d81-970f-eee5190ea280 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:11.169137 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-e3c73629-57c5-4d81-970f-eee5190ea280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:11.200407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c73629-57c5-4d81-970f-eee5190ea280 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:11.211865 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d814e0-ff48-4eff-8b52-c4e56367bd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:11.211865 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d814e0-ff48-4eff-8b52-c4e56367bd54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:11.211865 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d814e0-ff48-4eff-8b52-c4e56367bd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:11.211865 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d814e0-ff48-4eff-8b52-c4e56367bd54 admin admin] PATH_INFO: `/v3/users/59ca4f2d55d540f2ac30a4b5b28b6bfb` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:11.212200 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d814e0-ff48-4eff-8b52-c4e56367bd54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59ca4f2d55d540f2ac30a4b5b28b6bfb)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:11.216086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d814e0-ff48-4eff-8b52-c4e56367bd54 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:11.242805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 840/1688] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:11.242805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1c90c-d636-454d-b8df-855081b81c7f None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:11.255995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1c90c-d636-454d-b8df-855081b81c7f None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:11.271606 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fe924-ad5d-4726-8375-6703ea0b00ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:11.272474 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fe924-ad5d-4726-8375-6703ea0b00ad admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:11.272868 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fe924-ad5d-4726-8375-6703ea0b00ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:11.273305 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fe924-ad5d-4726-8375-6703ea0b00ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:11.274134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fe924-ad5d-4726-8375-6703ea0b00ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:11.276693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fe924-ad5d-4726-8375-6703ea0b00ad admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:11.439573 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 841/1689] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:21:11 2022] POST /identity/v3/projects => generated 371 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:11.447862 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fe924-ad5d-4726-8375-6703ea0b00ad admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:11.447862 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-b11fe924-ad5d-4726-8375-6703ea0b00ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:11.519770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e0d814e0-ff48-4eff-8b52-c4e56367bd54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59ca4f2d55d540f2ac30a4b5b28b6bfb'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:11.524231 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e0d814e0-ff48-4eff-8b52-c4e56367bd54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59ca4f2d55d540f2ac30a4b5b28b6bfb'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:11.525557 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e0d814e0-ff48-4eff-8b52-c4e56367bd54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59ca4f2d55d540f2ac30a4b5b28b6bfb'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:11.569555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e0d814e0-ff48-4eff-8b52-c4e56367bd54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59ca4f2d55d540f2ac30a4b5b28b6bfb'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:11.596357 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e0d814e0-ff48-4eff-8b52-c4e56367bd54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59ca4f2d55d540f2ac30a4b5b28b6bfb'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:11.624221 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fe924-ad5d-4726-8375-6703ea0b00ad admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:11.629458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc9604-c471-42e1-b766-ef3f06db6be0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:11.630777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc9604-c471-42e1-b766-ef3f06db6be0 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:11.631071 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc9604-c471-42e1-b766-ef3f06db6be0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:11.632008 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc9604-c471-42e1-b766-ef3f06db6be0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:11.634639 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f0bc9604-c471-42e1-b766-ef3f06db6be0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:11.706071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 849/1690] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:21:11 2022] DELETE /identity/v3/users/59ca4f2d55d540f2ac30a4b5b28b6bfb => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:11.716174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d814e0-ff48-4eff-8b52-c4e56367bd54 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:11.716174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-e0d814e0-ff48-4eff-8b52-c4e56367bd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:11.792000 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:11.808161 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc9604-c471-42e1-b766-ef3f06db6be0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:11.818256 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc9604-c471-42e1-b766-ef3f06db6be0 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:11.836612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 842/1691] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:12.009066 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d814e0-ff48-4eff-8b52-c4e56367bd54 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:12.019846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc3fb0-760a-48fe-96e8-602333b4bdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:12.020998 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc3fb0-760a-48fe-96e8-602333b4bdb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:12.023800 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc3fb0-760a-48fe-96e8-602333b4bdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:12.024783 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc3fb0-760a-48fe-96e8-602333b4bdb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:12.025328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc3fb0-760a-48fe-96e8-602333b4bdb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:12.036822 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc3fb0-760a-48fe-96e8-602333b4bdb8 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:12.194428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 850/1692] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:21:11 2022] POST /identity/v3/users => generated 286 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:12.198776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc9604-c471-42e1-b766-ef3f06db6be0 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:12.225269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:12.437274 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f776db9-8b76-4780-9e43-62e5db649cae None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:12.437719 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f776db9-8b76-4780-9e43-62e5db649cae None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:12.438101 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f776db9-8b76-4780-9e43-62e5db649cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:12.506105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-8f776db9-8b76-4780-9e43-62e5db649cae None None] MFA Rules not processed for user `98ec4e37c2714729afec6ad805ed775a`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:12.508436 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-8f776db9-8b76-4780-9e43-62e5db649cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:12.518551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc9604-c471-42e1-b766-ef3f06db6be0 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:12.594831 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497db3f-3c98-491d-9d01-83a750ccd92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:12.598144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497db3f-3c98-491d-9d01-83a750ccd92d admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:12.599931 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497db3f-3c98-491d-9d01-83a750ccd92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:12.600366 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497db3f-3c98-491d-9d01-83a750ccd92d admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:12.601228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497db3f-3c98-491d-9d01-83a750ccd92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:12.622676 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497db3f-3c98-491d-9d01-83a750ccd92d admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:12.669224 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 843/1693] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:12.677692 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497db3f-3c98-491d-9d01-83a750ccd92d admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:12.728699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497db3f-3c98-491d-9d01-83a750ccd92d admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:12.747442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc12fd-6b10-4275-9815-e51883e0f017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:12.747442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc12fd-6b10-4275-9815-e51883e0f017 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:12.747442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc12fd-6b10-4275-9815-e51883e0f017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:12.747442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc12fd-6b10-4275-9815-e51883e0f017 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:12.747789 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc12fd-6b10-4275-9815-e51883e0f017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:12.747789 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc12fd-6b10-4275-9815-e51883e0f017 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:12.766661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 844/1694] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:12.773618 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc12fd-6b10-4275-9815-e51883e0f017 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:12.805160 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc12fd-6b10-4275-9815-e51883e0f017 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:12.820692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 851/1695] 10.222.0.50 () {58 vars in 1015 bytes} [Thu May 26 21:21:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:21:12.834127 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6afde4-1575-48e2-b44b-b4ce9ba9d607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:12.837510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6afde4-1575-48e2-b44b-b4ce9ba9d607 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:12.852753 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6afde4-1575-48e2-b44b-b4ce9ba9d607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:12.853234 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6afde4-1575-48e2-b44b-b4ce9ba9d607 admin admin] PATH_INFO: `/v3/projects/34feefe885274fb8bf2e83cbcb8c37d5/users/47a99f5000e54e628a371e8731871e55/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:12.909418 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6afde4-1575-48e2-b44b-b4ce9ba9d607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34feefe885274fb8bf2e83cbcb8c37d5, user_id=47a99f5000e54e628a371e8731871e55, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:12.913119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6afde4-1575-48e2-b44b-b4ce9ba9d607 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:12.936203 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f776db9-8b76-4780-9e43-62e5db649cae None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:12.940389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-8f776db9-8b76-4780-9e43-62e5db649cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:13.009294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f776db9-8b76-4780-9e43-62e5db649cae None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:13.035473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3ee5a-2267-488f-9a07-7944f7022635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:13.036163 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 845/1696] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:12 2022] PUT /identity/v3/projects/34feefe885274fb8bf2e83cbcb8c37d5/users/47a99f5000e54e628a371e8731871e55/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:13.037028 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3ee5a-2267-488f-9a07-7944f7022635 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:13.038290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016e3f2-a528-47e9-8c5c-8ce03e673787 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:13.038577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016e3f2-a528-47e9-8c5c-8ce03e673787 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:13.038855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016e3f2-a528-47e9-8c5c-8ce03e673787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:13.042414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3ee5a-2267-488f-9a07-7944f7022635 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:13.042956 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3ee5a-2267-488f-9a07-7944f7022635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:13.075867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3ee5a-2267-488f-9a07-7944f7022635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:13.082272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3ee5a-2267-488f-9a07-7944f7022635 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:13.108274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-7016e3f2-a528-47e9-8c5c-8ce03e673787 None None] MFA Rules not processed for user `47a99f5000e54e628a371e8731871e55`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:13.110107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-7016e3f2-a528-47e9-8c5c-8ce03e673787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:13.132646 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 852/1697] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:13.276066 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 846/1698] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:13.292761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3ee5a-2267-488f-9a07-7944f7022635 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:13.294753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f5f3ee5a-2267-488f-9a07-7944f7022635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:13.397958 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:13.610560 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3ee5a-2267-488f-9a07-7944f7022635 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:13.821524 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cdaf64-e131-416c-ae80-b4c9a319a0dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:13.822214 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdaf64-e131-416c-ae80-b4c9a319a0dc service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:13.822494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdaf64-e131-416c-ae80-b4c9a319a0dc service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:13.822775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdaf64-e131-416c-ae80-b4c9a319a0dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:13.859148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cdaf64-e131-416c-ae80-b4c9a319a0dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:13.860847 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cdaf64-e131-416c-ae80-b4c9a319a0dc service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:13.890158 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 853/1699] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:14.427533 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016e3f2-a528-47e9-8c5c-8ce03e673787 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:14.591133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:14.606023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016e3f2-a528-47e9-8c5c-8ce03e673787 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:14.611201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41718936-511f-44d4-88d4-37c43c3a448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:14.612096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41718936-511f-44d4-88d4-37c43c3a448c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:14.613021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41718936-511f-44d4-88d4-37c43c3a448c admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:14.613479 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41718936-511f-44d4-88d4-37c43c3a448c admin admin] PATH_INFO: `/v3/users/47a99f5000e54e628a371e8731871e55` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:14.615985 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41718936-511f-44d4-88d4-37c43c3a448c admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a99f5000e54e628a371e8731871e55)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:14.617961 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41718936-511f-44d4-88d4-37c43c3a448c admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:14.901459 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-41718936-511f-44d4-88d4-37c43c3a448c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a99f5000e54e628a371e8731871e55'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:14.973687 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-41718936-511f-44d4-88d4-37c43c3a448c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a99f5000e54e628a371e8731871e55'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:14.974773 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-41718936-511f-44d4-88d4-37c43c3a448c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a99f5000e54e628a371e8731871e55'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:15.015570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-41718936-511f-44d4-88d4-37c43c3a448c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a99f5000e54e628a371e8731871e55'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:15.018604 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-41718936-511f-44d4-88d4-37c43c3a448c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a99f5000e54e628a371e8731871e55'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:15.081353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 847/1700] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:21:14 2022] DELETE /identity/v3/users/47a99f5000e54e628a371e8731871e55 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:15.087589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26142ae6-b185-4eea-a1dc-c3005ed5353a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:15.088158 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26142ae6-b185-4eea-a1dc-c3005ed5353a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:15.088330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26142ae6-b185-4eea-a1dc-c3005ed5353a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:15.147215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-26142ae6-b185-4eea-a1dc-c3005ed5353a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:15.148463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-26142ae6-b185-4eea-a1dc-c3005ed5353a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:15.256400 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba07e3f-23e8-4686-8bf8-1fd1a9012fda None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:15.256400 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba07e3f-23e8-4686-8bf8-1fd1a9012fda None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:15.256400 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba07e3f-23e8-4686-8bf8-1fd1a9012fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:15.359625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-6ba07e3f-23e8-4686-8bf8-1fd1a9012fda None None] MFA Rules not processed for user `23ed95370bfd46e3a1c6946701e66065`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:15.368104 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6ba07e3f-23e8-4686-8bf8-1fd1a9012fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:15.455991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 854/1701] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:15.485518 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26142ae6-b185-4eea-a1dc-c3005ed5353a None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:15.490503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-26142ae6-b185-4eea-a1dc-c3005ed5353a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:15.612615 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 848/1702] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:15.616206 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82d61c-15d3-4dc2-8215-9b0a16cd73f8 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:15.616206 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82d61c-15d3-4dc2-8215-9b0a16cd73f8 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:15.616206 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82d61c-15d3-4dc2-8215-9b0a16cd73f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:15.679374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-6d82d61c-15d3-4dc2-8215-9b0a16cd73f8 None None] MFA Rules not processed for user `23ed95370bfd46e3a1c6946701e66065`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:15.693364 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6d82d61c-15d3-4dc2-8215-9b0a16cd73f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:15.722910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 849/1703] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:21:15.724835 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:15.738867 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82d61c-15d3-4dc2-8215-9b0a16cd73f8 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:15.740474 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6d82d61c-15d3-4dc2-8215-9b0a16cd73f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:15.741263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26142ae6-b185-4eea-a1dc-c3005ed5353a None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:15.756993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb8e85-67eb-4b4e-93bd-84a9be63dbf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:15.757722 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb8e85-67eb-4b4e-93bd-84a9be63dbf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:15.758013 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb8e85-67eb-4b4e-93bd-84a9be63dbf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:15.758359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb8e85-67eb-4b4e-93bd-84a9be63dbf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:15.789342 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb8e85-67eb-4b4e-93bd-84a9be63dbf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:15.794923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb8e85-67eb-4b4e-93bd-84a9be63dbf9 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:15.838393 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 855/1704] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:16.006657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:16.082569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82d61c-15d3-4dc2-8215-9b0a16cd73f8 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:16.106652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836d678-a155-4650-95ec-21ce70c8120d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:16.106652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836d678-a155-4650-95ec-21ce70c8120d service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:16.106652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836d678-a155-4650-95ec-21ce70c8120d service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:16.106652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836d678-a155-4650-95ec-21ce70c8120d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:16.129290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836d678-a155-4650-95ec-21ce70c8120d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:16.130944 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836d678-a155-4650-95ec-21ce70c8120d service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:16.176368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 850/1705] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:21:16.653210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb8e85-67eb-4b4e-93bd-84a9be63dbf9 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:16.655818 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-e3bb8e85-67eb-4b4e-93bd-84a9be63dbf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:16.723404 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb8e85-67eb-4b4e-93bd-84a9be63dbf9 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:16.752535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d72e0-7f70-4658-9194-3ec9b141b8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:16.754165 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d72e0-7f70-4658-9194-3ec9b141b8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:16.756119 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d72e0-7f70-4658-9194-3ec9b141b8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:16.756414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d72e0-7f70-4658-9194-3ec9b141b8c2 admin admin] PATH_INFO: `/v3/projects/40ab3957f7884fbcb4add7902edc4b42` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:16.765601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d72e0-7f70-4658-9194-3ec9b141b8c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40ab3957f7884fbcb4add7902edc4b42)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:16.767596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d72e0-7f70-4658-9194-3ec9b141b8c2 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:16.859759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf5162-4380-470d-b31f-f4f16b5de052 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:16.860320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf5162-4380-470d-b31f-f4f16b5de052 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:16.860320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf5162-4380-470d-b31f-f4f16b5de052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:16.935587 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-65cf5162-4380-470d-b31f-f4f16b5de052 None None] MFA Rules not processed for user `7d524a8208354c2099eb3b41b0f53de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:16.936867 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-65cf5162-4380-470d-b31f-f4f16b5de052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:16.977594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c43d72e0-7f70-4658-9194-3ec9b141b8c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40ab3957f7884fbcb4add7902edc4b42', 'request_id': 'req-c43d72e0-7f70-4658-9194-3ec9b141b8c2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:17.068354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c43d72e0-7f70-4658-9194-3ec9b141b8c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40ab3957f7884fbcb4add7902edc4b42', 'request_id': 'req-c43d72e0-7f70-4658-9194-3ec9b141b8c2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:17.076788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c43d72e0-7f70-4658-9194-3ec9b141b8c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40ab3957f7884fbcb4add7902edc4b42', 'request_id': 'req-c43d72e0-7f70-4658-9194-3ec9b141b8c2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:17.109157 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c43d72e0-7f70-4658-9194-3ec9b141b8c2 admin admin] The token cache is being invalidate because project 40ab3957f7884fbcb4add7902edc4b42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:21:17.109157 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c43d72e0-7f70-4658-9194-3ec9b141b8c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:17.109157 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c43d72e0-7f70-4658-9194-3ec9b141b8c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:17.109157 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 856/1706] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:21:16 2022] DELETE /identity/v3/projects/40ab3957f7884fbcb4add7902edc4b42 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:17.113143 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd1d86-feb8-456f-a317-8310a37af424 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:17.113476 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd1d86-feb8-456f-a317-8310a37af424 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:17.113799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd1d86-feb8-456f-a317-8310a37af424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:17.161845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-f5cd1d86-feb8-456f-a317-8310a37af424 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:17.163635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f5cd1d86-feb8-456f-a317-8310a37af424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:17.198788 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 851/1707] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:17.309134 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 857/1708] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:21:17.319586 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff766a1-8538-4082-8dd7-9c7efd879dad None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:17.319959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff766a1-8538-4082-8dd7-9c7efd879dad None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:17.320288 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff766a1-8538-4082-8dd7-9c7efd879dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:17.392890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-0ff766a1-8538-4082-8dd7-9c7efd879dad None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:17.394795 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0ff766a1-8538-4082-8dd7-9c7efd879dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:17.429592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 852/1709] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:17.435940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd1d86-feb8-456f-a317-8310a37af424 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:17.453772 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd1d86-feb8-456f-a317-8310a37af424 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:17.460901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81f899-a5b0-4bde-8a61-a91cc71c4649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:17.462760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81f899-a5b0-4bde-8a61-a91cc71c4649 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:17.463072 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81f899-a5b0-4bde-8a61-a91cc71c4649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:17.463344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81f899-a5b0-4bde-8a61-a91cc71c4649 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:17.466518 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81f899-a5b0-4bde-8a61-a91cc71c4649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:21:17.466838 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81f899-a5b0-4bde-8a61-a91cc71c4649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:17.468538 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81f899-a5b0-4bde-8a61-a91cc71c4649 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:17.498172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 858/1710] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:21:17.502244 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff766a1-8538-4082-8dd7-9c7efd879dad None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:17.513068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff766a1-8538-4082-8dd7-9c7efd879dad None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:17.518838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d4baa-af43-4d6d-a6c8-ecadc5c6db15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:17.519635 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d4baa-af43-4d6d-a6c8-ecadc5c6db15 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:17.519984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d4baa-af43-4d6d-a6c8-ecadc5c6db15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:17.520366 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d4baa-af43-4d6d-a6c8-ecadc5c6db15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:17.522037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d4baa-af43-4d6d-a6c8-ecadc5c6db15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:17.524121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d4baa-af43-4d6d-a6c8-ecadc5c6db15 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:17.685154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 853/1711] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:21:17 2022] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:17.686427 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81f899-a5b0-4bde-8a61-a91cc71c4649 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:17.711910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81f899-a5b0-4bde-8a61-a91cc71c4649 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:17.909719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d4baa-af43-4d6d-a6c8-ecadc5c6db15 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:17.912700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-bd9d4baa-af43-4d6d-a6c8-ecadc5c6db15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:17.988059 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f21f1c-183a-4022-80fc-9dee262222d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:17.988059 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f21f1c-183a-4022-80fc-9dee262222d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:17.988059 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f21f1c-183a-4022-80fc-9dee262222d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:17.988059 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f21f1c-183a-4022-80fc-9dee262222d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:17.988387 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f21f1c-183a-4022-80fc-9dee262222d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:17.990518 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f21f1c-183a-4022-80fc-9dee262222d6 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:18.025593 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:18.139136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 859/1712] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:21:17 2022] POST /identity/v3/users => generated 284 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:18.143808 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f21f1c-183a-4022-80fc-9dee262222d6 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:18.185717 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f21f1c-183a-4022-80fc-9dee262222d6 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:18.224732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9ecc4-a335-4fd6-be1f-8cb24af2d9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:18.226495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9ecc4-a335-4fd6-be1f-8cb24af2d9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:18.226799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9ecc4-a335-4fd6-be1f-8cb24af2d9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:18.227133 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9ecc4-a335-4fd6-be1f-8cb24af2d9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:18.227931 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9ecc4-a335-4fd6-be1f-8cb24af2d9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:18.233886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9ecc4-a335-4fd6-be1f-8cb24af2d9c5 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:18.242764 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d4baa-af43-4d6d-a6c8-ecadc5c6db15 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:18.258245 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb94d7-17b6-4df2-8622-944f496c702c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:18.259196 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb94d7-17b6-4df2-8622-944f496c702c service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:18.259675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb94d7-17b6-4df2-8622-944f496c702c service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:18.260357 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb94d7-17b6-4df2-8622-944f496c702c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:18.266949 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 860/1713] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:18.272817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9ecc4-a335-4fd6-be1f-8cb24af2d9c5 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:18.310612 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9ecc4-a335-4fd6-be1f-8cb24af2d9c5 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:18.324429 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b21fea-a8ee-46bd-95fd-155aa00191c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:18.325214 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b21fea-a8ee-46bd-95fd-155aa00191c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:18.327142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b21fea-a8ee-46bd-95fd-155aa00191c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:18.328531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b21fea-a8ee-46bd-95fd-155aa00191c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:18.329415 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b21fea-a8ee-46bd-95fd-155aa00191c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:18.335679 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b21fea-a8ee-46bd-95fd-155aa00191c2 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:18.345289 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:18.363008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 861/1714] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:18.371302 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb94d7-17b6-4df2-8622-944f496c702c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:18.371628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b21fea-a8ee-46bd-95fd-155aa00191c2 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:18.378359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb94d7-17b6-4df2-8622-944f496c702c service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:18.399795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b21fea-a8ee-46bd-95fd-155aa00191c2 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:18.418796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73aa41-9a57-4acf-96e3-467452da93d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:18.419745 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73aa41-9a57-4acf-96e3-467452da93d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:18.423636 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73aa41-9a57-4acf-96e3-467452da93d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:18.423893 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73aa41-9a57-4acf-96e3-467452da93d7 admin admin] PATH_INFO: `/v3/projects/e9ece08b45fa4e679e9d3b3b18df8bee/users/7dbc97343bb94e76b16d72be0c865687/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:18.436755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 854/1715] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:21:18.474333 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73aa41-9a57-4acf-96e3-467452da93d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ece08b45fa4e679e9d3b3b18df8bee, user_id=7dbc97343bb94e76b16d72be0c865687, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:18.477099 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73aa41-9a57-4acf-96e3-467452da93d7 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:18.477352 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7b1b6-1154-4188-89ce-c8a4019ac60e None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:18.478695 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7b1b6-1154-4188-89ce-c8a4019ac60e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:18.479188 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7b1b6-1154-4188-89ce-c8a4019ac60e None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:18.481008 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 855/1716] 10.222.0.66 () {54 vars in 921 bytes} [Thu May 26 21:21:18 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:21:18.532400 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a8dab-691b-4544-b52d-a05186eb02cc None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:18.535421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a8dab-691b-4544-b52d-a05186eb02cc None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:18.535421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a8dab-691b-4544-b52d-a05186eb02cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:18.600861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 862/1717] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:18 2022] PUT /identity/v3/projects/e9ece08b45fa4e679e9d3b3b18df8bee/users/7dbc97343bb94e76b16d72be0c865687/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:18.602026 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-ea1a8dab-691b-4544-b52d-a05186eb02cc None None] MFA Rules not processed for user `df008eed25464be387741ee7a1e5ce80`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:18.606086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d7f8-767d-4dbb-81a6-09f377566744 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:18.606421 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d7f8-767d-4dbb-81a6-09f377566744 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:18.606707 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d7f8-767d-4dbb-81a6-09f377566744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:18.610461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ea1a8dab-691b-4544-b52d-a05186eb02cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:18.724236 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-3a00d7f8-767d-4dbb-81a6-09f377566744 None None] MFA Rules not processed for user `7dbc97343bb94e76b16d72be0c865687`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:18.727688 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3a00d7f8-767d-4dbb-81a6-09f377566744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:18.821785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 856/1718] 10.222.0.66 () {58 vars in 1018 bytes} [Thu May 26 21:21:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:18.892707 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 863/1719] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:18.897341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a8dab-691b-4544-b52d-a05186eb02cc None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:19.088050 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a8dab-691b-4544-b52d-a05186eb02cc None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:19.095825 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bb315-648f-4c43-8d1b-49b2ce1e955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:19.096508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bb315-648f-4c43-8d1b-49b2ce1e955e admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:19.097036 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bb315-648f-4c43-8d1b-49b2ce1e955e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:19.097416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bb315-648f-4c43-8d1b-49b2ce1e955e admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:19.098363 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bb315-648f-4c43-8d1b-49b2ce1e955e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:19.102435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bb315-648f-4c43-8d1b-49b2ce1e955e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:19.212546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 857/1720] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:21:18 2022] POST /identity/v3/projects => generated 367 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:19.217925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00d7f8-767d-4dbb-81a6-09f377566744 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:19.239795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00d7f8-767d-4dbb-81a6-09f377566744 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:19.328763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bb315-648f-4c43-8d1b-49b2ce1e955e admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:19.331178 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-c35bb315-648f-4c43-8d1b-49b2ce1e955e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:19.392458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27daa80-3a9c-4b31-ae35-4976b4bd3387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:19.393357 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27daa80-3a9c-4b31-ae35-4976b4bd3387 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:19.393753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27daa80-3a9c-4b31-ae35-4976b4bd3387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:19.394172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27daa80-3a9c-4b31-ae35-4976b4bd3387 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:19.395083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27daa80-3a9c-4b31-ae35-4976b4bd3387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:19.397315 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27daa80-3a9c-4b31-ae35-4976b4bd3387 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:19.470495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:19.518761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bb315-648f-4c43-8d1b-49b2ce1e955e admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:19.533073 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc338d2-dbc3-4ee3-8cf6-8c6c08b97891 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:19.533754 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc338d2-dbc3-4ee3-8cf6-8c6c08b97891 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:19.534042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc338d2-dbc3-4ee3-8cf6-8c6c08b97891 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:19.534323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc338d2-dbc3-4ee3-8cf6-8c6c08b97891 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:19.548342 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 864/1721] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:21:19 2022] POST /identity/v3/users => generated 290 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:19.550093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27daa80-3a9c-4b31-ae35-4976b4bd3387 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:19.577076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc338d2-dbc3-4ee3-8cf6-8c6c08b97891 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:19.584857 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc338d2-dbc3-4ee3-8cf6-8c6c08b97891 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:19.591221 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27daa80-3a9c-4b31-ae35-4976b4bd3387 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:19.611435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fae49-2f6b-48c9-bca7-3e1584bcd00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:19.613698 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fae49-2f6b-48c9-bca7-3e1584bcd00c admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:19.613990 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fae49-2f6b-48c9-bca7-3e1584bcd00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:19.614837 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fae49-2f6b-48c9-bca7-3e1584bcd00c admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:19.615595 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fae49-2f6b-48c9-bca7-3e1584bcd00c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:19.618697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 858/1722] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:19.641584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63b3de-b85e-421b-b495-4ba31295abda None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:19.641584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63b3de-b85e-421b-b495-4ba31295abda None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:19.642265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fae49-2f6b-48c9-bca7-3e1584bcd00c admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:19.643161 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63b3de-b85e-421b-b495-4ba31295abda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:19.681972 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 865/1723] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:19.684271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fae49-2f6b-48c9-bca7-3e1584bcd00c admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:19.690558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2a6fae49-2f6b-48c9-bca7-3e1584bcd00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:19.751498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fae49-2f6b-48c9-bca7-3e1584bcd00c admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:19.761136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-8d63b3de-b85e-421b-b495-4ba31295abda None None] MFA Rules not processed for user `46e692bef3e3484ebac5d1563e489e03`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:19.762543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8d63b3de-b85e-421b-b495-4ba31295abda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:19.774879 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279edf77-6002-4cdf-bfed-f0159e00adb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:19.779747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279edf77-6002-4cdf-bfed-f0159e00adb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:19.779747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279edf77-6002-4cdf-bfed-f0159e00adb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:19.779747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279edf77-6002-4cdf-bfed-f0159e00adb6 admin admin] PATH_INFO: `/v3/projects/34feefe885274fb8bf2e83cbcb8c37d5` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:19.779747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279edf77-6002-4cdf-bfed-f0159e00adb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34feefe885274fb8bf2e83cbcb8c37d5)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:19.783669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279edf77-6002-4cdf-bfed-f0159e00adb6 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:19.808909 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:19.873890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 859/1724] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:19.890843 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63b3de-b85e-421b-b495-4ba31295abda None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:19.952744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63b3de-b85e-421b-b495-4ba31295abda None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:20.016443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-279edf77-6002-4cdf-bfed-f0159e00adb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34feefe885274fb8bf2e83cbcb8c37d5', 'request_id': 'req-279edf77-6002-4cdf-bfed-f0159e00adb6'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:20.117685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf777c-20cd-45d0-9612-199d65266b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:20.119403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf777c-20cd-45d0-9612-199d65266b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:20.119982 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf777c-20cd-45d0-9612-199d65266b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:20.120472 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf777c-20cd-45d0-9612-199d65266b0a admin admin] PATH_INFO: `/v3/projects/4ea9d5071cf64493ad123d1e92482966/users/2dabf047a08a481da67f5fcf0b5035e6/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:20.148928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf777c-20cd-45d0-9612-199d65266b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea9d5071cf64493ad123d1e92482966, user_id=2dabf047a08a481da67f5fcf0b5035e6, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:20.155139 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf777c-20cd-45d0-9612-199d65266b0a admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:20.167113 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-279edf77-6002-4cdf-bfed-f0159e00adb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34feefe885274fb8bf2e83cbcb8c37d5', 'request_id': 'req-279edf77-6002-4cdf-bfed-f0159e00adb6'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:20.180782 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-279edf77-6002-4cdf-bfed-f0159e00adb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34feefe885274fb8bf2e83cbcb8c37d5', 'request_id': 'req-279edf77-6002-4cdf-bfed-f0159e00adb6'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:20.248007 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-279edf77-6002-4cdf-bfed-f0159e00adb6 admin admin] The token cache is being invalidate because project 34feefe885274fb8bf2e83cbcb8c37d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:21:20.248007 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-279edf77-6002-4cdf-bfed-f0159e00adb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:20.248007 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-279edf77-6002-4cdf-bfed-f0159e00adb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:20.254187 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 866/1725] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:21:19 2022] DELETE /identity/v3/projects/34feefe885274fb8bf2e83cbcb8c37d5 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:20.268036 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b746e81-07cf-4c88-b137-a638c5309599 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:20.268036 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b746e81-07cf-4c88-b137-a638c5309599 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:20.270189 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b746e81-07cf-4c88-b137-a638c5309599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:20.323225 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 860/1726] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:19 2022] PUT /identity/v3/projects/4ea9d5071cf64493ad123d1e92482966/users/2dabf047a08a481da67f5fcf0b5035e6/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:20.327267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-0b746e81-07cf-4c88-b137-a638c5309599 None None] MFA Rules not processed for user `23ed95370bfd46e3a1c6946701e66065`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:20.328516 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf777c-20cd-45d0-9612-199d65266b0a admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:20.330578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-0b746e81-07cf-4c88-b137-a638c5309599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:20.361549 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1abf777c-20cd-45d0-9612-199d65266b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:20.516820 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 867/1727] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:20.518226 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a76ea-ed4d-49c2-910d-972d55fb1493 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:20.523927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a76ea-ed4d-49c2-910d-972d55fb1493 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:20.524220 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a76ea-ed4d-49c2-910d-972d55fb1493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:20.586773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-3f4a76ea-ed4d-49c2-910d-972d55fb1493 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:20.597880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3f4a76ea-ed4d-49c2-910d-972d55fb1493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:20.615894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:20.729201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf777c-20cd-45d0-9612-199d65266b0a admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:20.743946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617cea5-808d-4328-bd83-27805f45c2fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:20.759510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617cea5-808d-4328-bd83-27805f45c2fb service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:20.759937 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617cea5-808d-4328-bd83-27805f45c2fb service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:20.761360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617cea5-808d-4328-bd83-27805f45c2fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:20.766031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-7617cea5-808d-4328-bd83-27805f45c2fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:20.956506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 868/1728] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:20.960882 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a76ea-ed4d-49c2-910d-972d55fb1493 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:20.965784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3f4a76ea-ed4d-49c2-910d-972d55fb1493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:21.016618 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617cea5-808d-4328-bd83-27805f45c2fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:21.025231 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617cea5-808d-4328-bd83-27805f45c2fb service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:21.028329 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a76ea-ed4d-49c2-910d-972d55fb1493 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:21.044386 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8385084-39ab-422f-bb54-0572f9086917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:21.047851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8385084-39ab-422f-bb54-0572f9086917 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:21.048153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8385084-39ab-422f-bb54-0572f9086917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:21.048636 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8385084-39ab-422f-bb54-0572f9086917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:21.056840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8385084-39ab-422f-bb54-0572f9086917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:21.066232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8385084-39ab-422f-bb54-0572f9086917 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:21.067385 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 861/1729] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 743 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:21.075789 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b067b-287e-4ca8-ace1-1d83e6ec3b18 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:21.075789 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b067b-287e-4ca8-ace1-1d83e6ec3b18 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:21.076009 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b067b-287e-4ca8-ace1-1d83e6ec3b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:21.095133 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 869/1730] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:21.098006 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8385084-39ab-422f-bb54-0572f9086917 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:21.121485 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-8d6b067b-287e-4ca8-ace1-1d83e6ec3b18 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:21.125698 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8d6b067b-287e-4ca8-ace1-1d83e6ec3b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:21.126575 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8385084-39ab-422f-bb54-0572f9086917 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:21.143144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7ea22-e9cb-4a41-9016-e090ea3ef007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:21.147241 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7ea22-e9cb-4a41-9016-e090ea3ef007 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:21.148058 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7ea22-e9cb-4a41-9016-e090ea3ef007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:21.148373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7ea22-e9cb-4a41-9016-e090ea3ef007 admin admin] PATH_INFO: `/v3/projects/4ea9d5071cf64493ad123d1e92482966/users/2dabf047a08a481da67f5fcf0b5035e6/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:21.157529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7ea22-e9cb-4a41-9016-e090ea3ef007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea9d5071cf64493ad123d1e92482966, user_id=2dabf047a08a481da67f5fcf0b5035e6, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:21.158518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 862/1731] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:21.161475 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b067b-287e-4ca8-ace1-1d83e6ec3b18 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:21.171214 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7ea22-e9cb-4a41-9016-e090ea3ef007 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:21.195645 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b067b-287e-4ca8-ace1-1d83e6ec3b18 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:21.223980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 870/1732] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:21 2022] PUT /identity/v3/projects/4ea9d5071cf64493ad123d1e92482966/users/2dabf047a08a481da67f5fcf0b5035e6/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:21.233987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f239a1e-f489-4d58-8c7f-0a73bf3c4a4c None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:21.233987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f239a1e-f489-4d58-8c7f-0a73bf3c4a4c None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:21.233987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f239a1e-f489-4d58-8c7f-0a73bf3c4a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:21.279094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-5f239a1e-f489-4d58-8c7f-0a73bf3c4a4c None None] MFA Rules not processed for user `2dabf047a08a481da67f5fcf0b5035e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:21.280738 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-5f239a1e-f489-4d58-8c7f-0a73bf3c4a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:21.288556 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:21.387202 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a38885-1bfc-4fca-855f-2399eba2eb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:21.389391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a38885-1bfc-4fca-855f-2399eba2eb1a admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:21.389391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a38885-1bfc-4fca-855f-2399eba2eb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:21.389391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a38885-1bfc-4fca-855f-2399eba2eb1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:21.389391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a38885-1bfc-4fca-855f-2399eba2eb1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:21:21.389672 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a38885-1bfc-4fca-855f-2399eba2eb1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:21.392405 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a38885-1bfc-4fca-855f-2399eba2eb1a admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:21.426025 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 863/1733] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:21:21.426025 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3753953-2415-49ed-9068-2b08256c45d8 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:21.426025 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3753953-2415-49ed-9068-2b08256c45d8 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:21.432742 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3753953-2415-49ed-9068-2b08256c45d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:21.459143 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 871/1734] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:21:21.461017 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f239a1e-f489-4d58-8c7f-0a73bf3c4a4c None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:21.479572 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f239a1e-f489-4d58-8c7f-0a73bf3c4a4c None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:21.486131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e61b90-37da-40fc-8fa5-0730e7d81167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:21.487066 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e61b90-37da-40fc-8fa5-0730e7d81167 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:21.487548 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e61b90-37da-40fc-8fa5-0730e7d81167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:21.488133 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e61b90-37da-40fc-8fa5-0730e7d81167 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:21.489419 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e61b90-37da-40fc-8fa5-0730e7d81167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:21.492525 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e61b90-37da-40fc-8fa5-0730e7d81167 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:21.590262 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 872/1735] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:21:21 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:21.591953 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e61b90-37da-40fc-8fa5-0730e7d81167 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:21.599464 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d0e61b90-37da-40fc-8fa5-0730e7d81167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:21.611389 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-c3753953-2415-49ed-9068-2b08256c45d8 None None] MFA Rules not processed for user `388330e61ade4f188c40c11c4ac46fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:21.615920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-c3753953-2415-49ed-9068-2b08256c45d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:21.821851 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 864/1736] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:21.822888 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e61b90-37da-40fc-8fa5-0730e7d81167 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:21.823863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3753953-2415-49ed-9068-2b08256c45d8 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:21.827634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50123c-fac8-4cec-93fb-2a27f0c4dc9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:21.828370 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50123c-fac8-4cec-93fb-2a27f0c4dc9d service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:21.829701 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50123c-fac8-4cec-93fb-2a27f0c4dc9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:21.830017 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50123c-fac8-4cec-93fb-2a27f0c4dc9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:21.837771 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:21.972049 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3753953-2415-49ed-9068-2b08256c45d8 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:21.989076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b801b91-4588-4326-83de-3b77de057c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:21.990306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b801b91-4588-4326-83de-3b77de057c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:21.990585 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b801b91-4588-4326-83de-3b77de057c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:21.990859 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b801b91-4588-4326-83de-3b77de057c0a admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:21.991670 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b801b91-4588-4326-83de-3b77de057c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:21.993644 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b801b91-4588-4326-83de-3b77de057c0a admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:22.105433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50123c-fac8-4cec-93fb-2a27f0c4dc9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:22.107546 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50123c-fac8-4cec-93fb-2a27f0c4dc9d service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:22.142377 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 865/1737] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:21:21 2022] POST /identity/v3/users => generated 290 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:22.147075 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b801b91-4588-4326-83de-3b77de057c0a admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:22.147660 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 873/1738] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:22.177601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b801b91-4588-4326-83de-3b77de057c0a admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:22.191884 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdabd7-d4be-469a-93d1-9bfeb63cd560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:22.193207 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdabd7-d4be-469a-93d1-9bfeb63cd560 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:22.196939 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdabd7-d4be-469a-93d1-9bfeb63cd560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:22.197449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdabd7-d4be-469a-93d1-9bfeb63cd560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:22.198482 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdabd7-d4be-469a-93d1-9bfeb63cd560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:22.200375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdabd7-d4be-469a-93d1-9bfeb63cd560 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:22.237434 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 866/1739] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:22.242352 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50123c-fac8-4cec-93fb-2a27f0c4dc9d service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:22.265798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50123c-fac8-4cec-93fb-2a27f0c4dc9d service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:22.303771 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1586c68-6998-460c-b86b-a4f827ecb8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:22.303771 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1586c68-6998-460c-b86b-a4f827ecb8ad admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:22.309489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1586c68-6998-460c-b86b-a4f827ecb8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:22.309981 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1586c68-6998-460c-b86b-a4f827ecb8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:22.318400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1586c68-6998-460c-b86b-a4f827ecb8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:22.326790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1586c68-6998-460c-b86b-a4f827ecb8ad admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:22.343303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdabd7-d4be-469a-93d1-9bfeb63cd560 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:22.414225 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 874/1740] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:22.416808 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1586c68-6998-460c-b86b-a4f827ecb8ad admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:22.452382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1586c68-6998-460c-b86b-a4f827ecb8ad admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:22.483105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa794ff8-545c-4eb9-a621-02941f78acf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:22.502378 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794ff8-545c-4eb9-a621-02941f78acf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:22.502682 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794ff8-545c-4eb9-a621-02941f78acf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:22.502967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794ff8-545c-4eb9-a621-02941f78acf4 admin admin] PATH_INFO: `/v3/projects/d9c2e1c04d3d4a319a871f65b61e513d/users/df1adcbd70434d38b21324783c42379f/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:22.556104 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdabd7-d4be-469a-93d1-9bfeb63cd560 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:22.571080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa794ff8-545c-4eb9-a621-02941f78acf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c2e1c04d3d4a319a871f65b61e513d, user_id=df1adcbd70434d38b21324783c42379f, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:22.574068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0082f-f318-4dd3-887b-bb425e92061f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:22.575022 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0082f-f318-4dd3-887b-bb425e92061f service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:22.575520 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0082f-f318-4dd3-887b-bb425e92061f service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:22.575926 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0082f-f318-4dd3-887b-bb425e92061f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:22.585777 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa794ff8-545c-4eb9-a621-02941f78acf4 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:22.588471 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0082f-f318-4dd3-887b-bb425e92061f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:22.588633 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:22.591556 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0082f-f318-4dd3-887b-bb425e92061f service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:22.605431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 867/1741] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:22.607432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0082f-f318-4dd3-887b-bb425e92061f service nova] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:22.623921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0082f-f318-4dd3-887b-bb425e92061f service nova] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:22.660284 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498be22f-5962-46ab-b29c-530f8befc663 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:22.665864 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498be22f-5962-46ab-b29c-530f8befc663 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:22.666294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498be22f-5962-46ab-b29c-530f8befc663 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:22.669009 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498be22f-5962-46ab-b29c-530f8befc663 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:22.680682 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 875/1742] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:22 2022] PUT /identity/v3/projects/d9c2e1c04d3d4a319a871f65b61e513d/users/df1adcbd70434d38b21324783c42379f/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:22.689851 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-498be22f-5962-46ab-b29c-530f8befc663 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:22.693048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170043d3-1549-40e3-8383-4f4a965fd46c None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:22.693339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170043d3-1549-40e3-8383-4f4a965fd46c None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:22.693620 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170043d3-1549-40e3-8383-4f4a965fd46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:22.789653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-170043d3-1549-40e3-8383-4f4a965fd46c None None] MFA Rules not processed for user `df1adcbd70434d38b21324783c42379f`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:22.793870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-170043d3-1549-40e3-8383-4f4a965fd46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:22.899083 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498be22f-5962-46ab-b29c-530f8befc663 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:22.901558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498be22f-5962-46ab-b29c-530f8befc663 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:22.945542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 868/1743] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:23.118454 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 876/1744] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:21:23.119078 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498be22f-5962-46ab-b29c-530f8befc663 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:23.141552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498be22f-5962-46ab-b29c-530f8befc663 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:23.178461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:23.235755 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170043d3-1549-40e3-8383-4f4a965fd46c None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:23.237351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-170043d3-1549-40e3-8383-4f4a965fd46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:23.481928 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170043d3-1549-40e3-8383-4f4a965fd46c None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:23.500708 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f41c7-e9f0-4f4d-a63d-fe5bbd7f4efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:23.501505 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f41c7-e9f0-4f4d-a63d-fe5bbd7f4efd service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:23.512384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f41c7-e9f0-4f4d-a63d-fe5bbd7f4efd service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:23.517759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8541353-393c-4855-9332-9298163ef9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:23.518477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8541353-393c-4855-9332-9298163ef9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:23.518602 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f41c7-e9f0-4f4d-a63d-fe5bbd7f4efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:23.521879 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a89f41c7-e9f0-4f4d-a63d-fe5bbd7f4efd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:23.522330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8541353-393c-4855-9332-9298163ef9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:23.522835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8541353-393c-4855-9332-9298163ef9c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:23.524710 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8541353-393c-4855-9332-9298163ef9c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:23.537478 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8541353-393c-4855-9332-9298163ef9c4 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:23.797292 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 869/1745] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:21:23 2022] POST /identity/v3/projects => generated 381 bytes in 677 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:21:23.800085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8541353-393c-4855-9332-9298163ef9c4 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:23.902912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f41c7-e9f0-4f4d-a63d-fe5bbd7f4efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:23.908030 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f41c7-e9f0-4f4d-a63d-fe5bbd7f4efd service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:23.964787 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 877/1746] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:23 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 730 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:21:24.106047 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8541353-393c-4855-9332-9298163ef9c4 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:24.119279 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978aecd5-cbf6-499f-9652-eb385039c155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:24.120038 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978aecd5-cbf6-499f-9652-eb385039c155 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:24.128199 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978aecd5-cbf6-499f-9652-eb385039c155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:24.128404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978aecd5-cbf6-499f-9652-eb385039c155 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:24.130369 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978aecd5-cbf6-499f-9652-eb385039c155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:24.134101 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978aecd5-cbf6-499f-9652-eb385039c155 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:24.276444 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 870/1747] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:21:23 2022] POST /identity/v3/users => generated 297 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:24.281416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f41c7-e9f0-4f4d-a63d-fe5bbd7f4efd service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:24.315339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f41c7-e9f0-4f4d-a63d-fe5bbd7f4efd service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:24.337469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1310b-b30a-4c99-806b-49ec2e40b391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:24.338362 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1310b-b30a-4c99-806b-49ec2e40b391 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:24.338659 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1310b-b30a-4c99-806b-49ec2e40b391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:24.338940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1310b-b30a-4c99-806b-49ec2e40b391 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:24.339692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1310b-b30a-4c99-806b-49ec2e40b391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:24.345577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1310b-b30a-4c99-806b-49ec2e40b391 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:24.396300 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 878/1748] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:24.400083 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978aecd5-cbf6-499f-9652-eb385039c155 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:24.430017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978aecd5-cbf6-499f-9652-eb385039c155 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:24.445801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2673a-f0fb-4ac3-adb8-d204ec7a4666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:24.448305 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2673a-f0fb-4ac3-adb8-d204ec7a4666 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:24.448964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2673a-f0fb-4ac3-adb8-d204ec7a4666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:24.450256 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2673a-f0fb-4ac3-adb8-d204ec7a4666 admin admin] PATH_INFO: `/v3/projects/24c668d12a6e4d7687278a3b25eff762/users/fa4bea1e150e4a6b8e31b6745caab509/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:24.503433 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2673a-f0fb-4ac3-adb8-d204ec7a4666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c668d12a6e4d7687278a3b25eff762, user_id=fa4bea1e150e4a6b8e31b6745caab509, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:24.520416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2673a-f0fb-4ac3-adb8-d204ec7a4666 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:24.632183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 871/1749] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:24 2022] PUT /identity/v3/projects/24c668d12a6e4d7687278a3b25eff762/users/fa4bea1e150e4a6b8e31b6745caab509/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:24.636527 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1310b-b30a-4c99-806b-49ec2e40b391 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:24.658434 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1310b-b30a-4c99-806b-49ec2e40b391 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:24.756508 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:24.894678 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebf88f-c29f-4c81-8292-40533afe97a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:24.896119 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebf88f-c29f-4c81-8292-40533afe97a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:24.897823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebf88f-c29f-4c81-8292-40533afe97a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:24.898321 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebf88f-c29f-4c81-8292-40533afe97a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:24.900976 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebf88f-c29f-4c81-8292-40533afe97a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:24.916107 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebf88f-c29f-4c81-8292-40533afe97a8 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:24.930499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 879/1750] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:24.934586 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2673a-f0fb-4ac3-adb8-d204ec7a4666 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:24.975973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2673a-f0fb-4ac3-adb8-d204ec7a4666 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:24.990981 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e350161-cf47-4e3f-b045-97d132414b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:24.996310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e350161-cf47-4e3f-b045-97d132414b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:24.996890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e350161-cf47-4e3f-b045-97d132414b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:24.997314 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e350161-cf47-4e3f-b045-97d132414b7e admin admin] PATH_INFO: `/v3/projects/24c668d12a6e4d7687278a3b25eff762/users/fa4bea1e150e4a6b8e31b6745caab509/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:25.001903 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e350161-cf47-4e3f-b045-97d132414b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c668d12a6e4d7687278a3b25eff762, user_id=fa4bea1e150e4a6b8e31b6745caab509, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:25.024500 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e350161-cf47-4e3f-b045-97d132414b7e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:25.091460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 872/1751] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:24 2022] PUT /identity/v3/projects/24c668d12a6e4d7687278a3b25eff762/users/fa4bea1e150e4a6b8e31b6745caab509/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:25.093426 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0aef67-f2b2-40b4-85e5-5d22fdc02c43 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:25.094693 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0aef67-f2b2-40b4-85e5-5d22fdc02c43 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:25.097364 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0aef67-f2b2-40b4-85e5-5d22fdc02c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:25.146962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-7b0aef67-f2b2-40b4-85e5-5d22fdc02c43 None None] MFA Rules not processed for user `fa4bea1e150e4a6b8e31b6745caab509`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:25.150514 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-7b0aef67-f2b2-40b4-85e5-5d22fdc02c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:25.422473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 880/1752] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:21:25.443076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e350161-cf47-4e3f-b045-97d132414b7e admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:25.656975 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:25.693817 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e350161-cf47-4e3f-b045-97d132414b7e admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:25.711081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c453a2-93d2-46f9-93b0-8abe0a5739f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:25.711827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c453a2-93d2-46f9-93b0-8abe0a5739f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:25.712227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c453a2-93d2-46f9-93b0-8abe0a5739f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:25.712572 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c453a2-93d2-46f9-93b0-8abe0a5739f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:25.731076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c453a2-93d2-46f9-93b0-8abe0a5739f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:25.732887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c453a2-93d2-46f9-93b0-8abe0a5739f3 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:25.747009 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 873/1753] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:26.067407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0aef67-f2b2-40b4-85e5-5d22fdc02c43 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:26.083903 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0aef67-f2b2-40b4-85e5-5d22fdc02c43 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:26.096830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256ed72-0aec-4c31-938c-5262689d7b5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:26.097932 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256ed72-0aec-4c31-938c-5262689d7b5e service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:26.101112 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256ed72-0aec-4c31-938c-5262689d7b5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:26.101112 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256ed72-0aec-4c31-938c-5262689d7b5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:26.271870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256ed72-0aec-4c31-938c-5262689d7b5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:26.281016 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256ed72-0aec-4c31-938c-5262689d7b5e service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:26.331240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 881/1754] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:28.380038 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680133b-9ab3-40fa-abec-9316d0da7a73 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:28.381347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680133b-9ab3-40fa-abec-9316d0da7a73 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:28.381829 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680133b-9ab3-40fa-abec-9316d0da7a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:28.432679 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-a680133b-9ab3-40fa-abec-9316d0da7a73 None None] MFA Rules not processed for user `7d524a8208354c2099eb3b41b0f53de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:28.434046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-a680133b-9ab3-40fa-abec-9316d0da7a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:28.689785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 874/1755] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:21:29.254969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b1c41-a4db-4a9f-8319-ec745a217472 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:29.256169 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b1c41-a4db-4a9f-8319-ec745a217472 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:29.256677 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b1c41-a4db-4a9f-8319-ec745a217472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:29.295646 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-e55b1c41-a4db-4a9f-8319-ec745a217472 None None] MFA Rules not processed for user `46e692bef3e3484ebac5d1563e489e03`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:29.297369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-e55b1c41-a4db-4a9f-8319-ec745a217472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:29.389930 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:29.478533 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 882/1756] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:30.507619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fc8fc-c7fe-4e79-b18d-50346e2d72e5 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:30.508103 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fc8fc-c7fe-4e79-b18d-50346e2d72e5 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:30.508932 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fc8fc-c7fe-4e79-b18d-50346e2d72e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:30.539076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-984fc8fc-c7fe-4e79-b18d-50346e2d72e5 None None] MFA Rules not processed for user `388330e61ade4f188c40c11c4ac46fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:30.540464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-984fc8fc-c7fe-4e79-b18d-50346e2d72e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:30.670498 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 875/1757] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:30.788919 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f06600-8c94-4336-b45f-7aed506b4f10 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:30.789848 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f06600-8c94-4336-b45f-7aed506b4f10 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:30.790282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f06600-8c94-4336-b45f-7aed506b4f10 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:30.792445 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 883/1758] 10.222.0.66 () {54 vars in 912 bytes} [Thu May 26 21:21:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:21:30.810770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1083a8-645e-4d5b-8529-6aaa4cd0a949 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:30.810962 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1083a8-645e-4d5b-8529-6aaa4cd0a949 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:30.811382 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1083a8-645e-4d5b-8529-6aaa4cd0a949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:30.872780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-aa1083a8-645e-4d5b-8529-6aaa4cd0a949 None None] MFA Rules not processed for user `98ec4e37c2714729afec6ad805ed775a`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:30.874999 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-aa1083a8-645e-4d5b-8529-6aaa4cd0a949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:31.191155 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 876/1759] 10.222.0.66 () {58 vars in 1009 bytes} [Thu May 26 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:31.192633 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f06600-8c94-4336-b45f-7aed506b4f10 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:31.192633 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-c3f06600-8c94-4336-b45f-7aed506b4f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:31.192633 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f06600-8c94-4336-b45f-7aed506b4f10 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:31.195210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfcc39-f62a-42d8-a888-73ac9958b6ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:31.195210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfcc39-f62a-42d8-a888-73ac9958b6ba service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:31.195210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfcc39-f62a-42d8-a888-73ac9958b6ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:31.195210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfcc39-f62a-42d8-a888-73ac9958b6ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:31.197263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfcc39-f62a-42d8-a888-73ac9958b6ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:31.197263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfcc39-f62a-42d8-a888-73ac9958b6ba service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:31.200915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 884/1760] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:31.926332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa89a4-5151-40d9-be5b-eb9c4aae27a5 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:31.926931 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa89a4-5151-40d9-be5b-eb9c4aae27a5 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:31.927014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa89a4-5151-40d9-be5b-eb9c4aae27a5 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:31.935286 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 877/1761] 10.222.0.66 () {54 vars in 921 bytes} [Thu May 26 21:21:31 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:21:31.957119 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471886dd-416b-4852-939f-8e1151082fd9 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:31.958626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471886dd-416b-4852-939f-8e1151082fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:31.959125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471886dd-416b-4852-939f-8e1151082fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:31.989328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-471886dd-416b-4852-939f-8e1151082fd9 None None] MFA Rules not processed for user `df008eed25464be387741ee7a1e5ce80`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:31.991270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-471886dd-416b-4852-939f-8e1151082fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:32.142829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 885/1762] 10.222.0.66 () {58 vars in 1018 bytes} [Thu May 26 21:21:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:32.594480 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa89a4-5151-40d9-be5b-eb9c4aae27a5 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:32.620152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa89a4-5151-40d9-be5b-eb9c4aae27a5 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:32.629493 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837a6fa-454d-4a30-8cf6-5c620664befb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:32.630165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837a6fa-454d-4a30-8cf6-5c620664befb service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:32.630448 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837a6fa-454d-4a30-8cf6-5c620664befb service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:32.630725 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837a6fa-454d-4a30-8cf6-5c620664befb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:32.641078 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837a6fa-454d-4a30-8cf6-5c620664befb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:32.643010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837a6fa-454d-4a30-8cf6-5c620664befb service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:32.658230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 878/1763] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:34.149056 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471886dd-416b-4852-939f-8e1151082fd9 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:34.232649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471886dd-416b-4852-939f-8e1151082fd9 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:34.243221 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91609d1-e1a5-41ea-9701-5cb487df25ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:34.244203 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91609d1-e1a5-41ea-9701-5cb487df25ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:34.244482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91609d1-e1a5-41ea-9701-5cb487df25ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:34.244793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91609d1-e1a5-41ea-9701-5cb487df25ef admin admin] PATH_INFO: `/v3/users/7dbc97343bb94e76b16d72be0c865687` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:34.246252 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91609d1-e1a5-41ea-9701-5cb487df25ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dbc97343bb94e76b16d72be0c865687)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:34.248285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91609d1-e1a5-41ea-9701-5cb487df25ef admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:34.507888 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-b91609d1-e1a5-41ea-9701-5cb487df25ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dbc97343bb94e76b16d72be0c865687'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:34.508561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-b91609d1-e1a5-41ea-9701-5cb487df25ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dbc97343bb94e76b16d72be0c865687'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:34.509258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-b91609d1-e1a5-41ea-9701-5cb487df25ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dbc97343bb94e76b16d72be0c865687'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:34.527292 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-b91609d1-e1a5-41ea-9701-5cb487df25ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dbc97343bb94e76b16d72be0c865687'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:34.529541 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:34.535428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-b91609d1-e1a5-41ea-9701-5cb487df25ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dbc97343bb94e76b16d72be0c865687'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:34.618602 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 886/1764] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:21:34 2022] DELETE /identity/v3/users/7dbc97343bb94e76b16d72be0c865687 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:34.623149 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d7138-1d7b-4a35-979c-e14c6acdfad0 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:34.623672 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d7138-1d7b-4a35-979c-e14c6acdfad0 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:34.623759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d7138-1d7b-4a35-979c-e14c6acdfad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:34.641427 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-d00d7138-1d7b-4a35-979c-e14c6acdfad0 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:34.642633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d00d7138-1d7b-4a35-979c-e14c6acdfad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:34.674744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:34.704022 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 879/1765] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:34.714553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91609d1-e1a5-41ea-9701-5cb487df25ef admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:34.715931 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b91609d1-e1a5-41ea-9701-5cb487df25ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:34.773751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91609d1-e1a5-41ea-9701-5cb487df25ef admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:34.777496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813ad96-74b8-4aaf-8aa6-3b42679fa6bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:34.778158 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813ad96-74b8-4aaf-8aa6-3b42679fa6bb service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:34.778436 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813ad96-74b8-4aaf-8aa6-3b42679fa6bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:34.778713 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813ad96-74b8-4aaf-8aa6-3b42679fa6bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:34.791144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813ad96-74b8-4aaf-8aa6-3b42679fa6bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:34.792752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813ad96-74b8-4aaf-8aa6-3b42679fa6bb service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:34.803519 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 887/1766] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:35.248144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d7138-1d7b-4a35-979c-e14c6acdfad0 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:35.249671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d00d7138-1d7b-4a35-979c-e14c6acdfad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:35.262898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d7138-1d7b-4a35-979c-e14c6acdfad0 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:35.269095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57338a1b-d302-45bd-94e1-feb0cef65eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:35.269962 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57338a1b-d302-45bd-94e1-feb0cef65eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:35.270251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57338a1b-d302-45bd-94e1-feb0cef65eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:35.270532 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57338a1b-d302-45bd-94e1-feb0cef65eb5 admin admin] PATH_INFO: `/v3/projects/e9ece08b45fa4e679e9d3b3b18df8bee` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:35.271764 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57338a1b-d302-45bd-94e1-feb0cef65eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ece08b45fa4e679e9d3b3b18df8bee)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:35.282701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57338a1b-d302-45bd-94e1-feb0cef65eb5 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:35.411421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-57338a1b-d302-45bd-94e1-feb0cef65eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ece08b45fa4e679e9d3b3b18df8bee', 'request_id': 'req-57338a1b-d302-45bd-94e1-feb0cef65eb5'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:35.426841 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-57338a1b-d302-45bd-94e1-feb0cef65eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ece08b45fa4e679e9d3b3b18df8bee', 'request_id': 'req-57338a1b-d302-45bd-94e1-feb0cef65eb5'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:35.509178 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-57338a1b-d302-45bd-94e1-feb0cef65eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ece08b45fa4e679e9d3b3b18df8bee', 'request_id': 'req-57338a1b-d302-45bd-94e1-feb0cef65eb5'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:35.521189 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-57338a1b-d302-45bd-94e1-feb0cef65eb5 admin admin] The token cache is being invalidate because project e9ece08b45fa4e679e9d3b3b18df8bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:21:35.521481 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-57338a1b-d302-45bd-94e1-feb0cef65eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:35.522141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-57338a1b-d302-45bd-94e1-feb0cef65eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:35.523755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 880/1767] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:21:35 2022] DELETE /identity/v3/projects/e9ece08b45fa4e679e9d3b3b18df8bee => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:35.527872 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813ad96-74b8-4aaf-8aa6-3b42679fa6bb service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:35.538982 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813ad96-74b8-4aaf-8aa6-3b42679fa6bb service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:35.599812 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b933e73-a3f6-414f-9fb0-c07c21c0425d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:35.601362 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b933e73-a3f6-414f-9fb0-c07c21c0425d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:35.601649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b933e73-a3f6-414f-9fb0-c07c21c0425d admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:35.601930 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b933e73-a3f6-414f-9fb0-c07c21c0425d admin admin] PATH_INFO: `/v3/users/2dabf047a08a481da67f5fcf0b5035e6` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:35.603301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b933e73-a3f6-414f-9fb0-c07c21c0425d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dabf047a08a481da67f5fcf0b5035e6)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:35.605481 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b933e73-a3f6-414f-9fb0-c07c21c0425d admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:35.815289 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-6b933e73-a3f6-414f-9fb0-c07c21c0425d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dabf047a08a481da67f5fcf0b5035e6'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:35.815988 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-6b933e73-a3f6-414f-9fb0-c07c21c0425d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dabf047a08a481da67f5fcf0b5035e6'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:35.816662 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-6b933e73-a3f6-414f-9fb0-c07c21c0425d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dabf047a08a481da67f5fcf0b5035e6'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:35.828520 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-6b933e73-a3f6-414f-9fb0-c07c21c0425d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dabf047a08a481da67f5fcf0b5035e6'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:35.835923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-6b933e73-a3f6-414f-9fb0-c07c21c0425d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dabf047a08a481da67f5fcf0b5035e6'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:35.955391 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 888/1768] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:21:35 2022] DELETE /identity/v3/users/2dabf047a08a481da67f5fcf0b5035e6 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:37.287787 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57338a1b-d302-45bd-94e1-feb0cef65eb5 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:37.290411 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-57338a1b-d302-45bd-94e1-feb0cef65eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:37.305649 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57338a1b-d302-45bd-94e1-feb0cef65eb5 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:37.366641 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72487118-3712-4581-b7d6-548b05bd22bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:37.367510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72487118-3712-4581-b7d6-548b05bd22bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:37.367792 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72487118-3712-4581-b7d6-548b05bd22bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:37.368066 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72487118-3712-4581-b7d6-548b05bd22bc admin admin] PATH_INFO: `/v3/projects/4ea9d5071cf64493ad123d1e92482966` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:37.369248 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72487118-3712-4581-b7d6-548b05bd22bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea9d5071cf64493ad123d1e92482966)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:37.371127 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72487118-3712-4581-b7d6-548b05bd22bc admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:37.572211 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-72487118-3712-4581-b7d6-548b05bd22bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea9d5071cf64493ad123d1e92482966', 'request_id': 'req-72487118-3712-4581-b7d6-548b05bd22bc'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:37.578113 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-72487118-3712-4581-b7d6-548b05bd22bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea9d5071cf64493ad123d1e92482966', 'request_id': 'req-72487118-3712-4581-b7d6-548b05bd22bc'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:37.581226 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:37.692232 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-72487118-3712-4581-b7d6-548b05bd22bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea9d5071cf64493ad123d1e92482966', 'request_id': 'req-72487118-3712-4581-b7d6-548b05bd22bc'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:37.703931 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-72487118-3712-4581-b7d6-548b05bd22bc admin admin] The token cache is being invalidate because project 4ea9d5071cf64493ad123d1e92482966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:21:37.704213 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-72487118-3712-4581-b7d6-548b05bd22bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:37.704894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-72487118-3712-4581-b7d6-548b05bd22bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:37.706468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 881/1769] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:21:37 2022] DELETE /identity/v3/projects/4ea9d5071cf64493ad123d1e92482966 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:37.711317 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c7968-27b1-47f5-8ec3-d10b92e21e66 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:37.711788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c7968-27b1-47f5-8ec3-d10b92e21e66 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:37.711879 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c7968-27b1-47f5-8ec3-d10b92e21e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:37.724636 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:37.730880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-7d6c7968-27b1-47f5-8ec3-d10b92e21e66 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:37.732084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-7d6c7968-27b1-47f5-8ec3-d10b92e21e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:37.794272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 889/1770] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:37.802932 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2fb4d-e165-416d-aa16-f1ea7a5161cb None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:37.803225 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2fb4d-e165-416d-aa16-f1ea7a5161cb None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:37.803506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2fb4d-e165-416d-aa16-f1ea7a5161cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:37.822908 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-37d2fb4d-e165-416d-aa16-f1ea7a5161cb None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:37.824777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-37d2fb4d-e165-416d-aa16-f1ea7a5161cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:37.832493 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 882/1771] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:37.836962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c7968-27b1-47f5-8ec3-d10b92e21e66 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:37.846993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c7968-27b1-47f5-8ec3-d10b92e21e66 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:37.852147 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87daba-ab70-4ca3-8c9b-45f79184e4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:37.852844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87daba-ab70-4ca3-8c9b-45f79184e4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:37.853384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87daba-ab70-4ca3-8c9b-45f79184e4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:37.853384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87daba-ab70-4ca3-8c9b-45f79184e4e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:37.854112 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87daba-ab70-4ca3-8c9b-45f79184e4e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:21:37.854420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87daba-ab70-4ca3-8c9b-45f79184e4e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:37.856019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87daba-ab70-4ca3-8c9b-45f79184e4e9 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:37.868873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 890/1772] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:21:37.873828 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2fb4d-e165-416d-aa16-f1ea7a5161cb None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:37.883061 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2fb4d-e165-416d-aa16-f1ea7a5161cb None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:37.887702 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f69c3-9b97-4b25-b542-62af42e25746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:37.888365 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f69c3-9b97-4b25-b542-62af42e25746 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:37.888671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f69c3-9b97-4b25-b542-62af42e25746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:37.888952 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f69c3-9b97-4b25-b542-62af42e25746 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:37.889643 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f69c3-9b97-4b25-b542-62af42e25746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:37.891518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f69c3-9b97-4b25-b542-62af42e25746 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:37.960707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 883/1773] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:21:37 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:37.962043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87daba-ab70-4ca3-8c9b-45f79184e4e9 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:37.972401 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87daba-ab70-4ca3-8c9b-45f79184e4e9 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:38.038865 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58ab94-14c5-4079-9518-8aa0063d72a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:38.039530 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58ab94-14c5-4079-9518-8aa0063d72a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:38.039814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58ab94-14c5-4079-9518-8aa0063d72a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:38.040096 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58ab94-14c5-4079-9518-8aa0063d72a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:38.040955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58ab94-14c5-4079-9518-8aa0063d72a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:38.043029 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58ab94-14c5-4079-9518-8aa0063d72a3 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:38.201099 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 891/1774] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:21:37 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:38.205341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f69c3-9b97-4b25-b542-62af42e25746 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:38.222577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f69c3-9b97-4b25-b542-62af42e25746 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:38.222577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02f752-8ffa-4d39-9716-309d17309633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:38.222577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02f752-8ffa-4d39-9716-309d17309633 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:38.222577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02f752-8ffa-4d39-9716-309d17309633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:38.223639 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02f752-8ffa-4d39-9716-309d17309633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:38.223639 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02f752-8ffa-4d39-9716-309d17309633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:38.225065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02f752-8ffa-4d39-9716-309d17309633 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:38.235310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 884/1775] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:38.239518 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58ab94-14c5-4079-9518-8aa0063d72a3 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:38.250091 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58ab94-14c5-4079-9518-8aa0063d72a3 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:38.255803 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc48780-2699-4363-98dd-743634c4dfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:38.256472 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc48780-2699-4363-98dd-743634c4dfef admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:38.256913 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc48780-2699-4363-98dd-743634c4dfef admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:38.257297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc48780-2699-4363-98dd-743634c4dfef admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:38.257961 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc48780-2699-4363-98dd-743634c4dfef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:38.259789 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc48780-2699-4363-98dd-743634c4dfef admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:38.271023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 892/1776] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:38.275329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02f752-8ffa-4d39-9716-309d17309633 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:38.286360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02f752-8ffa-4d39-9716-309d17309633 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:38.291286 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21fa3f-5d52-4f21-87d4-ea442cccc502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:38.292233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21fa3f-5d52-4f21-87d4-ea442cccc502 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:38.292460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21fa3f-5d52-4f21-87d4-ea442cccc502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:38.293197 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21fa3f-5d52-4f21-87d4-ea442cccc502 admin admin] PATH_INFO: `/v3/projects/63f66f399537417098c59f1428f3b00a/users/b3720ac131584ebeac3cdafdadb67975/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:38.309851 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21fa3f-5d52-4f21-87d4-ea442cccc502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f66f399537417098c59f1428f3b00a, user_id=b3720ac131584ebeac3cdafdadb67975, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:38.312513 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21fa3f-5d52-4f21-87d4-ea442cccc502 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:38.402198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 885/1777] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:38 2022] PUT /identity/v3/projects/63f66f399537417098c59f1428f3b00a/users/b3720ac131584ebeac3cdafdadb67975/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:38.413376 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103667d-637b-4975-bc0d-7af699631b86 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:38.413687 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103667d-637b-4975-bc0d-7af699631b86 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:38.413972 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103667d-637b-4975-bc0d-7af699631b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:38.451724 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-9103667d-637b-4975-bc0d-7af699631b86 None None] MFA Rules not processed for user `b3720ac131584ebeac3cdafdadb67975`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:38.452997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-9103667d-637b-4975-bc0d-7af699631b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:38.521861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 893/1778] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:38.526567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21fa3f-5d52-4f21-87d4-ea442cccc502 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:38.593801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21fa3f-5d52-4f21-87d4-ea442cccc502 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:38.599034 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84626e52-dc6e-4b2c-925d-3e027cdf8e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:38.599717 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84626e52-dc6e-4b2c-925d-3e027cdf8e68 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:38.599997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84626e52-dc6e-4b2c-925d-3e027cdf8e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:38.600274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84626e52-dc6e-4b2c-925d-3e027cdf8e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:38.601015 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84626e52-dc6e-4b2c-925d-3e027cdf8e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:38.602912 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84626e52-dc6e-4b2c-925d-3e027cdf8e68 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:38.723527 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 886/1779] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:21:38 2022] POST /identity/v3/projects => generated 387 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:38.727649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103667d-637b-4975-bc0d-7af699631b86 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:38.733283 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:38.740287 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103667d-637b-4975-bc0d-7af699631b86 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:38.799814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee20cd-a20f-46ac-b203-d135eb0446d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:38.800484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee20cd-a20f-46ac-b203-d135eb0446d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:38.808569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee20cd-a20f-46ac-b203-d135eb0446d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:38.808569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee20cd-a20f-46ac-b203-d135eb0446d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:38.808569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee20cd-a20f-46ac-b203-d135eb0446d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:38.808569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee20cd-a20f-46ac-b203-d135eb0446d1 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:38.903044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 894/1780] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:21:38 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:38.907511 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84626e52-dc6e-4b2c-925d-3e027cdf8e68 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:38.918494 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84626e52-dc6e-4b2c-925d-3e027cdf8e68 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:38.923344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e8535-df88-4444-b746-59e6f54353d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:38.924016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e8535-df88-4444-b746-59e6f54353d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:38.924300 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e8535-df88-4444-b746-59e6f54353d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:38.924601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e8535-df88-4444-b746-59e6f54353d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:38.925343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e8535-df88-4444-b746-59e6f54353d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:38.926973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e8535-df88-4444-b746-59e6f54353d8 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:38.937479 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 887/1781] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:38.941760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee20cd-a20f-46ac-b203-d135eb0446d1 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:38.951565 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee20cd-a20f-46ac-b203-d135eb0446d1 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:38.956201 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261fd16-b224-43ad-b145-a8c2da66b507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:38.957633 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261fd16-b224-43ad-b145-a8c2da66b507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:38.957920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261fd16-b224-43ad-b145-a8c2da66b507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:38.958194 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261fd16-b224-43ad-b145-a8c2da66b507 admin admin] PATH_INFO: `/v3/projects/b65d8e2d1a4d4f4d88f59c1094885b71/users/cc3c1a1ba47b4eb5aee5ef751eb12b41/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:38.973531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261fd16-b224-43ad-b145-a8c2da66b507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65d8e2d1a4d4f4d88f59c1094885b71, user_id=cc3c1a1ba47b4eb5aee5ef751eb12b41, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:38.976180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261fd16-b224-43ad-b145-a8c2da66b507 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:39.075067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 895/1782] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:38 2022] PUT /identity/v3/projects/b65d8e2d1a4d4f4d88f59c1094885b71/users/cc3c1a1ba47b4eb5aee5ef751eb12b41/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:39.079328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e8535-df88-4444-b746-59e6f54353d8 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:39.090292 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e8535-df88-4444-b746-59e6f54353d8 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:39.157166 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5e415-ebc1-4891-9191-6ce1225380b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:39.159957 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5e415-ebc1-4891-9191-6ce1225380b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:39.159957 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5e415-ebc1-4891-9191-6ce1225380b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:39.159957 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5e415-ebc1-4891-9191-6ce1225380b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:39.159957 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5e415-ebc1-4891-9191-6ce1225380b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:39.160941 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5e415-ebc1-4891-9191-6ce1225380b2 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:39.162870 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:39.176762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 888/1783] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:39.180655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261fd16-b224-43ad-b145-a8c2da66b507 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:39.194079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261fd16-b224-43ad-b145-a8c2da66b507 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:39.199506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a2a24-619c-49fa-bc1f-a58211d3c5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:39.200468 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a2a24-619c-49fa-bc1f-a58211d3c5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:39.201109 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a2a24-619c-49fa-bc1f-a58211d3c5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:39.201109 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a2a24-619c-49fa-bc1f-a58211d3c5b0 admin admin] PATH_INFO: `/v3/projects/b65d8e2d1a4d4f4d88f59c1094885b71/users/cc3c1a1ba47b4eb5aee5ef751eb12b41/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:39.203234 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a2a24-619c-49fa-bc1f-a58211d3c5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65d8e2d1a4d4f4d88f59c1094885b71, user_id=cc3c1a1ba47b4eb5aee5ef751eb12b41, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:39.206002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a2a24-619c-49fa-bc1f-a58211d3c5b0 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:39.220223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 896/1784] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:39 2022] PUT /identity/v3/projects/b65d8e2d1a4d4f4d88f59c1094885b71/users/cc3c1a1ba47b4eb5aee5ef751eb12b41/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:21:39.248596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a09e5-fcf1-4865-83a3-49eaf4d25508 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:39.248904 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a09e5-fcf1-4865-83a3-49eaf4d25508 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:39.249186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a09e5-fcf1-4865-83a3-49eaf4d25508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:39.276864 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-420a09e5-fcf1-4865-83a3-49eaf4d25508 None None] MFA Rules not processed for user `cc3c1a1ba47b4eb5aee5ef751eb12b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:39.278104 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-420a09e5-fcf1-4865-83a3-49eaf4d25508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:39.348066 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 889/1785] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:39.358943 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a2a24-619c-49fa-bc1f-a58211d3c5b0 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:39.360666 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2d6a2a24-619c-49fa-bc1f-a58211d3c5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:39.419299 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a2a24-619c-49fa-bc1f-a58211d3c5b0 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:39.422961 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e78316-a3f7-4c89-b849-19d646d930fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:39.423613 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e78316-a3f7-4c89-b849-19d646d930fc service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:39.423907 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e78316-a3f7-4c89-b849-19d646d930fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:39.424164 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e78316-a3f7-4c89-b849-19d646d930fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:39.434381 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e78316-a3f7-4c89-b849-19d646d930fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:39.435807 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e78316-a3f7-4c89-b849-19d646d930fc service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:39.446219 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 897/1786] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:40.685292 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a09e5-fcf1-4865-83a3-49eaf4d25508 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:40.757560 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a09e5-fcf1-4865-83a3-49eaf4d25508 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:40.762372 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b1d9d-c9a1-4a92-a65c-c77dc68d98ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:40.763260 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b1d9d-c9a1-4a92-a65c-c77dc68d98ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:40.763547 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b1d9d-c9a1-4a92-a65c-c77dc68d98ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:40.763825 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b1d9d-c9a1-4a92-a65c-c77dc68d98ca admin admin] PATH_INFO: `/v3/users/b3720ac131584ebeac3cdafdadb67975` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:40.765065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b1d9d-c9a1-4a92-a65c-c77dc68d98ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3720ac131584ebeac3cdafdadb67975)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:40.767031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b1d9d-c9a1-4a92-a65c-c77dc68d98ca admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:40.951998 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f09b1d9d-c9a1-4a92-a65c-c77dc68d98ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3720ac131584ebeac3cdafdadb67975'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:41.023308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f09b1d9d-c9a1-4a92-a65c-c77dc68d98ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3720ac131584ebeac3cdafdadb67975'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:41.023959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f09b1d9d-c9a1-4a92-a65c-c77dc68d98ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3720ac131584ebeac3cdafdadb67975'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:41.036932 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f09b1d9d-c9a1-4a92-a65c-c77dc68d98ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3720ac131584ebeac3cdafdadb67975'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:41.037619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f09b1d9d-c9a1-4a92-a65c-c77dc68d98ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3720ac131584ebeac3cdafdadb67975'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:41.046023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:41.050513 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 890/1787] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:21:40 2022] DELETE /identity/v3/users/b3720ac131584ebeac3cdafdadb67975 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:41.055454 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b09f71-60b4-46b1-bba8-db317d30a360 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:41.055961 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b09f71-60b4-46b1-bba8-db317d30a360 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:41.056042 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b09f71-60b4-46b1-bba8-db317d30a360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:41.074026 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-c8b09f71-60b4-46b1-bba8-db317d30a360 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:41.075147 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-c8b09f71-60b4-46b1-bba8-db317d30a360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:41.125524 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:41.135880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 898/1788] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:41.145867 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b1d9d-c9a1-4a92-a65c-c77dc68d98ca admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:41.147349 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f09b1d9d-c9a1-4a92-a65c-c77dc68d98ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:41.205151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b1d9d-c9a1-4a92-a65c-c77dc68d98ca admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:41.208780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d2ef5-0406-4ecb-bc64-08ac372cbd1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:41.209428 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d2ef5-0406-4ecb-bc64-08ac372cbd1f service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:41.209715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d2ef5-0406-4ecb-bc64-08ac372cbd1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:41.209990 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d2ef5-0406-4ecb-bc64-08ac372cbd1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:41.219184 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d2ef5-0406-4ecb-bc64-08ac372cbd1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:41.220729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d2ef5-0406-4ecb-bc64-08ac372cbd1f service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:41.230138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 891/1789] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:21:41.665770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b09f71-60b4-46b1-bba8-db317d30a360 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:41.667255 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-c8b09f71-60b4-46b1-bba8-db317d30a360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:41.682063 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b09f71-60b4-46b1-bba8-db317d30a360 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:41.686879 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc6f25-1238-4a77-b340-3100ca6ee59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:41.687765 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc6f25-1238-4a77-b340-3100ca6ee59b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:41.688060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc6f25-1238-4a77-b340-3100ca6ee59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:41.688340 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc6f25-1238-4a77-b340-3100ca6ee59b admin admin] PATH_INFO: `/v3/projects/63f66f399537417098c59f1428f3b00a` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:41.690662 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc6f25-1238-4a77-b340-3100ca6ee59b admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f66f399537417098c59f1428f3b00a)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:41.692382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc6f25-1238-4a77-b340-3100ca6ee59b admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:41.804889 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-7fdc6f25-1238-4a77-b340-3100ca6ee59b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f66f399537417098c59f1428f3b00a', 'request_id': 'req-7fdc6f25-1238-4a77-b340-3100ca6ee59b'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:41.875593 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-7fdc6f25-1238-4a77-b340-3100ca6ee59b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f66f399537417098c59f1428f3b00a', 'request_id': 'req-7fdc6f25-1238-4a77-b340-3100ca6ee59b'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:41.887828 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-7fdc6f25-1238-4a77-b340-3100ca6ee59b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f66f399537417098c59f1428f3b00a', 'request_id': 'req-7fdc6f25-1238-4a77-b340-3100ca6ee59b'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:41.902055 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-7fdc6f25-1238-4a77-b340-3100ca6ee59b admin admin] The token cache is being invalidate because project 63f66f399537417098c59f1428f3b00a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:21:41.902575 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-7fdc6f25-1238-4a77-b340-3100ca6ee59b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:41.903902 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-7fdc6f25-1238-4a77-b340-3100ca6ee59b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:41.906681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 899/1790] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:21:41 2022] DELETE /identity/v3/projects/63f66f399537417098c59f1428f3b00a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:41.910723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d2ef5-0406-4ecb-bc64-08ac372cbd1f service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:41.921050 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d2ef5-0406-4ecb-bc64-08ac372cbd1f service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:41.982290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c930a-e7cc-4ed6-9ecb-e5cbf9c20001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:41.983179 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c930a-e7cc-4ed6-9ecb-e5cbf9c20001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:41.983468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c930a-e7cc-4ed6-9ecb-e5cbf9c20001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:41.983738 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c930a-e7cc-4ed6-9ecb-e5cbf9c20001 admin admin] PATH_INFO: `/v3/users/cc3c1a1ba47b4eb5aee5ef751eb12b41` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:41.986653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c930a-e7cc-4ed6-9ecb-e5cbf9c20001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3c1a1ba47b4eb5aee5ef751eb12b41)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:41.987195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c930a-e7cc-4ed6-9ecb-e5cbf9c20001 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:42.215800 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-036c930a-e7cc-4ed6-9ecb-e5cbf9c20001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3c1a1ba47b4eb5aee5ef751eb12b41'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:42.274856 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-036c930a-e7cc-4ed6-9ecb-e5cbf9c20001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3c1a1ba47b4eb5aee5ef751eb12b41'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:42.275480 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-036c930a-e7cc-4ed6-9ecb-e5cbf9c20001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3c1a1ba47b4eb5aee5ef751eb12b41'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:42.289100 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-036c930a-e7cc-4ed6-9ecb-e5cbf9c20001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3c1a1ba47b4eb5aee5ef751eb12b41'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:42.297749 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-036c930a-e7cc-4ed6-9ecb-e5cbf9c20001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3c1a1ba47b4eb5aee5ef751eb12b41'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:42.303306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 892/1791] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:21:41 2022] DELETE /identity/v3/users/cc3c1a1ba47b4eb5aee5ef751eb12b41 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:42.727954 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc6f25-1238-4a77-b340-3100ca6ee59b admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:42.729600 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-7fdc6f25-1238-4a77-b340-3100ca6ee59b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:42.750096 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc6f25-1238-4a77-b340-3100ca6ee59b admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:42.812442 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260aeac0-3870-43d1-971a-42a4a90f22fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:42.813367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aeac0-3870-43d1-971a-42a4a90f22fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:42.813644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aeac0-3870-43d1-971a-42a4a90f22fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:42.813912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aeac0-3870-43d1-971a-42a4a90f22fe admin admin] PATH_INFO: `/v3/projects/b65d8e2d1a4d4f4d88f59c1094885b71` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:42.815131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260aeac0-3870-43d1-971a-42a4a90f22fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b65d8e2d1a4d4f4d88f59c1094885b71)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:42.817606 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260aeac0-3870-43d1-971a-42a4a90f22fe admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:42.925007 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-260aeac0-3870-43d1-971a-42a4a90f22fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b65d8e2d1a4d4f4d88f59c1094885b71', 'request_id': 'req-260aeac0-3870-43d1-971a-42a4a90f22fe'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:43.006009 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-260aeac0-3870-43d1-971a-42a4a90f22fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b65d8e2d1a4d4f4d88f59c1094885b71', 'request_id': 'req-260aeac0-3870-43d1-971a-42a4a90f22fe'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:43.012833 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-260aeac0-3870-43d1-971a-42a4a90f22fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b65d8e2d1a4d4f4d88f59c1094885b71', 'request_id': 'req-260aeac0-3870-43d1-971a-42a4a90f22fe'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:43.024173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-260aeac0-3870-43d1-971a-42a4a90f22fe admin admin] The token cache is being invalidate because project b65d8e2d1a4d4f4d88f59c1094885b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:21:43.024467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-260aeac0-3870-43d1-971a-42a4a90f22fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:43.025176 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-260aeac0-3870-43d1-971a-42a4a90f22fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:43.026727 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 900/1792] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:21:42 2022] DELETE /identity/v3/projects/b65d8e2d1a4d4f4d88f59c1094885b71 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:43.031991 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd430d-4a67-4be9-9373-6434f2031374 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:43.032463 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd430d-4a67-4be9-9373-6434f2031374 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:43.032538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd430d-4a67-4be9-9373-6434f2031374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:43.051564 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-a5cd430d-4a67-4be9-9373-6434f2031374 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:43.052861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-a5cd430d-4a67-4be9-9373-6434f2031374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:43.070986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:43.116973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 893/1793] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:43.125124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ded582-9c81-4f92-ad0b-5cb13fbc0ad7 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:43.125427 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ded582-9c81-4f92-ad0b-5cb13fbc0ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:43.125651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ded582-9c81-4f92-ad0b-5cb13fbc0ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:43.146859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-d7ded582-9c81-4f92-ad0b-5cb13fbc0ad7 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:43.148076 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d7ded582-9c81-4f92-ad0b-5cb13fbc0ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:43.156570 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 901/1794] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:43.161214 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd430d-4a67-4be9-9373-6434f2031374 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:43.171262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd430d-4a67-4be9-9373-6434f2031374 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:43.176684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8974c8-3ac0-44f6-92af-6c8b18d308af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:43.177374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8974c8-3ac0-44f6-92af-6c8b18d308af admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:43.177658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8974c8-3ac0-44f6-92af-6c8b18d308af admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:43.183205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8974c8-3ac0-44f6-92af-6c8b18d308af admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:43.183205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8974c8-3ac0-44f6-92af-6c8b18d308af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:21:43.183205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8974c8-3ac0-44f6-92af-6c8b18d308af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:43.183205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8974c8-3ac0-44f6-92af-6c8b18d308af admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:43.193812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 894/1795] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:21:43.198373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ded582-9c81-4f92-ad0b-5cb13fbc0ad7 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:43.204684 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:43.208740 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ded582-9c81-4f92-ad0b-5cb13fbc0ad7 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:43.213733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed55f2-8147-4b19-abdb-8a702b7df105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:43.214433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed55f2-8147-4b19-abdb-8a702b7df105 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:43.214843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed55f2-8147-4b19-abdb-8a702b7df105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:43.214997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed55f2-8147-4b19-abdb-8a702b7df105 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:43.215755 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed55f2-8147-4b19-abdb-8a702b7df105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:43.217720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed55f2-8147-4b19-abdb-8a702b7df105 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:43.310238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 902/1796] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:21:43 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:43.314445 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8974c8-3ac0-44f6-92af-6c8b18d308af admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:43.325238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8974c8-3ac0-44f6-92af-6c8b18d308af admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:43.381770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ed961-f391-4bf5-bd16-31b8360bbd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:43.382490 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ed961-f391-4bf5-bd16-31b8360bbd99 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:43.382775 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ed961-f391-4bf5-bd16-31b8360bbd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:43.383057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ed961-f391-4bf5-bd16-31b8360bbd99 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:43.383763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ed961-f391-4bf5-bd16-31b8360bbd99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:43.385717 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ed961-f391-4bf5-bd16-31b8360bbd99 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:43.481096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 895/1797] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:21:43 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:43.485336 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed55f2-8147-4b19-abdb-8a702b7df105 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:43.496192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed55f2-8147-4b19-abdb-8a702b7df105 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:43.500996 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdee59-cc36-4495-a82d-97b2273be17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:43.501713 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdee59-cc36-4495-a82d-97b2273be17e admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:43.501985 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdee59-cc36-4495-a82d-97b2273be17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:43.502264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdee59-cc36-4495-a82d-97b2273be17e admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:43.503210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdee59-cc36-4495-a82d-97b2273be17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:43.506001 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdee59-cc36-4495-a82d-97b2273be17e admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:43.517695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 903/1798] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:43.521664 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ed961-f391-4bf5-bd16-31b8360bbd99 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:43.533048 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ed961-f391-4bf5-bd16-31b8360bbd99 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:43.538471 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280546a1-2cce-49c1-80df-e4a870969fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:43.539146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280546a1-2cce-49c1-80df-e4a870969fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:43.539432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280546a1-2cce-49c1-80df-e4a870969fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:43.539718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280546a1-2cce-49c1-80df-e4a870969fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:43.540449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280546a1-2cce-49c1-80df-e4a870969fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:43.542154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280546a1-2cce-49c1-80df-e4a870969fcc admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:43.554186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 896/1799] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:21:43.558382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdee59-cc36-4495-a82d-97b2273be17e admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:43.569148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdee59-cc36-4495-a82d-97b2273be17e admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:43.573830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e5e30-860f-413f-bc75-f479e08e91cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:43.574735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e5e30-860f-413f-bc75-f479e08e91cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:43.575015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e5e30-860f-413f-bc75-f479e08e91cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:43.575293 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e5e30-860f-413f-bc75-f479e08e91cc admin admin] PATH_INFO: `/v3/projects/d50396c6ba1e4958822052d58bacc1a8/users/25f891476f4e40eca879c04c3f5bf653/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:43.590909 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e5e30-860f-413f-bc75-f479e08e91cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50396c6ba1e4958822052d58bacc1a8, user_id=25f891476f4e40eca879c04c3f5bf653, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:43.593610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e5e30-860f-413f-bc75-f479e08e91cc admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:43.663829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 904/1800] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:43 2022] PUT /identity/v3/projects/d50396c6ba1e4958822052d58bacc1a8/users/25f891476f4e40eca879c04c3f5bf653/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:43.675564 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50259610-92df-404c-ab01-0a751aa44caf None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:43.675941 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50259610-92df-404c-ab01-0a751aa44caf None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:43.676303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50259610-92df-404c-ab01-0a751aa44caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:43.709270 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-50259610-92df-404c-ab01-0a751aa44caf None None] MFA Rules not processed for user `25f891476f4e40eca879c04c3f5bf653`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:43.710615 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-50259610-92df-404c-ab01-0a751aa44caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:43.776061 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 897/1801] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:43.780848 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e5e30-860f-413f-bc75-f479e08e91cc admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:43.847019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e5e30-860f-413f-bc75-f479e08e91cc admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:43.851723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcfe66-667c-4531-ad34-dccbd14959e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:43.852392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcfe66-667c-4531-ad34-dccbd14959e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:43.852710 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcfe66-667c-4531-ad34-dccbd14959e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:43.852992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcfe66-667c-4531-ad34-dccbd14959e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:43.853707 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcfe66-667c-4531-ad34-dccbd14959e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:43.855662 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcfe66-667c-4531-ad34-dccbd14959e3 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:43.975787 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 905/1802] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:21:43 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:43.978137 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50259610-92df-404c-ab01-0a751aa44caf None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:43.995534 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50259610-92df-404c-ab01-0a751aa44caf None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:44.009646 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:44.053359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad2028-8aa9-48b2-9f9b-ef4a95673467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:44.054041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad2028-8aa9-48b2-9f9b-ef4a95673467 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:44.054328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad2028-8aa9-48b2-9f9b-ef4a95673467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:44.054607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad2028-8aa9-48b2-9f9b-ef4a95673467 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:44.055330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad2028-8aa9-48b2-9f9b-ef4a95673467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:44.057353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad2028-8aa9-48b2-9f9b-ef4a95673467 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:44.171458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 898/1803] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:21:43 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:44.176167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcfe66-667c-4531-ad34-dccbd14959e3 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:44.186408 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcfe66-667c-4531-ad34-dccbd14959e3 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:44.191777 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e3179-1468-40f6-896e-5d791f75e637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:44.192484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e3179-1468-40f6-896e-5d791f75e637 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:44.192795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e3179-1468-40f6-896e-5d791f75e637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:44.193074 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e3179-1468-40f6-896e-5d791f75e637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:44.193809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e3179-1468-40f6-896e-5d791f75e637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:44.195423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e3179-1468-40f6-896e-5d791f75e637 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:44.206538 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 906/1804] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:44.210787 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad2028-8aa9-48b2-9f9b-ef4a95673467 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:44.221346 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad2028-8aa9-48b2-9f9b-ef4a95673467 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:44.231945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f57737-e4c4-4b4a-8dbd-8ea0c8979374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:44.232965 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f57737-e4c4-4b4a-8dbd-8ea0c8979374 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:44.233381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f57737-e4c4-4b4a-8dbd-8ea0c8979374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:44.233670 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f57737-e4c4-4b4a-8dbd-8ea0c8979374 admin admin] PATH_INFO: `/v3/projects/d659b4139a514297a024cb282c9caa86/users/8aaa3e3dfe8441a78b7f950ad8d362b8/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:44.249919 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f57737-e4c4-4b4a-8dbd-8ea0c8979374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d659b4139a514297a024cb282c9caa86, user_id=8aaa3e3dfe8441a78b7f950ad8d362b8, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:44.252629 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f57737-e4c4-4b4a-8dbd-8ea0c8979374 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:44.327309 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 899/1805] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:44 2022] PUT /identity/v3/projects/d659b4139a514297a024cb282c9caa86/users/8aaa3e3dfe8441a78b7f950ad8d362b8/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:21:44.332377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e3179-1468-40f6-896e-5d791f75e637 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:44.343542 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e3179-1468-40f6-896e-5d791f75e637 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:44.399937 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78330bf9-4678-4350-993d-d34d2161ba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:44.400919 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78330bf9-4678-4350-993d-d34d2161ba88 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:44.401305 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78330bf9-4678-4350-993d-d34d2161ba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:44.401577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78330bf9-4678-4350-993d-d34d2161ba88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:44.402498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78330bf9-4678-4350-993d-d34d2161ba88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:44.404412 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78330bf9-4678-4350-993d-d34d2161ba88 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:44.416044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 907/1806] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:44.420242 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f57737-e4c4-4b4a-8dbd-8ea0c8979374 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:44.431925 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f57737-e4c4-4b4a-8dbd-8ea0c8979374 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:44.436798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6e6c4-15a1-4f56-9685-80e6ef6bbb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:44.437692 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6e6c4-15a1-4f56-9685-80e6ef6bbb7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:44.437977 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6e6c4-15a1-4f56-9685-80e6ef6bbb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:44.438309 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6e6c4-15a1-4f56-9685-80e6ef6bbb7e admin admin] PATH_INFO: `/v3/projects/d659b4139a514297a024cb282c9caa86/users/8aaa3e3dfe8441a78b7f950ad8d362b8/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:44.440447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6e6c4-15a1-4f56-9685-80e6ef6bbb7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d659b4139a514297a024cb282c9caa86, user_id=8aaa3e3dfe8441a78b7f950ad8d362b8, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:44.443235 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6e6c4-15a1-4f56-9685-80e6ef6bbb7e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:44.455548 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 900/1807] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:44 2022] PUT /identity/v3/projects/d659b4139a514297a024cb282c9caa86/users/8aaa3e3dfe8441a78b7f950ad8d362b8/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:21:44.466024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b20caf-de37-46ae-8edb-aa8e8277db04 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:44.466317 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b20caf-de37-46ae-8edb-aa8e8277db04 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:44.466601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b20caf-de37-46ae-8edb-aa8e8277db04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:44.494701 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-45b20caf-de37-46ae-8edb-aa8e8277db04 None None] MFA Rules not processed for user `8aaa3e3dfe8441a78b7f950ad8d362b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:44.495926 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-45b20caf-de37-46ae-8edb-aa8e8277db04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:44.500948 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:44.565789 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 908/1808] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:44.577294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6e6c4-15a1-4f56-9685-80e6ef6bbb7e admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:44.579042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4ea6e6c4-15a1-4f56-9685-80e6ef6bbb7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:44.637709 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6e6c4-15a1-4f56-9685-80e6ef6bbb7e admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:44.642263 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd60a8-e23b-46f7-aba5-7a7e9de89bc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:44.642916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd60a8-e23b-46f7-aba5-7a7e9de89bc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:44.643199 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd60a8-e23b-46f7-aba5-7a7e9de89bc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:44.643473 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd60a8-e23b-46f7-aba5-7a7e9de89bc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:44.653042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd60a8-e23b-46f7-aba5-7a7e9de89bc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:44.654723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd60a8-e23b-46f7-aba5-7a7e9de89bc1 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:44.664884 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 901/1809] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:45.270208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b20caf-de37-46ae-8edb-aa8e8277db04 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:45.376445 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b20caf-de37-46ae-8edb-aa8e8277db04 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:45.383817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44f590-4c65-446a-bacb-1aef6acc34d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:45.385058 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44f590-4c65-446a-bacb-1aef6acc34d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:45.385512 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44f590-4c65-446a-bacb-1aef6acc34d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:45.386126 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44f590-4c65-446a-bacb-1aef6acc34d6 admin admin] PATH_INFO: `/v3/users/25f891476f4e40eca879c04c3f5bf653` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:45.387708 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44f590-4c65-446a-bacb-1aef6acc34d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f891476f4e40eca879c04c3f5bf653)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:45.408147 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44f590-4c65-446a-bacb-1aef6acc34d6 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:45.718589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1e44f590-4c65-446a-bacb-1aef6acc34d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f891476f4e40eca879c04c3f5bf653'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:45.719260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1e44f590-4c65-446a-bacb-1aef6acc34d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f891476f4e40eca879c04c3f5bf653'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:45.719903 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1e44f590-4c65-446a-bacb-1aef6acc34d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f891476f4e40eca879c04c3f5bf653'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:45.736766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1e44f590-4c65-446a-bacb-1aef6acc34d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f891476f4e40eca879c04c3f5bf653'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:45.744461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1e44f590-4c65-446a-bacb-1aef6acc34d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f891476f4e40eca879c04c3f5bf653'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:45.891580 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 909/1810] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:21:45 2022] DELETE /identity/v3/users/25f891476f4e40eca879c04c3f5bf653 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:45.891685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58959e46-cbb0-47a7-8857-5fad866bf67e None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:45.891685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58959e46-cbb0-47a7-8857-5fad866bf67e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:45.891685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58959e46-cbb0-47a7-8857-5fad866bf67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:45.933055 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-58959e46-cbb0-47a7-8857-5fad866bf67e None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:45.934294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-58959e46-cbb0-47a7-8857-5fad866bf67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:46.005039 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 902/1811] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:46.015132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44f590-4c65-446a-bacb-1aef6acc34d6 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:46.020880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1e44f590-4c65-446a-bacb-1aef6acc34d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:46.074280 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:46.125450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44f590-4c65-446a-bacb-1aef6acc34d6 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:46.129090 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8c150-a2ab-4f7b-9fb3-c1f5ea0a1ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:46.130319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8c150-a2ab-4f7b-9fb3-c1f5ea0a1ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:46.130780 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8c150-a2ab-4f7b-9fb3-c1f5ea0a1ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:46.131123 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8c150-a2ab-4f7b-9fb3-c1f5ea0a1ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:46.142127 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8c150-a2ab-4f7b-9fb3-c1f5ea0a1ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:46.143603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8c150-a2ab-4f7b-9fb3-c1f5ea0a1ef2 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:46.173857 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 910/1812] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:47.010714 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58959e46-cbb0-47a7-8857-5fad866bf67e None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:47.012641 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-58959e46-cbb0-47a7-8857-5fad866bf67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:47.034070 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58959e46-cbb0-47a7-8857-5fad866bf67e None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:47.052429 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010692f-8cec-46c0-9987-fa79b6412d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:47.053784 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010692f-8cec-46c0-9987-fa79b6412d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:47.054243 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010692f-8cec-46c0-9987-fa79b6412d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:47.054677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010692f-8cec-46c0-9987-fa79b6412d8b admin admin] PATH_INFO: `/v3/users/df1adcbd70434d38b21324783c42379f` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:47.056156 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010692f-8cec-46c0-9987-fa79b6412d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=df1adcbd70434d38b21324783c42379f)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:47.058279 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010692f-8cec-46c0-9987-fa79b6412d8b admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:47.068222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:47.088058 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8c150-a2ab-4f7b-9fb3-c1f5ea0a1ef2 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:47.089596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-46f8c150-a2ab-4f7b-9fb3-c1f5ea0a1ef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:47.115824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8c150-a2ab-4f7b-9fb3-c1f5ea0a1ef2 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:47.138829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d031f25-5ee3-44e7-8612-afc8db7273be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:47.145319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d031f25-5ee3-44e7-8612-afc8db7273be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:47.145319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d031f25-5ee3-44e7-8612-afc8db7273be admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:47.145319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d031f25-5ee3-44e7-8612-afc8db7273be admin admin] PATH_INFO: `/v3/projects/d50396c6ba1e4958822052d58bacc1a8` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:47.145319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d031f25-5ee3-44e7-8612-afc8db7273be admin admin] RBAC: Authorizing `identity:delete_project(project_id=d50396c6ba1e4958822052d58bacc1a8)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:47.148271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d031f25-5ee3-44e7-8612-afc8db7273be admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:47.343228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-6d031f25-5ee3-44e7-8612-afc8db7273be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd50396c6ba1e4958822052d58bacc1a8', 'request_id': 'req-6d031f25-5ee3-44e7-8612-afc8db7273be'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:47.343958 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3010692f-8cec-46c0-9987-fa79b6412d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df1adcbd70434d38b21324783c42379f'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:47.400554 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-6d031f25-5ee3-44e7-8612-afc8db7273be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd50396c6ba1e4958822052d58bacc1a8', 'request_id': 'req-6d031f25-5ee3-44e7-8612-afc8db7273be'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:47.414889 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-6d031f25-5ee3-44e7-8612-afc8db7273be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd50396c6ba1e4958822052d58bacc1a8', 'request_id': 'req-6d031f25-5ee3-44e7-8612-afc8db7273be'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:47.428371 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-6d031f25-5ee3-44e7-8612-afc8db7273be admin admin] The token cache is being invalidate because project d50396c6ba1e4958822052d58bacc1a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:21:47.428844 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-6d031f25-5ee3-44e7-8612-afc8db7273be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:47.429552 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-6d031f25-5ee3-44e7-8612-afc8db7273be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:47.432315 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 911/1813] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:21:47 2022] DELETE /identity/v3/projects/d50396c6ba1e4958822052d58bacc1a8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:47.437069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d031f25-5ee3-44e7-8612-afc8db7273be admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:47.438477 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-6d031f25-5ee3-44e7-8612-afc8db7273be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:47.480783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3010692f-8cec-46c0-9987-fa79b6412d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df1adcbd70434d38b21324783c42379f'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:47.481648 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3010692f-8cec-46c0-9987-fa79b6412d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df1adcbd70434d38b21324783c42379f'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:47.506531 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3010692f-8cec-46c0-9987-fa79b6412d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df1adcbd70434d38b21324783c42379f'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:47.518553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3010692f-8cec-46c0-9987-fa79b6412d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df1adcbd70434d38b21324783c42379f'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:47.557449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 903/1814] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:21:47 2022] DELETE /identity/v3/users/df1adcbd70434d38b21324783c42379f => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:47.562126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ce2c0-fed3-44de-962f-08e4bd1f8840 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:47.562523 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ce2c0-fed3-44de-962f-08e4bd1f8840 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:47.562910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ce2c0-fed3-44de-962f-08e4bd1f8840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:47.606442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-ce5ce2c0-fed3-44de-962f-08e4bd1f8840 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:47.609789 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ce5ce2c0-fed3-44de-962f-08e4bd1f8840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:47.610609 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d031f25-5ee3-44e7-8612-afc8db7273be admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:47.704516 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:47.713228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3b6ef-35bb-48da-8756-7710c5046975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:47.714963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3b6ef-35bb-48da-8756-7710c5046975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:47.715470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3b6ef-35bb-48da-8756-7710c5046975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:47.715955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3b6ef-35bb-48da-8756-7710c5046975 admin admin] PATH_INFO: `/v3/users/8aaa3e3dfe8441a78b7f950ad8d362b8` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:47.718016 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3b6ef-35bb-48da-8756-7710c5046975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aaa3e3dfe8441a78b7f950ad8d362b8)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:47.720226 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3b6ef-35bb-48da-8756-7710c5046975 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:47.743912 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 904/1815] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:47.751713 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ce2c0-fed3-44de-962f-08e4bd1f8840 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:47.753216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ce5ce2c0-fed3-44de-962f-08e4bd1f8840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:47.850401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ce2c0-fed3-44de-962f-08e4bd1f8840 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:47.862713 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67ec37-a87f-476c-b690-9c7b5e578c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:47.863899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67ec37-a87f-476c-b690-9c7b5e578c34 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:47.864184 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67ec37-a87f-476c-b690-9c7b5e578c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:47.864455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67ec37-a87f-476c-b690-9c7b5e578c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:47.875910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67ec37-a87f-476c-b690-9c7b5e578c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:47.877423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67ec37-a87f-476c-b690-9c7b5e578c34 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:47.896907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 905/1816] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:21:47.902996 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-58b3b6ef-35bb-48da-8756-7710c5046975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aaa3e3dfe8441a78b7f950ad8d362b8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:47.903967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-58b3b6ef-35bb-48da-8756-7710c5046975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aaa3e3dfe8441a78b7f950ad8d362b8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:47.904653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-58b3b6ef-35bb-48da-8756-7710c5046975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aaa3e3dfe8441a78b7f950ad8d362b8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:47.920224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-58b3b6ef-35bb-48da-8756-7710c5046975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aaa3e3dfe8441a78b7f950ad8d362b8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:47.927675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-58b3b6ef-35bb-48da-8756-7710c5046975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aaa3e3dfe8441a78b7f950ad8d362b8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:48.000259 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 912/1817] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:21:47 2022] DELETE /identity/v3/users/8aaa3e3dfe8441a78b7f950ad8d362b8 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:48.333805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67ec37-a87f-476c-b690-9c7b5e578c34 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:48.335363 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-db67ec37-a87f-476c-b690-9c7b5e578c34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:48.349764 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67ec37-a87f-476c-b690-9c7b5e578c34 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:48.382164 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:48.416718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8d2c9-4262-4faf-8c81-55c207fcc606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:48.418452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8d2c9-4262-4faf-8c81-55c207fcc606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:48.418452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8d2c9-4262-4faf-8c81-55c207fcc606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:48.418620 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8d2c9-4262-4faf-8c81-55c207fcc606 admin admin] PATH_INFO: `/v3/projects/d9c2e1c04d3d4a319a871f65b61e513d` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:48.419757 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8d2c9-4262-4faf-8c81-55c207fcc606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9c2e1c04d3d4a319a871f65b61e513d)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:48.421862 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8d2c9-4262-4faf-8c81-55c207fcc606 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:48.541047 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-e7c8d2c9-4262-4faf-8c81-55c207fcc606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9c2e1c04d3d4a319a871f65b61e513d', 'request_id': 'req-e7c8d2c9-4262-4faf-8c81-55c207fcc606'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:48.546896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-e7c8d2c9-4262-4faf-8c81-55c207fcc606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9c2e1c04d3d4a319a871f65b61e513d', 'request_id': 'req-e7c8d2c9-4262-4faf-8c81-55c207fcc606'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:48.630192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3b6ef-35bb-48da-8756-7710c5046975 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:48.632892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-58b3b6ef-35bb-48da-8756-7710c5046975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:48.648176 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3b6ef-35bb-48da-8756-7710c5046975 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:48.674417 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-e7c8d2c9-4262-4faf-8c81-55c207fcc606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9c2e1c04d3d4a319a871f65b61e513d', 'request_id': 'req-e7c8d2c9-4262-4faf-8c81-55c207fcc606'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:48.697076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-e7c8d2c9-4262-4faf-8c81-55c207fcc606 admin admin] The token cache is being invalidate because project d9c2e1c04d3d4a319a871f65b61e513d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:21:48.697076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-e7c8d2c9-4262-4faf-8c81-55c207fcc606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:48.697076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-e7c8d2c9-4262-4faf-8c81-55c207fcc606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:48.707666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 906/1818] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:21:48 2022] DELETE /identity/v3/projects/d9c2e1c04d3d4a319a871f65b61e513d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:48.707666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8d2c9-4262-4faf-8c81-55c207fcc606 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:48.707666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e7c8d2c9-4262-4faf-8c81-55c207fcc606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:48.733476 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81d218-fdc3-4235-be4d-b3484bd7db2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:48.736319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81d218-fdc3-4235-be4d-b3484bd7db2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:48.736319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81d218-fdc3-4235-be4d-b3484bd7db2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:48.736319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81d218-fdc3-4235-be4d-b3484bd7db2b admin admin] PATH_INFO: `/v3/projects/d659b4139a514297a024cb282c9caa86` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:48.736319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81d218-fdc3-4235-be4d-b3484bd7db2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d659b4139a514297a024cb282c9caa86)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:48.738064 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81d218-fdc3-4235-be4d-b3484bd7db2b admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:48.778312 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8d2c9-4262-4faf-8c81-55c207fcc606 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:48.783580 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbed3c5-70ae-450d-8641-a5213d354426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:48.784504 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbed3c5-70ae-450d-8641-a5213d354426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:48.784848 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbed3c5-70ae-450d-8641-a5213d354426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:48.785136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbed3c5-70ae-450d-8641-a5213d354426 admin admin] PATH_INFO: `/v3/users/fa4bea1e150e4a6b8e31b6745caab509` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:48.786358 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbed3c5-70ae-450d-8641-a5213d354426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4bea1e150e4a6b8e31b6745caab509)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:48.788296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbed3c5-70ae-450d-8641-a5213d354426 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:48.830682 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ce81d218-fdc3-4235-be4d-b3484bd7db2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd659b4139a514297a024cb282c9caa86', 'request_id': 'req-ce81d218-fdc3-4235-be4d-b3484bd7db2b'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:48.897296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ce81d218-fdc3-4235-be4d-b3484bd7db2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd659b4139a514297a024cb282c9caa86', 'request_id': 'req-ce81d218-fdc3-4235-be4d-b3484bd7db2b'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:48.905123 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ce81d218-fdc3-4235-be4d-b3484bd7db2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd659b4139a514297a024cb282c9caa86', 'request_id': 'req-ce81d218-fdc3-4235-be4d-b3484bd7db2b'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:48.918964 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ce81d218-fdc3-4235-be4d-b3484bd7db2b admin admin] The token cache is being invalidate because project d659b4139a514297a024cb282c9caa86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:21:48.919283 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ce81d218-fdc3-4235-be4d-b3484bd7db2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:48.920640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ce81d218-fdc3-4235-be4d-b3484bd7db2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:48.926711 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 913/1819] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:21:48 2022] DELETE /identity/v3/projects/d659b4139a514297a024cb282c9caa86 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:48.928247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608ef4a-f720-4b32-bc51-79722332538a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:48.928527 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608ef4a-f720-4b32-bc51-79722332538a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:48.928848 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608ef4a-f720-4b32-bc51-79722332538a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:48.937064 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:48.939482 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-5bbed3c5-70ae-450d-8641-a5213d354426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4bea1e150e4a6b8e31b6745caab509'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:48.951186 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-c608ef4a-f720-4b32-bc51-79722332538a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:48.952420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-c608ef4a-f720-4b32-bc51-79722332538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:49.022803 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 914/1820] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:49.031076 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bc36c-db9d-4851-87db-40ba54d742c7 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:49.031369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bc36c-db9d-4851-87db-40ba54d742c7 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:49.031668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bc36c-db9d-4851-87db-40ba54d742c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:49.046065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-5bbed3c5-70ae-450d-8641-a5213d354426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4bea1e150e4a6b8e31b6745caab509'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:49.046844 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-5bbed3c5-70ae-450d-8641-a5213d354426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4bea1e150e4a6b8e31b6745caab509'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:49.051596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-158bc36c-db9d-4851-87db-40ba54d742c7 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:49.052774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-158bc36c-db9d-4851-87db-40ba54d742c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:49.064705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 915/1821] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:21:49.065565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-5bbed3c5-70ae-450d-8641-a5213d354426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4bea1e150e4a6b8e31b6745caab509'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:49.065705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bc36c-db9d-4851-87db-40ba54d742c7 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:49.066509 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-5bbed3c5-70ae-450d-8641-a5213d354426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4bea1e150e4a6b8e31b6745caab509'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:49.075704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bc36c-db9d-4851-87db-40ba54d742c7 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:49.079951 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 907/1822] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:21:48 2022] DELETE /identity/v3/users/fa4bea1e150e4a6b8e31b6745caab509 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:49.080878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c0af7-0686-4d20-a549-8e3112ef30c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:49.081653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c0af7-0686-4d20-a549-8e3112ef30c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:49.081941 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c0af7-0686-4d20-a549-8e3112ef30c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:49.082214 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c0af7-0686-4d20-a549-8e3112ef30c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:49.083141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c0af7-0686-4d20-a549-8e3112ef30c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:21:49.083614 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c0af7-0686-4d20-a549-8e3112ef30c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:49.085543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c0af7-0686-4d20-a549-8e3112ef30c8 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:49.104089 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 916/1823] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:21:49.105353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbed3c5-70ae-450d-8641-a5213d354426 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:49.107696 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-5bbed3c5-70ae-450d-8641-a5213d354426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:49.182415 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbed3c5-70ae-450d-8641-a5213d354426 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:49.187194 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02836dcd-523d-4a3b-bcbf-db946a43c7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:49.187872 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02836dcd-523d-4a3b-bcbf-db946a43c7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:49.188153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02836dcd-523d-4a3b-bcbf-db946a43c7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:49.188429 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02836dcd-523d-4a3b-bcbf-db946a43c7f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:49.189197 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02836dcd-523d-4a3b-bcbf-db946a43c7f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:49.191151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02836dcd-523d-4a3b-bcbf-db946a43c7f1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:49.282551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 908/1824] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:21:49 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:49.287264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c0af7-0686-4d20-a549-8e3112ef30c8 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:49.297662 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c0af7-0686-4d20-a549-8e3112ef30c8 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:49.360263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b1026-6871-460b-9b08-661707787886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:49.361030 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b1026-6871-460b-9b08-661707787886 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:49.361314 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b1026-6871-460b-9b08-661707787886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:49.361586 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b1026-6871-460b-9b08-661707787886 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:49.362285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b1026-6871-460b-9b08-661707787886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:49.364815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b1026-6871-460b-9b08-661707787886 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:49.488026 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 917/1825] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:21:49 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:49.492419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02836dcd-523d-4a3b-bcbf-db946a43c7f1 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:49.502508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02836dcd-523d-4a3b-bcbf-db946a43c7f1 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:49.507548 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d22ca-8e60-4d14-b5f3-2ba09935ddd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:49.508210 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d22ca-8e60-4d14-b5f3-2ba09935ddd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:49.508490 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d22ca-8e60-4d14-b5f3-2ba09935ddd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:49.508859 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d22ca-8e60-4d14-b5f3-2ba09935ddd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:49.509577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d22ca-8e60-4d14-b5f3-2ba09935ddd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:49.511163 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d22ca-8e60-4d14-b5f3-2ba09935ddd7 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:49.518068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:49.523854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b1026-6871-460b-9b08-661707787886 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:49.525737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 909/1826] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:49.526765 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-803b1026-6871-460b-9b08-661707787886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:49.529803 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d22ca-8e60-4d14-b5f3-2ba09935ddd7 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:49.543233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d22ca-8e60-4d14-b5f3-2ba09935ddd7 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:49.551896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9b84a-5123-40ce-bd6d-c459f5a5a92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:49.552762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9b84a-5123-40ce-bd6d-c459f5a5a92d admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:49.558388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9b84a-5123-40ce-bd6d-c459f5a5a92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:49.558388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9b84a-5123-40ce-bd6d-c459f5a5a92d admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:49.558388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9b84a-5123-40ce-bd6d-c459f5a5a92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:49.558388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9b84a-5123-40ce-bd6d-c459f5a5a92d admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:49.559173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b1026-6871-460b-9b08-661707787886 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:49.566860 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5bf2f-f77a-4112-b681-db08414dbb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:49.567832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5bf2f-f77a-4112-b681-db08414dbb65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:49.568190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5bf2f-f77a-4112-b681-db08414dbb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:49.568536 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5bf2f-f77a-4112-b681-db08414dbb65 admin admin] PATH_INFO: `/v3/projects/24c668d12a6e4d7687278a3b25eff762` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:49.569881 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5bf2f-f77a-4112-b681-db08414dbb65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24c668d12a6e4d7687278a3b25eff762)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:49.571189 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 910/1827] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:21:49.572627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9b84a-5123-40ce-bd6d-c459f5a5a92d admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:49.573208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5bf2f-f77a-4112-b681-db08414dbb65 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:49.589105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9b84a-5123-40ce-bd6d-c459f5a5a92d admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:49.595013 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aa351-3de4-416e-9b64-d8b0b259db8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:49.596745 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aa351-3de4-416e-9b64-d8b0b259db8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:49.597370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aa351-3de4-416e-9b64-d8b0b259db8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:49.597879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aa351-3de4-416e-9b64-d8b0b259db8b admin admin] PATH_INFO: `/v3/projects/0201d06ef1d141f4bd5f5d71f143f6d3/users/ce33b857336f4461a116b9af92e2d0bc/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:49.617182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226aa351-3de4-416e-9b64-d8b0b259db8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0201d06ef1d141f4bd5f5d71f143f6d3, user_id=ce33b857336f4461a116b9af92e2d0bc, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:49.620000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226aa351-3de4-416e-9b64-d8b0b259db8b admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:49.762376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 911/1828] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:49 2022] PUT /identity/v3/projects/0201d06ef1d141f4bd5f5d71f143f6d3/users/ce33b857336f4461a116b9af92e2d0bc/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:49.772130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-d3b5bf2f-f77a-4112-b681-db08414dbb65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24c668d12a6e4d7687278a3b25eff762', 'request_id': 'req-d3b5bf2f-f77a-4112-b681-db08414dbb65'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:49.774793 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20b722-458a-45a5-ab49-e4f3bf9bc117 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:49.775091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20b722-458a-45a5-ab49-e4f3bf9bc117 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:49.775828 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20b722-458a-45a5-ab49-e4f3bf9bc117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:49.808778 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-ec20b722-458a-45a5-ab49-e4f3bf9bc117 None None] MFA Rules not processed for user `ce33b857336f4461a116b9af92e2d0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:49.808778 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ec20b722-458a-45a5-ab49-e4f3bf9bc117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:49.862190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-d3b5bf2f-f77a-4112-b681-db08414dbb65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24c668d12a6e4d7687278a3b25eff762', 'request_id': 'req-d3b5bf2f-f77a-4112-b681-db08414dbb65'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:49.868862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-d3b5bf2f-f77a-4112-b681-db08414dbb65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24c668d12a6e4d7687278a3b25eff762', 'request_id': 'req-d3b5bf2f-f77a-4112-b681-db08414dbb65'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:49.870370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 912/1829] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:21:49.880994 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-d3b5bf2f-f77a-4112-b681-db08414dbb65 admin admin] The token cache is being invalidate because project 24c668d12a6e4d7687278a3b25eff762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:21:49.881365 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-d3b5bf2f-f77a-4112-b681-db08414dbb65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:49.881795 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20b722-458a-45a5-ab49-e4f3bf9bc117 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:49.882042 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-d3b5bf2f-f77a-4112-b681-db08414dbb65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:21:49.883222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ec20b722-458a-45a5-ab49-e4f3bf9bc117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:49.883597 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 918/1830] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:21:49 2022] DELETE /identity/v3/projects/24c668d12a6e4d7687278a3b25eff762 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:49.888837 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03108f-1b5b-48d3-a47e-23fdf1cb7b6b None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:49.889835 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03108f-1b5b-48d3-a47e-23fdf1cb7b6b None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:49.889835 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03108f-1b5b-48d3-a47e-23fdf1cb7b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:49.908746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-1b03108f-1b5b-48d3-a47e-23fdf1cb7b6b None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:49.909962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1b03108f-1b5b-48d3-a47e-23fdf1cb7b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:49.945790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20b722-458a-45a5-ab49-e4f3bf9bc117 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:49.950310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96119027-93d2-4b43-9da2-fa2ffbd9b142 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdb2d75e4025a5d73ea713c690b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:49.951123 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96119027-93d2-4b43-9da2-fa2ffbd9b142 service glance] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:49.951503 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96119027-93d2-4b43-9da2-fa2ffbd9b142 service glance] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:49.951989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96119027-93d2-4b43-9da2-fa2ffbd9b142 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:49.954167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-96119027-93d2-4b43-9da2-fa2ffbd9b142 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:49.967700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96119027-93d2-4b43-9da2-fa2ffbd9b142 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:49.969567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96119027-93d2-4b43-9da2-fa2ffbd9b142 service glance] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:49.977329 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 919/1831] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:21:49.979161 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 913/1832] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:21:49.984971 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafd773-e781-4cc4-a901-1265c148769e None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:49.985348 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafd773-e781-4cc4-a901-1265c148769e None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:49.985705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafd773-e781-4cc4-a901-1265c148769e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:50.012083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-9aafd773-e781-4cc4-a901-1265c148769e None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:50.013323 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-9aafd773-e781-4cc4-a901-1265c148769e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:50.019719 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:50.025268 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 920/1833] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:21:50.029594 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96119027-93d2-4b43-9da2-fa2ffbd9b142 service glance] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:50.041867 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96119027-93d2-4b43-9da2-fa2ffbd9b142 service glance] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:50.047896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710281d-327e-44c8-b87a-f981f50b6aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:50.049240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710281d-327e-44c8-b87a-f981f50b6aec admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:50.049681 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710281d-327e-44c8-b87a-f981f50b6aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:50.050760 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710281d-327e-44c8-b87a-f981f50b6aec admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:50.052855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710281d-327e-44c8-b87a-f981f50b6aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:21:50.053115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710281d-327e-44c8-b87a-f981f50b6aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:50.054722 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710281d-327e-44c8-b87a-f981f50b6aec admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:50.075565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 914/1834] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:21:50.080240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafd773-e781-4cc4-a901-1265c148769e None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:50.091001 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafd773-e781-4cc4-a901-1265c148769e None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:50.098852 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66753f-126c-4efb-8efe-71a5e2a190e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:50.098852 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66753f-126c-4efb-8efe-71a5e2a190e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:50.098852 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66753f-126c-4efb-8efe-71a5e2a190e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:50.098852 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66753f-126c-4efb-8efe-71a5e2a190e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:50.099626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66753f-126c-4efb-8efe-71a5e2a190e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:50.100634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66753f-126c-4efb-8efe-71a5e2a190e6 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:50.126389 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:50.186482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 921/1835] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:21:50 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:50.190886 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710281d-327e-44c8-b87a-f981f50b6aec admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:50.210375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710281d-327e-44c8-b87a-f981f50b6aec admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:50.286298 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75347a1-e05a-4268-8547-f3b3a6ea32c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:50.287434 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75347a1-e05a-4268-8547-f3b3a6ea32c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:50.287888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75347a1-e05a-4268-8547-f3b3a6ea32c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:50.288425 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75347a1-e05a-4268-8547-f3b3a6ea32c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:50.289955 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75347a1-e05a-4268-8547-f3b3a6ea32c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:50.294425 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75347a1-e05a-4268-8547-f3b3a6ea32c2 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:50.418829 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 915/1836] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:21:50 2022] POST /identity/v3/users => generated 283 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:50.423564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66753f-126c-4efb-8efe-71a5e2a190e6 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:50.434575 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66753f-126c-4efb-8efe-71a5e2a190e6 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:50.439416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd2364-e6a7-44e9-9c7e-2b3118960692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:50.440173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd2364-e6a7-44e9-9c7e-2b3118960692 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:50.440534 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd2364-e6a7-44e9-9c7e-2b3118960692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:50.440842 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd2364-e6a7-44e9-9c7e-2b3118960692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:50.441626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd2364-e6a7-44e9-9c7e-2b3118960692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:50.443261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd2364-e6a7-44e9-9c7e-2b3118960692 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:50.454025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 922/1837] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:50.458334 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75347a1-e05a-4268-8547-f3b3a6ea32c2 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:50.468964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75347a1-e05a-4268-8547-f3b3a6ea32c2 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:50.475226 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44deb9-1fc2-448c-be87-ab80ef075c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:50.475903 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44deb9-1fc2-448c-be87-ab80ef075c94 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:50.476196 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44deb9-1fc2-448c-be87-ab80ef075c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:50.476495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44deb9-1fc2-448c-be87-ab80ef075c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:50.477243 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44deb9-1fc2-448c-be87-ab80ef075c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:50.478894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44deb9-1fc2-448c-be87-ab80ef075c94 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:50.489846 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 916/1838] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:50.494110 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd2364-e6a7-44e9-9c7e-2b3118960692 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:50.504243 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd2364-e6a7-44e9-9c7e-2b3118960692 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:50.508824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b4633-9ab9-4621-9857-78e19c2f9d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:50.509704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b4633-9ab9-4621-9857-78e19c2f9d0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:50.509986 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b4633-9ab9-4621-9857-78e19c2f9d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:50.510263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b4633-9ab9-4621-9857-78e19c2f9d0c admin admin] PATH_INFO: `/v3/projects/9cf925d2aa7b4613acaa8838a18a68d5/users/2d4acab793bf4dbf98bc8dea03e95644/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:50.525866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b4633-9ab9-4621-9857-78e19c2f9d0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf925d2aa7b4613acaa8838a18a68d5, user_id=2d4acab793bf4dbf98bc8dea03e95644, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:50.528888 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b4633-9ab9-4621-9857-78e19c2f9d0c admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:50.595389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 923/1839] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:50 2022] PUT /identity/v3/projects/9cf925d2aa7b4613acaa8838a18a68d5/users/2d4acab793bf4dbf98bc8dea03e95644/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:50.607823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbc6cc-78b9-4a1c-8e56-8c9636ce66f1 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:50.608351 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbc6cc-78b9-4a1c-8e56-8c9636ce66f1 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:50.608505 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbc6cc-78b9-4a1c-8e56-8c9636ce66f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:50.641395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-9bbbc6cc-78b9-4a1c-8e56-8c9636ce66f1 None None] MFA Rules not processed for user `2d4acab793bf4dbf98bc8dea03e95644`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:50.642616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-9bbbc6cc-78b9-4a1c-8e56-8c9636ce66f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:50.717373 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 917/1840] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:50.722030 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b4633-9ab9-4621-9857-78e19c2f9d0c admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:50.792314 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b4633-9ab9-4621-9857-78e19c2f9d0c admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:50.797366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517ebca-9466-45d8-b448-c8ecb70c1104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:50.798033 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517ebca-9466-45d8-b448-c8ecb70c1104 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:50.798319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517ebca-9466-45d8-b448-c8ecb70c1104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:50.798600 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517ebca-9466-45d8-b448-c8ecb70c1104 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:50.799299 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517ebca-9466-45d8-b448-c8ecb70c1104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:50.801447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517ebca-9466-45d8-b448-c8ecb70c1104 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:50.927038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 924/1841] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:21:50 2022] POST /identity/v3/projects => generated 363 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:50.931589 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbc6cc-78b9-4a1c-8e56-8c9636ce66f1 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:50.938518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:50.943136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbc6cc-78b9-4a1c-8e56-8c9636ce66f1 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:51.004046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499a68b-06a0-4cb9-968a-6798ba5ba8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:51.009438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499a68b-06a0-4cb9-968a-6798ba5ba8ed admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:51.009438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499a68b-06a0-4cb9-968a-6798ba5ba8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:51.009438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499a68b-06a0-4cb9-968a-6798ba5ba8ed admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:51.009438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499a68b-06a0-4cb9-968a-6798ba5ba8ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:51.009438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499a68b-06a0-4cb9-968a-6798ba5ba8ed admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:51.108960 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 918/1842] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:21:50 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:21:51.113217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517ebca-9466-45d8-b448-c8ecb70c1104 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:51.123832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517ebca-9466-45d8-b448-c8ecb70c1104 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:51.129266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2de14-6541-45a9-a3c6-8197f7ddad3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:51.130069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2de14-6541-45a9-a3c6-8197f7ddad3f admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:51.130350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2de14-6541-45a9-a3c6-8197f7ddad3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:51.130623 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2de14-6541-45a9-a3c6-8197f7ddad3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:51.131358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2de14-6541-45a9-a3c6-8197f7ddad3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:51.133008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2de14-6541-45a9-a3c6-8197f7ddad3f admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:51.145677 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 925/1843] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:51.150135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499a68b-06a0-4cb9-968a-6798ba5ba8ed admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:51.160951 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499a68b-06a0-4cb9-968a-6798ba5ba8ed admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:51.165603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d16b2f-b536-40c1-a3dd-912b04786d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:51.166495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d16b2f-b536-40c1-a3dd-912b04786d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:51.166770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d16b2f-b536-40c1-a3dd-912b04786d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:51.167040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d16b2f-b536-40c1-a3dd-912b04786d50 admin admin] PATH_INFO: `/v3/projects/33a4ddd316cf412a8673020404f647aa/users/cac4745f6598402eaf865a1c899d22fb/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:51.183614 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d16b2f-b536-40c1-a3dd-912b04786d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a4ddd316cf412a8673020404f647aa, user_id=cac4745f6598402eaf865a1c899d22fb, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:51.186572 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d16b2f-b536-40c1-a3dd-912b04786d50 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:51.297179 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 919/1844] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:51 2022] PUT /identity/v3/projects/33a4ddd316cf412a8673020404f647aa/users/cac4745f6598402eaf865a1c899d22fb/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:21:51.301477 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2de14-6541-45a9-a3c6-8197f7ddad3f admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:51.311783 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2de14-6541-45a9-a3c6-8197f7ddad3f admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:51.319131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:51.383899 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5e660-aced-4d5a-a72e-a7a4867733f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:51.385005 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5e660-aced-4d5a-a72e-a7a4867733f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:51.385465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5e660-aced-4d5a-a72e-a7a4867733f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:51.390856 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5e660-aced-4d5a-a72e-a7a4867733f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:51.390856 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5e660-aced-4d5a-a72e-a7a4867733f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:51.390856 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5e660-aced-4d5a-a72e-a7a4867733f0 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:51.401139 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 926/1845] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:21:51.405588 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d16b2f-b536-40c1-a3dd-912b04786d50 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:51.416385 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d16b2f-b536-40c1-a3dd-912b04786d50 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:51.421185 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac6672-ab41-41c4-9d19-23db38c91f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:51.422093 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac6672-ab41-41c4-9d19-23db38c91f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:51.422372 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac6672-ab41-41c4-9d19-23db38c91f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:51.422645 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac6672-ab41-41c4-9d19-23db38c91f35 admin admin] PATH_INFO: `/v3/projects/33a4ddd316cf412a8673020404f647aa/users/cac4745f6598402eaf865a1c899d22fb/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:51.425863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac6672-ab41-41c4-9d19-23db38c91f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a4ddd316cf412a8673020404f647aa, user_id=cac4745f6598402eaf865a1c899d22fb, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:51.428533 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac6672-ab41-41c4-9d19-23db38c91f35 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:51.440776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 920/1846] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:21:51 2022] PUT /identity/v3/projects/33a4ddd316cf412a8673020404f647aa/users/cac4745f6598402eaf865a1c899d22fb/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:21:51.451672 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733aa2c-489e-4ffb-9993-29faca50733a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:51.451970 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733aa2c-489e-4ffb-9993-29faca50733a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:51.452251 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733aa2c-489e-4ffb-9993-29faca50733a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:51.480571 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-6733aa2c-489e-4ffb-9993-29faca50733a None None] MFA Rules not processed for user `cac4745f6598402eaf865a1c899d22fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:51.481872 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-6733aa2c-489e-4ffb-9993-29faca50733a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:51.583646 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 927/1847] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:21:51 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:51.595388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac6672-ab41-41c4-9d19-23db38c91f35 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:51.598499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-faac6672-ab41-41c4-9d19-23db38c91f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:51.674322 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac6672-ab41-41c4-9d19-23db38c91f35 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:51.679331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39baff-780d-41f7-b7f5-69f1fdb21003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:51.680141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39baff-780d-41f7-b7f5-69f1fdb21003 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:51.680426 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39baff-780d-41f7-b7f5-69f1fdb21003 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:51.680757 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39baff-780d-41f7-b7f5-69f1fdb21003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:51.695910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39baff-780d-41f7-b7f5-69f1fdb21003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:51.697888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39baff-780d-41f7-b7f5-69f1fdb21003 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:51.710715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 921/1848] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:51 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:51.957533 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733aa2c-489e-4ffb-9993-29faca50733a None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:51.967408 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733aa2c-489e-4ffb-9993-29faca50733a None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:51.973545 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3f7a5-3d27-48c5-8de1-95ecee05fbc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:51.974408 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3f7a5-3d27-48c5-8de1-95ecee05fbc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:51.974889 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3f7a5-3d27-48c5-8de1-95ecee05fbc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:51.975245 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3f7a5-3d27-48c5-8de1-95ecee05fbc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:52.061627 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3f7a5-3d27-48c5-8de1-95ecee05fbc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:52.063220 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3f7a5-3d27-48c5-8de1-95ecee05fbc8 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:52.074209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 928/1849] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:51 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:21:53.572924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3564c8-6fbe-45f5-9aca-6f2b0310ec1b None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:53.573514 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3564c8-6fbe-45f5-9aca-6f2b0310ec1b None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:53.573514 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3564c8-6fbe-45f5-9aca-6f2b0310ec1b None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:53.574939 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 922/1850] 10.222.0.66 () {54 vars in 921 bytes} [Thu May 26 21:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:21:53.587834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9e4ef-51eb-479e-8a3b-00617099bae1 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:53.594911 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9e4ef-51eb-479e-8a3b-00617099bae1 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:53.595493 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9e4ef-51eb-479e-8a3b-00617099bae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:53.629166 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-64e9e4ef-51eb-479e-8a3b-00617099bae1 None None] MFA Rules not processed for user `df008eed25464be387741ee7a1e5ce80`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:21:53.629166 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-64e9e4ef-51eb-479e-8a3b-00617099bae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:53.654483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:53.713286 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 929/1851] 10.222.0.66 () {58 vars in 1018 bytes} [Thu May 26 21:21:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:21:53.736854 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3564c8-6fbe-45f5-9aca-6f2b0310ec1b None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:21:53.739462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-dd3564c8-6fbe-45f5-9aca-6f2b0310ec1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:21:53.761137 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3564c8-6fbe-45f5-9aca-6f2b0310ec1b None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:21:53.767522 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975814f-c44c-43b7-91cc-454112d0d5d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:21:53.768195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975814f-c44c-43b7-91cc-454112d0d5d2 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:21:53.768477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975814f-c44c-43b7-91cc-454112d0d5d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:21:53.768786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975814f-c44c-43b7-91cc-454112d0d5d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:21:53.780015 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975814f-c44c-43b7-91cc-454112d0d5d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:21:53.781773 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975814f-c44c-43b7-91cc-454112d0d5d2 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:21:53.804389 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 923/1852] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:21:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:03.701508 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=18 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:03.789190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=74,keystone:INSERT=5 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:15.771146 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9e4ef-51eb-479e-8a3b-00617099bae1 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:15.780466 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-64e9e4ef-51eb-479e-8a3b-00617099bae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:15.853423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9e4ef-51eb-479e-8a3b-00617099bae1 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:15.858108 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3105d-f236-447f-aa71-513f26ae253a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:15.858992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3105d-f236-447f-aa71-513f26ae253a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:15.859274 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3105d-f236-447f-aa71-513f26ae253a admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:15.859550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3105d-f236-447f-aa71-513f26ae253a admin admin] PATH_INFO: `/v3/users/756bc3312d1444fea516963bb6a0018e` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:15.860790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3105d-f236-447f-aa71-513f26ae253a admin admin] RBAC: Authorizing `identity:delete_user(user_id=756bc3312d1444fea516963bb6a0018e)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:15.862773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3105d-f236-447f-aa71-513f26ae253a admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:16.039658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-90e3105d-f236-447f-aa71-513f26ae253a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756bc3312d1444fea516963bb6a0018e'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:16.041000 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-90e3105d-f236-447f-aa71-513f26ae253a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756bc3312d1444fea516963bb6a0018e'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:16.045604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-90e3105d-f236-447f-aa71-513f26ae253a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756bc3312d1444fea516963bb6a0018e'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:16.062068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-90e3105d-f236-447f-aa71-513f26ae253a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756bc3312d1444fea516963bb6a0018e'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:16.072172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-90e3105d-f236-447f-aa71-513f26ae253a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756bc3312d1444fea516963bb6a0018e'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:16.235238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 930/1853] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:22:15 2022] DELETE /identity/v3/users/756bc3312d1444fea516963bb6a0018e => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:16.240329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cfe99-cb36-4cdf-85ee-404c0c2e32dc None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:16.240959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cfe99-cb36-4cdf-85ee-404c0c2e32dc None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:16.241065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cfe99-cb36-4cdf-85ee-404c0c2e32dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:16.259176 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-1d7cfe99-cb36-4cdf-85ee-404c0c2e32dc None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:16.260387 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1d7cfe99-cb36-4cdf-85ee-404c0c2e32dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:16.363547 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 924/1854] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:16.374230 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3105d-f236-447f-aa71-513f26ae253a admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:16.376618 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-90e3105d-f236-447f-aa71-513f26ae253a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:16.477465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3105d-f236-447f-aa71-513f26ae253a admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:16.481118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a127691-0493-4f8e-8bbf-d49d8c3949df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:16.481805 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a127691-0493-4f8e-8bbf-d49d8c3949df service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:16.482089 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a127691-0493-4f8e-8bbf-d49d8c3949df service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:16.482391 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a127691-0493-4f8e-8bbf-d49d8c3949df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:16.492128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a127691-0493-4f8e-8bbf-d49d8c3949df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:16.493730 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a127691-0493-4f8e-8bbf-d49d8c3949df service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:16.505183 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 931/1855] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:16.696117 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cfe99-cb36-4cdf-85ee-404c0c2e32dc None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:16.697574 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1d7cfe99-cb36-4cdf-85ee-404c0c2e32dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:16.711076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cfe99-cb36-4cdf-85ee-404c0c2e32dc None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:16.717871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc63087-a040-4788-aa01-6a613c22edda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:16.718216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc63087-a040-4788-aa01-6a613c22edda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:16.718500 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc63087-a040-4788-aa01-6a613c22edda admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:16.718833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc63087-a040-4788-aa01-6a613c22edda admin admin] PATH_INFO: `/v3/users/2d4acab793bf4dbf98bc8dea03e95644` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:16.720095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc63087-a040-4788-aa01-6a613c22edda admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4acab793bf4dbf98bc8dea03e95644)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:16.722780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc63087-a040-4788-aa01-6a613c22edda admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:16.908408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-bfc63087-a040-4788-aa01-6a613c22edda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4acab793bf4dbf98bc8dea03e95644'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:16.972032 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-bfc63087-a040-4788-aa01-6a613c22edda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4acab793bf4dbf98bc8dea03e95644'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:16.973473 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-bfc63087-a040-4788-aa01-6a613c22edda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4acab793bf4dbf98bc8dea03e95644'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:16.987205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-bfc63087-a040-4788-aa01-6a613c22edda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4acab793bf4dbf98bc8dea03e95644'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:16.988819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-bfc63087-a040-4788-aa01-6a613c22edda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4acab793bf4dbf98bc8dea03e95644'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:17.003160 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 925/1856] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:22:16 2022] DELETE /identity/v3/users/2d4acab793bf4dbf98bc8dea03e95644 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:17.008550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc70a7a-3be0-4fda-8ef0-ba9a073273d3 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:17.009045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc70a7a-3be0-4fda-8ef0-ba9a073273d3 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:17.009123 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc70a7a-3be0-4fda-8ef0-ba9a073273d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:17.018081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc63087-a040-4788-aa01-6a613c22edda admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:17.021103 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-bfc63087-a040-4788-aa01-6a613c22edda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:17.030028 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-adc70a7a-3be0-4fda-8ef0-ba9a073273d3 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:17.037660 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-adc70a7a-3be0-4fda-8ef0-ba9a073273d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:17.068243 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:17.130640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc63087-a040-4788-aa01-6a613c22edda admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:17.134546 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 932/1857] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:17.135803 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f96ce-230c-4c73-a406-6934da5814a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:17.136785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f96ce-230c-4c73-a406-6934da5814a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:17.137009 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f96ce-230c-4c73-a406-6934da5814a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:17.137279 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f96ce-230c-4c73-a406-6934da5814a3 admin admin] PATH_INFO: `/v3/projects/4e3c9b3d15e746f7b1ca34dc55cb67b4` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:17.138481 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f96ce-230c-4c73-a406-6934da5814a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3c9b3d15e746f7b1ca34dc55cb67b4)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:17.140372 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f96ce-230c-4c73-a406-6934da5814a3 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:17.156849 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc70a7a-3be0-4fda-8ef0-ba9a073273d3 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:17.159285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-adc70a7a-3be0-4fda-8ef0-ba9a073273d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:17.166679 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:17.244413 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc70a7a-3be0-4fda-8ef0-ba9a073273d3 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:17.249388 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badfbef-06e2-452b-bdfe-4c3082e11780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:17.251483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badfbef-06e2-452b-bdfe-4c3082e11780 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:17.252639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badfbef-06e2-452b-bdfe-4c3082e11780 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:17.253074 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badfbef-06e2-452b-bdfe-4c3082e11780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:17.265407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badfbef-06e2-452b-bdfe-4c3082e11780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:17.267521 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badfbef-06e2-452b-bdfe-4c3082e11780 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:17.274340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0d6f96ce-230c-4c73-a406-6934da5814a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3c9b3d15e746f7b1ca34dc55cb67b4', 'request_id': 'req-0d6f96ce-230c-4c73-a406-6934da5814a3'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:17.281633 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 933/1858] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:17.283290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0d6f96ce-230c-4c73-a406-6934da5814a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3c9b3d15e746f7b1ca34dc55cb67b4', 'request_id': 'req-0d6f96ce-230c-4c73-a406-6934da5814a3'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:17.349433 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0d6f96ce-230c-4c73-a406-6934da5814a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3c9b3d15e746f7b1ca34dc55cb67b4', 'request_id': 'req-0d6f96ce-230c-4c73-a406-6934da5814a3'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:17.362352 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0d6f96ce-230c-4c73-a406-6934da5814a3 admin admin] The token cache is being invalidate because project 4e3c9b3d15e746f7b1ca34dc55cb67b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:22:17.362732 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0d6f96ce-230c-4c73-a406-6934da5814a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:17.363996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0d6f96ce-230c-4c73-a406-6934da5814a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:17.366181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 926/1859] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:22:17 2022] DELETE /identity/v3/projects/4e3c9b3d15e746f7b1ca34dc55cb67b4 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:17.370045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badfbef-06e2-452b-bdfe-4c3082e11780 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:17.380066 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badfbef-06e2-452b-bdfe-4c3082e11780 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:17.446715 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afcb0b-fe66-4d7d-84fa-da5923bb6db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:17.447681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afcb0b-fe66-4d7d-84fa-da5923bb6db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:17.447959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afcb0b-fe66-4d7d-84fa-da5923bb6db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:17.448239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afcb0b-fe66-4d7d-84fa-da5923bb6db8 admin admin] PATH_INFO: `/v3/users/0f28c6832c194464be4f22dcf3c4b953` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:17.449628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afcb0b-fe66-4d7d-84fa-da5923bb6db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f28c6832c194464be4f22dcf3c4b953)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:17.451593 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afcb0b-fe66-4d7d-84fa-da5923bb6db8 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:17.635356 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-34afcb0b-fe66-4d7d-84fa-da5923bb6db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f28c6832c194464be4f22dcf3c4b953'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:17.636101 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-34afcb0b-fe66-4d7d-84fa-da5923bb6db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f28c6832c194464be4f22dcf3c4b953'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:17.636772 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-34afcb0b-fe66-4d7d-84fa-da5923bb6db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f28c6832c194464be4f22dcf3c4b953'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:17.650336 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-34afcb0b-fe66-4d7d-84fa-da5923bb6db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f28c6832c194464be4f22dcf3c4b953'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:17.652317 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:17.658664 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-34afcb0b-fe66-4d7d-84fa-da5923bb6db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f28c6832c194464be4f22dcf3c4b953'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:17.765631 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f96ce-230c-4c73-a406-6934da5814a3 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:17.765812 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 934/1860] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:22:17 2022] DELETE /identity/v3/users/0f28c6832c194464be4f22dcf3c4b953 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:17.765950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0d6f96ce-230c-4c73-a406-6934da5814a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:17.784235 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f96ce-230c-4c73-a406-6934da5814a3 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:17.852392 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267301ff-ed55-4e71-ad40-1705f831a7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:17.853605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267301ff-ed55-4e71-ad40-1705f831a7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:17.854023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267301ff-ed55-4e71-ad40-1705f831a7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:17.854361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267301ff-ed55-4e71-ad40-1705f831a7f6 admin admin] PATH_INFO: `/v3/projects/9cf925d2aa7b4613acaa8838a18a68d5` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:17.855999 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267301ff-ed55-4e71-ad40-1705f831a7f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf925d2aa7b4613acaa8838a18a68d5)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:17.858109 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267301ff-ed55-4e71-ad40-1705f831a7f6 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:18.011969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-267301ff-ed55-4e71-ad40-1705f831a7f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf925d2aa7b4613acaa8838a18a68d5', 'request_id': 'req-267301ff-ed55-4e71-ad40-1705f831a7f6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:18.019379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-267301ff-ed55-4e71-ad40-1705f831a7f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf925d2aa7b4613acaa8838a18a68d5', 'request_id': 'req-267301ff-ed55-4e71-ad40-1705f831a7f6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:18.137812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-267301ff-ed55-4e71-ad40-1705f831a7f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf925d2aa7b4613acaa8838a18a68d5', 'request_id': 'req-267301ff-ed55-4e71-ad40-1705f831a7f6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:18.152929 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-267301ff-ed55-4e71-ad40-1705f831a7f6 admin admin] The token cache is being invalidate because project 9cf925d2aa7b4613acaa8838a18a68d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:22:18.153224 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-267301ff-ed55-4e71-ad40-1705f831a7f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:18.156756 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-267301ff-ed55-4e71-ad40-1705f831a7f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:18.157597 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 927/1861] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:22:17 2022] DELETE /identity/v3/projects/9cf925d2aa7b4613acaa8838a18a68d5 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:22:18.161864 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afcb0b-fe66-4d7d-84fa-da5923bb6db8 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:18.163324 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-34afcb0b-fe66-4d7d-84fa-da5923bb6db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:18.177167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afcb0b-fe66-4d7d-84fa-da5923bb6db8 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:18.252694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc142622-f068-452b-8bf9-239f208cf559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:18.254051 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc142622-f068-452b-8bf9-239f208cf559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:18.254513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc142622-f068-452b-8bf9-239f208cf559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:18.254961 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc142622-f068-452b-8bf9-239f208cf559 admin admin] PATH_INFO: `/v3/users/cac4745f6598402eaf865a1c899d22fb` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:18.256784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc142622-f068-452b-8bf9-239f208cf559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cac4745f6598402eaf865a1c899d22fb)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:18.259383 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc142622-f068-452b-8bf9-239f208cf559 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:18.276349 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267301ff-ed55-4e71-ad40-1705f831a7f6 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:18.279129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-267301ff-ed55-4e71-ad40-1705f831a7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:18.293113 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267301ff-ed55-4e71-ad40-1705f831a7f6 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:18.299180 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea57c9-4818-4d54-a796-e5fcab7410f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:18.306557 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea57c9-4818-4d54-a796-e5fcab7410f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:18.306557 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea57c9-4818-4d54-a796-e5fcab7410f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:18.306557 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea57c9-4818-4d54-a796-e5fcab7410f2 admin admin] PATH_INFO: `/v3/projects/def3f9de42ec48b59a2732f190587eda` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:18.306557 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea57c9-4818-4d54-a796-e5fcab7410f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=def3f9de42ec48b59a2732f190587eda)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:18.306557 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea57c9-4818-4d54-a796-e5fcab7410f2 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:18.420219 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:18.498154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-10ea57c9-4818-4d54-a796-e5fcab7410f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def3f9de42ec48b59a2732f190587eda', 'request_id': 'req-10ea57c9-4818-4d54-a796-e5fcab7410f2'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:18.503415 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-cc142622-f068-452b-8bf9-239f208cf559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cac4745f6598402eaf865a1c899d22fb'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:18.504560 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-cc142622-f068-452b-8bf9-239f208cf559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cac4745f6598402eaf865a1c899d22fb'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:18.505574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-cc142622-f068-452b-8bf9-239f208cf559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cac4745f6598402eaf865a1c899d22fb'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:18.513185 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-10ea57c9-4818-4d54-a796-e5fcab7410f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def3f9de42ec48b59a2732f190587eda', 'request_id': 'req-10ea57c9-4818-4d54-a796-e5fcab7410f2'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:18.545413 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-cc142622-f068-452b-8bf9-239f208cf559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cac4745f6598402eaf865a1c899d22fb'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:18.558716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-cc142622-f068-452b-8bf9-239f208cf559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cac4745f6598402eaf865a1c899d22fb'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:18.584633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-10ea57c9-4818-4d54-a796-e5fcab7410f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def3f9de42ec48b59a2732f190587eda', 'request_id': 'req-10ea57c9-4818-4d54-a796-e5fcab7410f2'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:18.611339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-10ea57c9-4818-4d54-a796-e5fcab7410f2 admin admin] The token cache is being invalidate because project def3f9de42ec48b59a2732f190587eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:22:18.611640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-10ea57c9-4818-4d54-a796-e5fcab7410f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:18.612340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-10ea57c9-4818-4d54-a796-e5fcab7410f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:18.613996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 928/1862] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:22:18 2022] DELETE /identity/v3/projects/def3f9de42ec48b59a2732f190587eda => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:18.618619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888a409-74a4-4860-b5d1-b38f4682fe43 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:18.618901 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888a409-74a4-4860-b5d1-b38f4682fe43 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:18.619175 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888a409-74a4-4860-b5d1-b38f4682fe43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:18.636883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-f888a409-74a4-4860-b5d1-b38f4682fe43 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:18.638078 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f888a409-74a4-4860-b5d1-b38f4682fe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:18.674618 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 935/1863] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:22:18 2022] DELETE /identity/v3/users/cac4745f6598402eaf865a1c899d22fb => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:18.705338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 929/1864] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:22:18.713692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee54e3a-1870-4111-96fa-c19f17273220 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:18.713692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee54e3a-1870-4111-96fa-c19f17273220 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:18.714154 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee54e3a-1870-4111-96fa-c19f17273220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:18.736998 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-6ee54e3a-1870-4111-96fa-c19f17273220 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:18.738498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-6ee54e3a-1870-4111-96fa-c19f17273220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:18.811830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 936/1865] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:22:18.816866 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888a409-74a4-4860-b5d1-b38f4682fe43 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:18.832858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888a409-74a4-4860-b5d1-b38f4682fe43 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:18.833894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a49815-35af-4c43-a362-a48eb5f79f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:18.834654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a49815-35af-4c43-a362-a48eb5f79f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:18.834992 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a49815-35af-4c43-a362-a48eb5f79f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:18.835344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a49815-35af-4c43-a362-a48eb5f79f4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:18.836164 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a49815-35af-4c43-a362-a48eb5f79f4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:22:18.836706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a49815-35af-4c43-a362-a48eb5f79f4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:18.838351 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a49815-35af-4c43-a362-a48eb5f79f4e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:18.851535 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 930/1866] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:22:18.855601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee54e3a-1870-4111-96fa-c19f17273220 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:18.861413 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:18.865422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee54e3a-1870-4111-96fa-c19f17273220 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:18.870448 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3365c-2947-44b8-a80c-ebad7930dbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:18.871116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3365c-2947-44b8-a80c-ebad7930dbd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:18.871396 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3365c-2947-44b8-a80c-ebad7930dbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:18.871669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3365c-2947-44b8-a80c-ebad7930dbd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:18.873372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3365c-2947-44b8-a80c-ebad7930dbd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:18.877671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3365c-2947-44b8-a80c-ebad7930dbd8 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:18.991956 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 937/1867] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:22:18 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:18.996192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a49815-35af-4c43-a362-a48eb5f79f4e admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:19.006251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a49815-35af-4c43-a362-a48eb5f79f4e admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:19.063614 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd766af-8f23-4471-bc6f-5017bfbe868f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:19.064244 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd766af-8f23-4471-bc6f-5017bfbe868f admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:19.064551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd766af-8f23-4471-bc6f-5017bfbe868f admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:19.064847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd766af-8f23-4471-bc6f-5017bfbe868f admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:19.065552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd766af-8f23-4471-bc6f-5017bfbe868f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:19.067649 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd766af-8f23-4471-bc6f-5017bfbe868f admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:19.071087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3365c-2947-44b8-a80c-ebad7930dbd8 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:19.073577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-35d3365c-2947-44b8-a80c-ebad7930dbd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:19.089126 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3365c-2947-44b8-a80c-ebad7930dbd8 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:19.104001 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06419bf3-0a3f-40e6-8f12-7d4c5658f295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:19.105131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06419bf3-0a3f-40e6-8f12-7d4c5658f295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:19.105727 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06419bf3-0a3f-40e6-8f12-7d4c5658f295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:19.106008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06419bf3-0a3f-40e6-8f12-7d4c5658f295 admin admin] PATH_INFO: `/v3/projects/33a4ddd316cf412a8673020404f647aa` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:19.107292 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06419bf3-0a3f-40e6-8f12-7d4c5658f295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a4ddd316cf412a8673020404f647aa)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:19.109417 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06419bf3-0a3f-40e6-8f12-7d4c5658f295 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:19.155849 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 931/1868] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:22:18 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:19.159819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd766af-8f23-4471-bc6f-5017bfbe868f admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:19.170638 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd766af-8f23-4471-bc6f-5017bfbe868f admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:19.175571 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745f147-e3e5-4191-aa11-d255d80f8704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:19.176247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745f147-e3e5-4191-aa11-d255d80f8704 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:19.176540 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745f147-e3e5-4191-aa11-d255d80f8704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:19.176842 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745f147-e3e5-4191-aa11-d255d80f8704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:19.177607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745f147-e3e5-4191-aa11-d255d80f8704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:19.179211 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745f147-e3e5-4191-aa11-d255d80f8704 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:19.189969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 932/1869] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:22:19.193836 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745f147-e3e5-4191-aa11-d255d80f8704 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:19.203697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745f147-e3e5-4191-aa11-d255d80f8704 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:19.209934 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295a4e8-869f-4f6b-b118-e17c1a3a4bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:19.210628 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295a4e8-869f-4f6b-b118-e17c1a3a4bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:19.211039 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295a4e8-869f-4f6b-b118-e17c1a3a4bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:19.211421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295a4e8-869f-4f6b-b118-e17c1a3a4bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:19.212044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295a4e8-869f-4f6b-b118-e17c1a3a4bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:19.213694 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295a4e8-869f-4f6b-b118-e17c1a3a4bb2 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:19.226437 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-06419bf3-0a3f-40e6-8f12-7d4c5658f295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a4ddd316cf412a8673020404f647aa', 'request_id': 'req-06419bf3-0a3f-40e6-8f12-7d4c5658f295'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:19.230352 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 933/1870] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:22:19.231512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295a4e8-869f-4f6b-b118-e17c1a3a4bb2 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:19.242065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295a4e8-869f-4f6b-b118-e17c1a3a4bb2 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:19.250689 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:19.302649 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f51a5-569c-4414-a916-745156b94949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:19.303570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f51a5-569c-4414-a916-745156b94949 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:19.303857 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f51a5-569c-4414-a916-745156b94949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:19.304141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f51a5-569c-4414-a916-745156b94949 admin admin] PATH_INFO: `/v3/projects/fd9fa22187c34b268ca0cbfbd82c6d3c/users/dfc33578eafc4cc4a784211e65627e24/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:19.320654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f51a5-569c-4414-a916-745156b94949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd9fa22187c34b268ca0cbfbd82c6d3c, user_id=dfc33578eafc4cc4a784211e65627e24, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:19.323253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f51a5-569c-4414-a916-745156b94949 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:19.332078 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-06419bf3-0a3f-40e6-8f12-7d4c5658f295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a4ddd316cf412a8673020404f647aa', 'request_id': 'req-06419bf3-0a3f-40e6-8f12-7d4c5658f295'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:19.339475 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-06419bf3-0a3f-40e6-8f12-7d4c5658f295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a4ddd316cf412a8673020404f647aa', 'request_id': 'req-06419bf3-0a3f-40e6-8f12-7d4c5658f295'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:19.350160 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-06419bf3-0a3f-40e6-8f12-7d4c5658f295 admin admin] The token cache is being invalidate because project 33a4ddd316cf412a8673020404f647aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:22:19.350452 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-06419bf3-0a3f-40e6-8f12-7d4c5658f295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:19.351129 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-06419bf3-0a3f-40e6-8f12-7d4c5658f295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:19.352727 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 938/1871] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:22:19 2022] DELETE /identity/v3/projects/33a4ddd316cf412a8673020404f647aa => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:22:19.357350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cc1c6-144b-408d-896a-f2eaf54d6804 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:19.357640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cc1c6-144b-408d-896a-f2eaf54d6804 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:19.357948 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cc1c6-144b-408d-896a-f2eaf54d6804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:19.376480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-2f2cc1c6-144b-408d-896a-f2eaf54d6804 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:19.377734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2f2cc1c6-144b-408d-896a-f2eaf54d6804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:19.388369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 939/1872] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:22:19.389754 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 934/1873] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:19 2022] PUT /identity/v3/projects/fd9fa22187c34b268ca0cbfbd82c6d3c/users/dfc33578eafc4cc4a784211e65627e24/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:19.396896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a735ccf-33d5-4443-8702-ac7bbc2d5e29 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:19.397356 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a735ccf-33d5-4443-8702-ac7bbc2d5e29 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:19.398262 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a735ccf-33d5-4443-8702-ac7bbc2d5e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:19.412622 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef25134-7fdd-48d3-a5c2-e9c4b188280c None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:19.423183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef25134-7fdd-48d3-a5c2-e9c4b188280c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:19.423183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef25134-7fdd-48d3-a5c2-e9c4b188280c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:19.429761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-4a735ccf-33d5-4443-8702-ac7bbc2d5e29 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:19.432234 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-4a735ccf-33d5-4443-8702-ac7bbc2d5e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:19.475087 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-1ef25134-7fdd-48d3-a5c2-e9c4b188280c None None] MFA Rules not processed for user `dfc33578eafc4cc4a784211e65627e24`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:19.476932 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1ef25134-7fdd-48d3-a5c2-e9c4b188280c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:19.529784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 940/1874] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:19.530880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a735ccf-33d5-4443-8702-ac7bbc2d5e29 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:19.556752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a735ccf-33d5-4443-8702-ac7bbc2d5e29 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:19.561322 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 935/1875] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:19.566453 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef25134-7fdd-48d3-a5c2-e9c4b188280c None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:19.567360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1ef25134-7fdd-48d3-a5c2-e9c4b188280c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:19.570729 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2f320-65d6-448b-a818-b137c642a7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:19.571311 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2f320-65d6-448b-a818-b137c642a7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:19.571593 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2f320-65d6-448b-a818-b137c642a7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:19.571855 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2f320-65d6-448b-a818-b137c642a7e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:19.572674 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2f320-65d6-448b-a818-b137c642a7e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:22:19.572985 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2f320-65d6-448b-a818-b137c642a7e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:19.574583 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2f320-65d6-448b-a818-b137c642a7e4 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:19.591945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 941/1876] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:22:19.601168 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef25134-7fdd-48d3-a5c2-e9c4b188280c None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:19.604145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2f320-65d6-448b-a818-b137c642a7e4 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:19.606473 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815ceef-38b1-4f0a-a844-33039ce7688a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:19.607210 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815ceef-38b1-4f0a-a844-33039ce7688a admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:19.607455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815ceef-38b1-4f0a-a844-33039ce7688a admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:19.607746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815ceef-38b1-4f0a-a844-33039ce7688a admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:19.608790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815ceef-38b1-4f0a-a844-33039ce7688a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:19.610735 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815ceef-38b1-4f0a-a844-33039ce7688a admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:19.617664 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2f320-65d6-448b-a818-b137c642a7e4 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:19.624103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7e420-75c9-42d6-a1b0-fa0e9f787435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:19.624817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7e420-75c9-42d6-a1b0-fa0e9f787435 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:19.625105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7e420-75c9-42d6-a1b0-fa0e9f787435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:19.625389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7e420-75c9-42d6-a1b0-fa0e9f787435 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:19.626143 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7e420-75c9-42d6-a1b0-fa0e9f787435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:19.629070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7e420-75c9-42d6-a1b0-fa0e9f787435 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:19.696620 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 936/1877] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:22:19 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:22:19.698634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815ceef-38b1-4f0a-a844-33039ce7688a admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:19.727462 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 942/1878] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:22:19 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:19.728773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7e420-75c9-42d6-a1b0-fa0e9f787435 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:19.761886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:19.768117 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815ceef-38b1-4f0a-a844-33039ce7688a admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:19.783042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:19.814734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7e420-75c9-42d6-a1b0-fa0e9f787435 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:19.819940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf8800-31d8-4a57-8fb4-f9bb099eb3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:19.820887 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf8800-31d8-4a57-8fb4-f9bb099eb3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:19.821096 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf8800-31d8-4a57-8fb4-f9bb099eb3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:19.821446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf8800-31d8-4a57-8fb4-f9bb099eb3e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:19.822326 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf8800-31d8-4a57-8fb4-f9bb099eb3e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:19.824306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf8800-31d8-4a57-8fb4-f9bb099eb3e6 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:19.844115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486ae23-00fe-43b9-9513-91af5c521b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:19.844938 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486ae23-00fe-43b9-9513-91af5c521b1c admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:19.845286 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486ae23-00fe-43b9-9513-91af5c521b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:19.845952 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486ae23-00fe-43b9-9513-91af5c521b1c admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:19.846517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486ae23-00fe-43b9-9513-91af5c521b1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:19.849049 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486ae23-00fe-43b9-9513-91af5c521b1c admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:19.926599 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 943/1879] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:22:19 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:19.931249 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf8800-31d8-4a57-8fb4-f9bb099eb3e6 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:19.939161 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 937/1880] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:22:19 2022] POST /identity/v3/users => generated 298 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:22:19.942891 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486ae23-00fe-43b9-9513-91af5c521b1c admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:19.945287 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf8800-31d8-4a57-8fb4-f9bb099eb3e6 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:19.949993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012477de-d0fa-44c8-a065-6984facb472f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:19.950664 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012477de-d0fa-44c8-a065-6984facb472f admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:19.954624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012477de-d0fa-44c8-a065-6984facb472f admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:19.954624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012477de-d0fa-44c8-a065-6984facb472f admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:19.954624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012477de-d0fa-44c8-a065-6984facb472f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:19.954920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486ae23-00fe-43b9-9513-91af5c521b1c admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:19.955016 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012477de-d0fa-44c8-a065-6984facb472f admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:19.959073 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aea960-435f-4546-b11f-dc62c74d0690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:19.959737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aea960-435f-4546-b11f-dc62c74d0690 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:19.960027 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aea960-435f-4546-b11f-dc62c74d0690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:19.960342 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aea960-435f-4546-b11f-dc62c74d0690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:19.961113 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aea960-435f-4546-b11f-dc62c74d0690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:19.962696 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aea960-435f-4546-b11f-dc62c74d0690 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:19.967448 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 944/1881] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:22:19.968596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012477de-d0fa-44c8-a065-6984facb472f admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:19.976700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 938/1882] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:22:19.979273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012477de-d0fa-44c8-a065-6984facb472f admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:19.984080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073e760-52d6-426c-9334-e45b930901fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:19.984778 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073e760-52d6-426c-9334-e45b930901fd admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:19.985085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073e760-52d6-426c-9334-e45b930901fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:19.985331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073e760-52d6-426c-9334-e45b930901fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:19.986202 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073e760-52d6-426c-9334-e45b930901fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:19.986362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aea960-435f-4546-b11f-dc62c74d0690 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:19.987879 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073e760-52d6-426c-9334-e45b930901fd admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:19.996698 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aea960-435f-4546-b11f-dc62c74d0690 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:19.999901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 945/1883] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:20.003486 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073e760-52d6-426c-9334-e45b930901fd admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:20.005145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d439766-1cd7-4758-88c0-9431cab7ec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:20.006071 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d439766-1cd7-4758-88c0-9431cab7ec7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:20.006350 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d439766-1cd7-4758-88c0-9431cab7ec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:20.006655 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d439766-1cd7-4758-88c0-9431cab7ec7d admin admin] PATH_INFO: `/v3/projects/438951c5455f4c10aee1f2ddffc99dec/users/15e7b0592e4740949fdb4d1c5aebc0f5/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:20.015023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073e760-52d6-426c-9334-e45b930901fd admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:20.021469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648a3fd-c789-4b17-b546-cf40468b67a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:20.022626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648a3fd-c789-4b17-b546-cf40468b67a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:20.022808 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d439766-1cd7-4758-88c0-9431cab7ec7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=438951c5455f4c10aee1f2ddffc99dec, user_id=15e7b0592e4740949fdb4d1c5aebc0f5, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:20.022945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648a3fd-c789-4b17-b546-cf40468b67a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:20.023267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648a3fd-c789-4b17-b546-cf40468b67a2 admin admin] PATH_INFO: `/v3/projects/0721af5a9eb041bc889d113e45e2ad98/users/74b00bc63dae4808aceb40d323e963cc/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:20.025500 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d439766-1cd7-4758-88c0-9431cab7ec7d admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:20.040968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648a3fd-c789-4b17-b546-cf40468b67a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0721af5a9eb041bc889d113e45e2ad98, user_id=74b00bc63dae4808aceb40d323e963cc, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:20.043651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648a3fd-c789-4b17-b546-cf40468b67a2 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:20.116341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 939/1884] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:19 2022] PUT /identity/v3/projects/438951c5455f4c10aee1f2ddffc99dec/users/15e7b0592e4740949fdb4d1c5aebc0f5/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:20.120184 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d439766-1cd7-4758-88c0-9431cab7ec7d admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:20.127824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 946/1885] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:20 2022] PUT /identity/v3/projects/0721af5a9eb041bc889d113e45e2ad98/users/74b00bc63dae4808aceb40d323e963cc/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:22:20.138280 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f175b-4077-4408-8094-65ce597e559a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:20.138561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f175b-4077-4408-8094-65ce597e559a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:20.138987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f175b-4077-4408-8094-65ce597e559a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:20.171717 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-656f175b-4077-4408-8094-65ce597e559a None None] MFA Rules not processed for user `74b00bc63dae4808aceb40d323e963cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:20.172979 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-656f175b-4077-4408-8094-65ce597e559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:20.187834 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d439766-1cd7-4758-88c0-9431cab7ec7d admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:20.239486 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 947/1886] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:22:20.244054 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f175b-4077-4408-8094-65ce597e559a None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:20.253208 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b99ecc-1727-41a8-aece-cb75f94cbd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:20.254429 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b99ecc-1727-41a8-aece-cb75f94cbd3e admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:20.254713 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b99ecc-1727-41a8-aece-cb75f94cbd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:20.254991 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b99ecc-1727-41a8-aece-cb75f94cbd3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:20.255760 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b99ecc-1727-41a8-aece-cb75f94cbd3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:20.257400 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b99ecc-1727-41a8-aece-cb75f94cbd3e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:20.267370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 940/1887] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:22:20.272027 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b99ecc-1727-41a8-aece-cb75f94cbd3e admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:20.283430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b99ecc-1727-41a8-aece-cb75f94cbd3e admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:20.289418 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28182f8-1ea5-4a04-a971-8a6f6cf8c1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:20.291308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28182f8-1ea5-4a04-a971-8a6f6cf8c1e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:20.291308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28182f8-1ea5-4a04-a971-8a6f6cf8c1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:20.291308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28182f8-1ea5-4a04-a971-8a6f6cf8c1e1 admin admin] PATH_INFO: `/v3/projects/438951c5455f4c10aee1f2ddffc99dec/users/15e7b0592e4740949fdb4d1c5aebc0f5/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:20.293147 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28182f8-1ea5-4a04-a971-8a6f6cf8c1e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=438951c5455f4c10aee1f2ddffc99dec, user_id=15e7b0592e4740949fdb4d1c5aebc0f5, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:20.295883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28182f8-1ea5-4a04-a971-8a6f6cf8c1e1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:20.299503 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:20.305494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:20.310494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f175b-4077-4408-8094-65ce597e559a None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:20.310852 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 941/1888] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:20 2022] PUT /identity/v3/projects/438951c5455f4c10aee1f2ddffc99dec/users/15e7b0592e4740949fdb4d1c5aebc0f5/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:22:20.326272 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b198fe-6951-4064-b09e-128614fade5d None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:20.326761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b198fe-6951-4064-b09e-128614fade5d None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:20.327122 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b198fe-6951-4064-b09e-128614fade5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:20.361579 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-d4b198fe-6951-4064-b09e-128614fade5d None None] MFA Rules not processed for user `15e7b0592e4740949fdb4d1c5aebc0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:20.363466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d4b198fe-6951-4064-b09e-128614fade5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:20.376151 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214aed2-7f28-4c3d-a32c-36dfa9f1f27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:20.376780 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214aed2-7f28-4c3d-a32c-36dfa9f1f27f admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:20.377066 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214aed2-7f28-4c3d-a32c-36dfa9f1f27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:20.377396 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214aed2-7f28-4c3d-a32c-36dfa9f1f27f admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:20.378111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214aed2-7f28-4c3d-a32c-36dfa9f1f27f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:20.380061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214aed2-7f28-4c3d-a32c-36dfa9f1f27f admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:20.437511 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 942/1889] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:20.448522 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b198fe-6951-4064-b09e-128614fade5d None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:20.450150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d4b198fe-6951-4064-b09e-128614fade5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:20.454621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 948/1890] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:22:20 2022] POST /identity/v3/projects => generated 369 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:22:20.458378 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214aed2-7f28-4c3d-a32c-36dfa9f1f27f admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:20.516224 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b198fe-6951-4064-b09e-128614fade5d None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:20.523968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214aed2-7f28-4c3d-a32c-36dfa9f1f27f admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:20.529145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66def4a2-371b-4230-8b09-e4a8afd70d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:20.529793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66def4a2-371b-4230-8b09-e4a8afd70d94 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:20.530074 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66def4a2-371b-4230-8b09-e4a8afd70d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:20.530369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66def4a2-371b-4230-8b09-e4a8afd70d94 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:20.531065 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66def4a2-371b-4230-8b09-e4a8afd70d94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:20.533041 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66def4a2-371b-4230-8b09-e4a8afd70d94 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:20.568643 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2eddd9-11be-450c-a905-696f202da4b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:20.569309 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2eddd9-11be-450c-a905-696f202da4b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:20.569598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2eddd9-11be-450c-a905-696f202da4b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:20.569874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2eddd9-11be-450c-a905-696f202da4b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:20.620875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 949/1891] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:22:20 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:22:20.622190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:20.625040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66def4a2-371b-4230-8b09-e4a8afd70d94 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:20.636982 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2eddd9-11be-450c-a905-696f202da4b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:20.638688 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2eddd9-11be-450c-a905-696f202da4b6 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:20.642121 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66def4a2-371b-4230-8b09-e4a8afd70d94 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:20.650798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6fd49-a4c6-47c6-b1fd-f379a56c4753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:20.651057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 943/1892] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:22:20.651851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6fd49-a4c6-47c6-b1fd-f379a56c4753 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:20.660861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6fd49-a4c6-47c6-b1fd-f379a56c4753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:20.660861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6fd49-a4c6-47c6-b1fd-f379a56c4753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:20.660861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6fd49-a4c6-47c6-b1fd-f379a56c4753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:20.660861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6fd49-a4c6-47c6-b1fd-f379a56c4753 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:20.666650 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 950/1893] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:20.670929 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2eddd9-11be-450c-a905-696f202da4b6 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:20.683311 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2eddd9-11be-450c-a905-696f202da4b6 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:20.688193 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651fd3e-6510-410f-9bb9-cd4c91e8bd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:20.689139 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651fd3e-6510-410f-9bb9-cd4c91e8bd1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:20.689430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651fd3e-6510-410f-9bb9-cd4c91e8bd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:20.689712 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651fd3e-6510-410f-9bb9-cd4c91e8bd1d admin admin] PATH_INFO: `/v3/projects/368753c87c1d4e3d96ed986ae2448fbe/users/8ea6f9319897411d9a1991528ef91505/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:20.706507 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651fd3e-6510-410f-9bb9-cd4c91e8bd1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=368753c87c1d4e3d96ed986ae2448fbe, user_id=8ea6f9319897411d9a1991528ef91505, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:20.711408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651fd3e-6510-410f-9bb9-cd4c91e8bd1d admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:20.770711 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 944/1894] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:20 2022] PUT /identity/v3/projects/368753c87c1d4e3d96ed986ae2448fbe/users/8ea6f9319897411d9a1991528ef91505/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:22:20.773531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6fd49-a4c6-47c6-b1fd-f379a56c4753 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:20.774527 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651fd3e-6510-410f-9bb9-cd4c91e8bd1d admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:20.784164 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6fd49-a4c6-47c6-b1fd-f379a56c4753 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:20.853577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651fd3e-6510-410f-9bb9-cd4c91e8bd1d admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:20.858097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25f5b4-42c4-45dc-a738-4c524cb561ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:20.858448 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f819d-1322-436f-a011-28270eea3072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:20.858764 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25f5b4-42c4-45dc-a738-4c524cb561ef service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:20.859126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f819d-1322-436f-a011-28270eea3072 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:20.859330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25f5b4-42c4-45dc-a738-4c524cb561ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:20.859449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f819d-1322-436f-a011-28270eea3072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:20.859623 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25f5b4-42c4-45dc-a738-4c524cb561ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:20.859714 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f819d-1322-436f-a011-28270eea3072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:20.860394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f819d-1322-436f-a011-28270eea3072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:20.862050 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f819d-1322-436f-a011-28270eea3072 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:20.873686 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 945/1895] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:22:20.877785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f819d-1322-436f-a011-28270eea3072 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:20.888470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f819d-1322-436f-a011-28270eea3072 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:20.892716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:20.899028 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da466213-2851-44bb-8d3d-10da3b1255de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:20.901086 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da466213-2851-44bb-8d3d-10da3b1255de admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:20.901373 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da466213-2851-44bb-8d3d-10da3b1255de admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:20.901654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da466213-2851-44bb-8d3d-10da3b1255de admin admin] PATH_INFO: `/v3/projects/368753c87c1d4e3d96ed986ae2448fbe/users/8ea6f9319897411d9a1991528ef91505/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:20.904125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da466213-2851-44bb-8d3d-10da3b1255de admin admin] RBAC: Authorizing `identity:create_grant(project_id=368753c87c1d4e3d96ed986ae2448fbe, user_id=8ea6f9319897411d9a1991528ef91505, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:20.906952 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da466213-2851-44bb-8d3d-10da3b1255de admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:20.918876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 946/1896] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:20 2022] PUT /identity/v3/projects/368753c87c1d4e3d96ed986ae2448fbe/users/8ea6f9319897411d9a1991528ef91505/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:22:20.930161 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b5aac-1a19-4549-b92f-3c55758e2600 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:20.930424 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b5aac-1a19-4549-b92f-3c55758e2600 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:20.930647 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b5aac-1a19-4549-b92f-3c55758e2600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:20.937421 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25f5b4-42c4-45dc-a738-4c524cb561ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:20.940129 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25f5b4-42c4-45dc-a738-4c524cb561ef service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:20.956869 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 951/1897] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:22:20.973530 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-440b5aac-1a19-4549-b92f-3c55758e2600 None None] MFA Rules not processed for user `8ea6f9319897411d9a1991528ef91505`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:20.975684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-440b5aac-1a19-4549-b92f-3c55758e2600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:21.095612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 947/1898] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:20 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:22:21.107539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25f5b4-42c4-45dc-a738-4c524cb561ef service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:21.109450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2e25f5b4-42c4-45dc-a738-4c524cb561ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:21.123974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25f5b4-42c4-45dc-a738-4c524cb561ef service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:21.178290 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b465d28-ccf1-43a5-b3b9-f83e6102ca4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:21.178987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b465d28-ccf1-43a5-b3b9-f83e6102ca4d service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:21.179273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b465d28-ccf1-43a5-b3b9-f83e6102ca4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:21.181065 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b465d28-ccf1-43a5-b3b9-f83e6102ca4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:21.188959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b465d28-ccf1-43a5-b3b9-f83e6102ca4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:21.190396 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b465d28-ccf1-43a5-b3b9-f83e6102ca4d service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:21.200724 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 952/1899] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:21 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:24.536506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b5aac-1a19-4549-b92f-3c55758e2600 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:24.579899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:24.618725 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b5aac-1a19-4549-b92f-3c55758e2600 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:24.623806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80363e58-e90f-492a-bf80-24cfa454f6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:24.624766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80363e58-e90f-492a-bf80-24cfa454f6f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:24.625052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80363e58-e90f-492a-bf80-24cfa454f6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:24.625328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80363e58-e90f-492a-bf80-24cfa454f6f1 admin admin] PATH_INFO: `/v3/users/dfc33578eafc4cc4a784211e65627e24` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:24.626556 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80363e58-e90f-492a-bf80-24cfa454f6f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfc33578eafc4cc4a784211e65627e24)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:24.628697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80363e58-e90f-492a-bf80-24cfa454f6f1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:24.700788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b465d28-ccf1-43a5-b3b9-f83e6102ca4d service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:24.713339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b465d28-ccf1-43a5-b3b9-f83e6102ca4d service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:24.717821 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc532f-1d24-4a2c-a5b7-7dae344eb68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:24.718638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc532f-1d24-4a2c-a5b7-7dae344eb68e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:24.718919 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc532f-1d24-4a2c-a5b7-7dae344eb68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:24.719192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc532f-1d24-4a2c-a5b7-7dae344eb68e admin admin] PATH_INFO: `/v3/users/74b00bc63dae4808aceb40d323e963cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:24.721034 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc532f-1d24-4a2c-a5b7-7dae344eb68e admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b00bc63dae4808aceb40d323e963cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:24.723608 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc532f-1d24-4a2c-a5b7-7dae344eb68e admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:24.880057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-80363e58-e90f-492a-bf80-24cfa454f6f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfc33578eafc4cc4a784211e65627e24'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:24.936224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-62fc532f-1d24-4a2c-a5b7-7dae344eb68e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b00bc63dae4808aceb40d323e963cc'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:24.936925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-62fc532f-1d24-4a2c-a5b7-7dae344eb68e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b00bc63dae4808aceb40d323e963cc'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:24.937613 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-62fc532f-1d24-4a2c-a5b7-7dae344eb68e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b00bc63dae4808aceb40d323e963cc'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:24.951199 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-62fc532f-1d24-4a2c-a5b7-7dae344eb68e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b00bc63dae4808aceb40d323e963cc'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:24.958219 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-62fc532f-1d24-4a2c-a5b7-7dae344eb68e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b00bc63dae4808aceb40d323e963cc'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:24.970593 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-80363e58-e90f-492a-bf80-24cfa454f6f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfc33578eafc4cc4a784211e65627e24'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:24.971210 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-80363e58-e90f-492a-bf80-24cfa454f6f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfc33578eafc4cc4a784211e65627e24'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:24.984829 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-80363e58-e90f-492a-bf80-24cfa454f6f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfc33578eafc4cc4a784211e65627e24'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:24.985497 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-80363e58-e90f-492a-bf80-24cfa454f6f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfc33578eafc4cc4a784211e65627e24'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:24.999082 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 948/1900] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:22:24 2022] DELETE /identity/v3/users/dfc33578eafc4cc4a784211e65627e24 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:22:24.999910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80363e58-e90f-492a-bf80-24cfa454f6f1 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:25.001325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-80363e58-e90f-492a-bf80-24cfa454f6f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:25.047208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 953/1901] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:22:24 2022] DELETE /identity/v3/users/74b00bc63dae4808aceb40d323e963cc => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:25.048348 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf719241-2e3c-4ba2-a7e0-58919ffa7a3c None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:25.048683 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf719241-2e3c-4ba2-a7e0-58919ffa7a3c None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:25.048969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf719241-2e3c-4ba2-a7e0-58919ffa7a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:25.068574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-bf719241-2e3c-4ba2-a7e0-58919ffa7a3c None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:25.069742 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-bf719241-2e3c-4ba2-a7e0-58919ffa7a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:25.081312 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80363e58-e90f-492a-bf80-24cfa454f6f1 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:25.107640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:25.136021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:25.136420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 954/1902] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:25.138069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca05b8-dd1d-4b41-9e2e-ea1c38876344 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:25.138362 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca05b8-dd1d-4b41-9e2e-ea1c38876344 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:25.138644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca05b8-dd1d-4b41-9e2e-ea1c38876344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:25.143325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d3c0a-6019-4a54-8dcc-1fee23b4a1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:25.144878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d3c0a-6019-4a54-8dcc-1fee23b4a1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:25.145258 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d3c0a-6019-4a54-8dcc-1fee23b4a1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:25.145543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d3c0a-6019-4a54-8dcc-1fee23b4a1b7 admin admin] PATH_INFO: `/v3/users/ce33b857336f4461a116b9af92e2d0bc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:25.146810 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d3c0a-6019-4a54-8dcc-1fee23b4a1b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce33b857336f4461a116b9af92e2d0bc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:25.149099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d3c0a-6019-4a54-8dcc-1fee23b4a1b7 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:25.159555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-2aca05b8-dd1d-4b41-9e2e-ea1c38876344 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:25.161383 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2aca05b8-dd1d-4b41-9e2e-ea1c38876344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:25.169460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 955/1903] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:25.170272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca05b8-dd1d-4b41-9e2e-ea1c38876344 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:25.171599 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2aca05b8-dd1d-4b41-9e2e-ea1c38876344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:25.227741 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca05b8-dd1d-4b41-9e2e-ea1c38876344 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:25.231367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bbfe3-5118-40c1-b059-07426f16b3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:25.232009 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bbfe3-5118-40c1-b059-07426f16b3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:25.232289 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bbfe3-5118-40c1-b059-07426f16b3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:25.232566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bbfe3-5118-40c1-b059-07426f16b3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:25.241904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bbfe3-5118-40c1-b059-07426f16b3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:25.243385 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bbfe3-5118-40c1-b059-07426f16b3c4 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:25.252793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 956/1904] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:25.253698 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bbfe3-5118-40c1-b059-07426f16b3c4 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:25.255264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-7a2bbfe3-5118-40c1-b059-07426f16b3c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:25.266608 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bbfe3-5118-40c1-b059-07426f16b3c4 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:25.271605 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620127a7-108f-4fa0-b60a-65b48a3569f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:25.272274 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620127a7-108f-4fa0-b60a-65b48a3569f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:25.272555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620127a7-108f-4fa0-b60a-65b48a3569f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:25.272879 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620127a7-108f-4fa0-b60a-65b48a3569f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:25.283279 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620127a7-108f-4fa0-b60a-65b48a3569f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:25.284484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620127a7-108f-4fa0-b60a-65b48a3569f0 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:25.295140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 957/1905] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:25.346067 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-be0d3c0a-6019-4a54-8dcc-1fee23b4a1b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce33b857336f4461a116b9af92e2d0bc'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:25.451307 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-be0d3c0a-6019-4a54-8dcc-1fee23b4a1b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce33b857336f4461a116b9af92e2d0bc'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:25.451968 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-be0d3c0a-6019-4a54-8dcc-1fee23b4a1b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce33b857336f4461a116b9af92e2d0bc'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:25.465844 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-be0d3c0a-6019-4a54-8dcc-1fee23b4a1b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce33b857336f4461a116b9af92e2d0bc'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:25.466766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-be0d3c0a-6019-4a54-8dcc-1fee23b4a1b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce33b857336f4461a116b9af92e2d0bc'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:25.481213 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 949/1906] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:22:24 2022] DELETE /identity/v3/users/ce33b857336f4461a116b9af92e2d0bc => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:25.485768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14877d57-0aad-4cd0-8924-4ce8eb802587 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:25.486062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14877d57-0aad-4cd0-8924-4ce8eb802587 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:25.486350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14877d57-0aad-4cd0-8924-4ce8eb802587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:25.507343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-14877d57-0aad-4cd0-8924-4ce8eb802587 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:25.508750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-14877d57-0aad-4cd0-8924-4ce8eb802587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:25.609498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 958/1907] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:22:25.623279 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d3c0a-6019-4a54-8dcc-1fee23b4a1b7 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:25.624740 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-be0d3c0a-6019-4a54-8dcc-1fee23b4a1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:25.698893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d3c0a-6019-4a54-8dcc-1fee23b4a1b7 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:25.704808 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff4b1b-0fdc-4258-96b2-3d594a0e4009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:25.706038 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff4b1b-0fdc-4258-96b2-3d594a0e4009 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:25.706328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff4b1b-0fdc-4258-96b2-3d594a0e4009 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:25.706607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff4b1b-0fdc-4258-96b2-3d594a0e4009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:25.719855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff4b1b-0fdc-4258-96b2-3d594a0e4009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:25.721931 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff4b1b-0fdc-4258-96b2-3d594a0e4009 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:25.737138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 950/1908] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:25.872488 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14877d57-0aad-4cd0-8924-4ce8eb802587 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:25.873501 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-14877d57-0aad-4cd0-8924-4ce8eb802587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:25.886117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14877d57-0aad-4cd0-8924-4ce8eb802587 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:25.918018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e96c4-4d41-491f-98c3-aebf3d483550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:25.919111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e96c4-4d41-491f-98c3-aebf3d483550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:25.920291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e96c4-4d41-491f-98c3-aebf3d483550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:25.921979 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e96c4-4d41-491f-98c3-aebf3d483550 admin admin] PATH_INFO: `/v3/projects/0721af5a9eb041bc889d113e45e2ad98` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:25.923164 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e96c4-4d41-491f-98c3-aebf3d483550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0721af5a9eb041bc889d113e45e2ad98)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:25.926918 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e96c4-4d41-491f-98c3-aebf3d483550 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:25.978627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff4b1b-0fdc-4258-96b2-3d594a0e4009 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:25.980295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-c1ff4b1b-0fdc-4258-96b2-3d594a0e4009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:25.998259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff4b1b-0fdc-4258-96b2-3d594a0e4009 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:26.001154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6ea62-485d-46ea-bc53-9f09437a4426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:26.002110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6ea62-485d-46ea-bc53-9f09437a4426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:26.002402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6ea62-485d-46ea-bc53-9f09437a4426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:26.002805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6ea62-485d-46ea-bc53-9f09437a4426 admin admin] PATH_INFO: `/v3/projects/fd9fa22187c34b268ca0cbfbd82c6d3c` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:26.004437 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6ea62-485d-46ea-bc53-9f09437a4426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd9fa22187c34b268ca0cbfbd82c6d3c)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:26.006469 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6ea62-485d-46ea-bc53-9f09437a4426 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:26.068717 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2f2e96c4-4d41-491f-98c3-aebf3d483550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0721af5a9eb041bc889d113e45e2ad98', 'request_id': 'req-2f2e96c4-4d41-491f-98c3-aebf3d483550'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.169630 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-32e6ea62-485d-46ea-bc53-9f09437a4426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd9fa22187c34b268ca0cbfbd82c6d3c', 'request_id': 'req-32e6ea62-485d-46ea-bc53-9f09437a4426'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.176224 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-32e6ea62-485d-46ea-bc53-9f09437a4426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd9fa22187c34b268ca0cbfbd82c6d3c', 'request_id': 'req-32e6ea62-485d-46ea-bc53-9f09437a4426'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.178170 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2f2e96c4-4d41-491f-98c3-aebf3d483550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0721af5a9eb041bc889d113e45e2ad98', 'request_id': 'req-2f2e96c4-4d41-491f-98c3-aebf3d483550'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.179530 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:26.187934 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2f2e96c4-4d41-491f-98c3-aebf3d483550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0721af5a9eb041bc889d113e45e2ad98', 'request_id': 'req-2f2e96c4-4d41-491f-98c3-aebf3d483550'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.199507 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2f2e96c4-4d41-491f-98c3-aebf3d483550 admin admin] The token cache is being invalidate because project 0721af5a9eb041bc889d113e45e2ad98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:22:26.199886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2f2e96c4-4d41-491f-98c3-aebf3d483550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.200633 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2f2e96c4-4d41-491f-98c3-aebf3d483550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.202273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 959/1909] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:22:25 2022] DELETE /identity/v3/projects/0721af5a9eb041bc889d113e45e2ad98 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:26.206363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e96c4-4d41-491f-98c3-aebf3d483550 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:26.207759 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2f2e96c4-4d41-491f-98c3-aebf3d483550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:26.269163 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-32e6ea62-485d-46ea-bc53-9f09437a4426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd9fa22187c34b268ca0cbfbd82c6d3c', 'request_id': 'req-32e6ea62-485d-46ea-bc53-9f09437a4426'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.274049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e96c4-4d41-491f-98c3-aebf3d483550 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:26.278089 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:26.282668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-32e6ea62-485d-46ea-bc53-9f09437a4426 admin admin] The token cache is being invalidate because project fd9fa22187c34b268ca0cbfbd82c6d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:22:26.282960 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-32e6ea62-485d-46ea-bc53-9f09437a4426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.283622 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-32e6ea62-485d-46ea-bc53-9f09437a4426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.286135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 951/1910] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:22:25 2022] DELETE /identity/v3/projects/fd9fa22187c34b268ca0cbfbd82c6d3c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:26.289812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6ea62-485d-46ea-bc53-9f09437a4426 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:26.291301 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-32e6ea62-485d-46ea-bc53-9f09437a4426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:26.339104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa2981-1142-4a54-87c9-75b2d70a6c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:26.339943 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa2981-1142-4a54-87c9-75b2d70a6c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:26.340228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa2981-1142-4a54-87c9-75b2d70a6c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:26.340506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa2981-1142-4a54-87c9-75b2d70a6c86 admin admin] PATH_INFO: `/v3/users/8ea6f9319897411d9a1991528ef91505` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:26.342702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa2981-1142-4a54-87c9-75b2d70a6c86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ea6f9319897411d9a1991528ef91505)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:26.344736 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa2981-1142-4a54-87c9-75b2d70a6c86 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:26.372263 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6ea62-485d-46ea-bc53-9f09437a4426 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:26.377084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd3ba8-504f-490f-86c9-5d9b7d639985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:26.377980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd3ba8-504f-490f-86c9-5d9b7d639985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:26.378285 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd3ba8-504f-490f-86c9-5d9b7d639985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:26.378615 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd3ba8-504f-490f-86c9-5d9b7d639985 admin admin] PATH_INFO: `/v3/users/15e7b0592e4740949fdb4d1c5aebc0f5` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:26.379827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd3ba8-504f-490f-86c9-5d9b7d639985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e7b0592e4740949fdb4d1c5aebc0f5)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:26.381776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd3ba8-504f-490f-86c9-5d9b7d639985 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:26.523169 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ccfa2981-1142-4a54-87c9-75b2d70a6c86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ea6f9319897411d9a1991528ef91505'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.523768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ccfa2981-1142-4a54-87c9-75b2d70a6c86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ea6f9319897411d9a1991528ef91505'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.524432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ccfa2981-1142-4a54-87c9-75b2d70a6c86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ea6f9319897411d9a1991528ef91505'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.537660 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ccfa2981-1142-4a54-87c9-75b2d70a6c86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ea6f9319897411d9a1991528ef91505'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.544508 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ccfa2981-1142-4a54-87c9-75b2d70a6c86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ea6f9319897411d9a1991528ef91505'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.552376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dbcd3ba8-504f-490f-86c9-5d9b7d639985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e7b0592e4740949fdb4d1c5aebc0f5'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.619789 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 960/1911] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:22:26 2022] DELETE /identity/v3/users/8ea6f9319897411d9a1991528ef91505 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:26.621044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa2981-1142-4a54-87c9-75b2d70a6c86 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:26.631416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ccfa2981-1142-4a54-87c9-75b2d70a6c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:26.688401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dbcd3ba8-504f-490f-86c9-5d9b7d639985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e7b0592e4740949fdb4d1c5aebc0f5'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.690415 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dbcd3ba8-504f-490f-86c9-5d9b7d639985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e7b0592e4740949fdb4d1c5aebc0f5'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.712276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:26.757218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dbcd3ba8-504f-490f-86c9-5d9b7d639985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e7b0592e4740949fdb4d1c5aebc0f5'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.758591 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dbcd3ba8-504f-490f-86c9-5d9b7d639985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e7b0592e4740949fdb4d1c5aebc0f5'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:26.758742 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa2981-1142-4a54-87c9-75b2d70a6c86 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:26.764175 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abaa92-5661-4e5c-bed9-8579ad4f47ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:26.765217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abaa92-5661-4e5c-bed9-8579ad4f47ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:26.765721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abaa92-5661-4e5c-bed9-8579ad4f47ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:26.766127 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abaa92-5661-4e5c-bed9-8579ad4f47ee admin admin] PATH_INFO: `/v3/projects/0201d06ef1d141f4bd5f5d71f143f6d3` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:26.767660 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abaa92-5661-4e5c-bed9-8579ad4f47ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=0201d06ef1d141f4bd5f5d71f143f6d3)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:26.770555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abaa92-5661-4e5c-bed9-8579ad4f47ee admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:26.801813 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 952/1912] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:22:26 2022] DELETE /identity/v3/users/15e7b0592e4740949fdb4d1c5aebc0f5 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:22:26.976974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-58abaa92-5661-4e5c-bed9-8579ad4f47ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0201d06ef1d141f4bd5f5d71f143f6d3', 'request_id': 'req-58abaa92-5661-4e5c-bed9-8579ad4f47ee'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:27.052437 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-58abaa92-5661-4e5c-bed9-8579ad4f47ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0201d06ef1d141f4bd5f5d71f143f6d3', 'request_id': 'req-58abaa92-5661-4e5c-bed9-8579ad4f47ee'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:27.060935 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-58abaa92-5661-4e5c-bed9-8579ad4f47ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0201d06ef1d141f4bd5f5d71f143f6d3', 'request_id': 'req-58abaa92-5661-4e5c-bed9-8579ad4f47ee'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:27.072928 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-58abaa92-5661-4e5c-bed9-8579ad4f47ee admin admin] The token cache is being invalidate because project 0201d06ef1d141f4bd5f5d71f143f6d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:22:27.073219 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-58abaa92-5661-4e5c-bed9-8579ad4f47ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:27.073932 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-58abaa92-5661-4e5c-bed9-8579ad4f47ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:27.075519 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 961/1913] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:22:26 2022] DELETE /identity/v3/projects/0201d06ef1d141f4bd5f5d71f143f6d3 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:27.080894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996730d-e7eb-46f2-b8a1-fd4d08a9c4e1 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:27.081190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996730d-e7eb-46f2-b8a1-fd4d08a9c4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:27.081491 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996730d-e7eb-46f2-b8a1-fd4d08a9c4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:27.101953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-4996730d-e7eb-46f2-b8a1-fd4d08a9c4e1 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:27.103192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4996730d-e7eb-46f2-b8a1-fd4d08a9c4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:27.224631 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 953/1914] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:27.231381 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6102d9b-db16-41f1-98aa-51d968040537 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:27.231668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6102d9b-db16-41f1-98aa-51d968040537 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:27.231947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6102d9b-db16-41f1-98aa-51d968040537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:27.252413 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-d6102d9b-db16-41f1-98aa-51d968040537 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:27.254224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d6102d9b-db16-41f1-98aa-51d968040537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:27.262542 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 962/1915] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:27.266813 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996730d-e7eb-46f2-b8a1-fd4d08a9c4e1 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:27.281412 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6102d9b-db16-41f1-98aa-51d968040537 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:27.284879 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d6102d9b-db16-41f1-98aa-51d968040537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:27.285591 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996730d-e7eb-46f2-b8a1-fd4d08a9c4e1 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:27.292451 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e674f1-324c-4666-99fb-cf2be43b69c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:27.293187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e674f1-324c-4666-99fb-cf2be43b69c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:27.293515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e674f1-324c-4666-99fb-cf2be43b69c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:27.293730 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e674f1-324c-4666-99fb-cf2be43b69c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:27.294472 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e674f1-324c-4666-99fb-cf2be43b69c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:22:27.295765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e674f1-324c-4666-99fb-cf2be43b69c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:27.298119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e674f1-324c-4666-99fb-cf2be43b69c0 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:27.316650 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 954/1916] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:22:27.319978 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e674f1-324c-4666-99fb-cf2be43b69c0 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:27.325434 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6102d9b-db16-41f1-98aa-51d968040537 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:27.331422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655788e5-2084-41f4-a827-d68f568df1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:27.332966 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655788e5-2084-41f4-a827-d68f568df1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:27.333177 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e674f1-324c-4666-99fb-cf2be43b69c0 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:27.333319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655788e5-2084-41f4-a827-d68f568df1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:27.333512 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655788e5-2084-41f4-a827-d68f568df1a0 admin admin] PATH_INFO: `/v3/projects/368753c87c1d4e3d96ed986ae2448fbe` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:27.334772 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655788e5-2084-41f4-a827-d68f568df1a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=368753c87c1d4e3d96ed986ae2448fbe)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:27.336761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655788e5-2084-41f4-a827-d68f568df1a0 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:27.340084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c1601-dd7c-4cd7-8ae1-713860dc113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:27.341293 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c1601-dd7c-4cd7-8ae1-713860dc113f admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:27.341852 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c1601-dd7c-4cd7-8ae1-713860dc113f admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:27.342338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c1601-dd7c-4cd7-8ae1-713860dc113f admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:27.343238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c1601-dd7c-4cd7-8ae1-713860dc113f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:27.346846 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c1601-dd7c-4cd7-8ae1-713860dc113f admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:27.352325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:27.462280 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 955/1917] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:22:27 2022] POST /identity/v3/projects => generated 361 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:27.469209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c1601-dd7c-4cd7-8ae1-713860dc113f admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:27.488514 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-655788e5-2084-41f4-a827-d68f568df1a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '368753c87c1d4e3d96ed986ae2448fbe', 'request_id': 'req-655788e5-2084-41f4-a827-d68f568df1a0'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:27.546035 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c1601-dd7c-4cd7-8ae1-713860dc113f admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:27.557510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7e25a-6317-4d74-91d7-a3e01b8168ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:27.559214 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7e25a-6317-4d74-91d7-a3e01b8168ed admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:27.559508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7e25a-6317-4d74-91d7-a3e01b8168ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:27.560251 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-655788e5-2084-41f4-a827-d68f568df1a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '368753c87c1d4e3d96ed986ae2448fbe', 'request_id': 'req-655788e5-2084-41f4-a827-d68f568df1a0'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:27.560420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7e25a-6317-4d74-91d7-a3e01b8168ed admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:27.561272 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7e25a-6317-4d74-91d7-a3e01b8168ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:27.563799 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7e25a-6317-4d74-91d7-a3e01b8168ed admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:27.568891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-655788e5-2084-41f4-a827-d68f568df1a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '368753c87c1d4e3d96ed986ae2448fbe', 'request_id': 'req-655788e5-2084-41f4-a827-d68f568df1a0'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:27.593641 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-655788e5-2084-41f4-a827-d68f568df1a0 admin admin] The token cache is being invalidate because project 368753c87c1d4e3d96ed986ae2448fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:22:27.593929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-655788e5-2084-41f4-a827-d68f568df1a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:27.594644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-655788e5-2084-41f4-a827-d68f568df1a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:27.600375 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 963/1918] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:22:27 2022] DELETE /identity/v3/projects/368753c87c1d4e3d96ed986ae2448fbe => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:27.600375 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655788e5-2084-41f4-a827-d68f568df1a0 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:27.601349 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-655788e5-2084-41f4-a827-d68f568df1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:27.620922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:27.647417 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 956/1919] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:22:27 2022] POST /identity/v3/users => generated 281 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:22:27.648718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d327abc-c848-4bbc-b2eb-6ac21eb405b5 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:27.649014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d327abc-c848-4bbc-b2eb-6ac21eb405b5 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:27.649298 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d327abc-c848-4bbc-b2eb-6ac21eb405b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:27.670971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-3d327abc-c848-4bbc-b2eb-6ac21eb405b5 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:27.672215 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3d327abc-c848-4bbc-b2eb-6ac21eb405b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:27.678752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655788e5-2084-41f4-a827-d68f568df1a0 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:27.685047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479130c6-d736-4326-b7d4-c5c559a2dec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:27.685522 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479130c6-d736-4326-b7d4-c5c559a2dec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:27.685869 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479130c6-d736-4326-b7d4-c5c559a2dec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:27.686245 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479130c6-d736-4326-b7d4-c5c559a2dec2 admin admin] PATH_INFO: `/v3/projects/438951c5455f4c10aee1f2ddffc99dec` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:27.687614 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479130c6-d736-4326-b7d4-c5c559a2dec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=438951c5455f4c10aee1f2ddffc99dec)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:27.687875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 957/1920] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:27.688885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d327abc-c848-4bbc-b2eb-6ac21eb405b5 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:27.690142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479130c6-d736-4326-b7d4-c5c559a2dec2 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:27.690434 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3d327abc-c848-4bbc-b2eb-6ac21eb405b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:27.706377 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d327abc-c848-4bbc-b2eb-6ac21eb405b5 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:27.712024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc82831-9883-41f5-8280-78d8097c77bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:27.713470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc82831-9883-41f5-8280-78d8097c77bb admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:27.713979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc82831-9883-41f5-8280-78d8097c77bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:27.714969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc82831-9883-41f5-8280-78d8097c77bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:27.731312 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc82831-9883-41f5-8280-78d8097c77bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:27.731312 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc82831-9883-41f5-8280-78d8097c77bb admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:27.750877 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 958/1921] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:27.752967 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba39f35-6d66-4008-b8ee-5429e8ede110 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:27.754929 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba39f35-6d66-4008-b8ee-5429e8ede110 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:27.755568 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba39f35-6d66-4008-b8ee-5429e8ede110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:27.775354 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-2ba39f35-6d66-4008-b8ee-5429e8ede110 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:27.776694 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-2ba39f35-6d66-4008-b8ee-5429e8ede110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:27.785024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 959/1922] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:27.786060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba39f35-6d66-4008-b8ee-5429e8ede110 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:27.801376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba39f35-6d66-4008-b8ee-5429e8ede110 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:27.801376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c76d1-f044-4637-8f0a-5c6001e84124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:27.801376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c76d1-f044-4637-8f0a-5c6001e84124 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:27.801376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c76d1-f044-4637-8f0a-5c6001e84124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:27.801877 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c76d1-f044-4637-8f0a-5c6001e84124 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:27.802234 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c76d1-f044-4637-8f0a-5c6001e84124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:27.803830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c76d1-f044-4637-8f0a-5c6001e84124 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:27.814094 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 960/1923] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:27.814944 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c76d1-f044-4637-8f0a-5c6001e84124 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:27.827892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c76d1-f044-4637-8f0a-5c6001e84124 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:27.832498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-479130c6-d736-4326-b7d4-c5c559a2dec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '438951c5455f4c10aee1f2ddffc99dec', 'request_id': 'req-479130c6-d736-4326-b7d4-c5c559a2dec2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:27.888418 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf09cfd-8626-48e2-843b-1dcf9f37e6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:27.889124 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf09cfd-8626-48e2-843b-1dcf9f37e6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:27.889529 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf09cfd-8626-48e2-843b-1dcf9f37e6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:27.889699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf09cfd-8626-48e2-843b-1dcf9f37e6c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:27.890468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf09cfd-8626-48e2-843b-1dcf9f37e6c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:22:27.890777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf09cfd-8626-48e2-843b-1dcf9f37e6c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:27.892357 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf09cfd-8626-48e2-843b-1dcf9f37e6c2 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:27.905151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 961/1924] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:22:27.905829 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf09cfd-8626-48e2-843b-1dcf9f37e6c2 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:27.914872 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-479130c6-d736-4326-b7d4-c5c559a2dec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '438951c5455f4c10aee1f2ddffc99dec', 'request_id': 'req-479130c6-d736-4326-b7d4-c5c559a2dec2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:27.915524 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf09cfd-8626-48e2-843b-1dcf9f37e6c2 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:27.920296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905de81-aa5e-427a-8f3d-1ecadff32550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:27.921253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905de81-aa5e-427a-8f3d-1ecadff32550 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:27.921495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905de81-aa5e-427a-8f3d-1ecadff32550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:27.921815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-479130c6-d736-4326-b7d4-c5c559a2dec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '438951c5455f4c10aee1f2ddffc99dec', 'request_id': 'req-479130c6-d736-4326-b7d4-c5c559a2dec2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:27.921911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905de81-aa5e-427a-8f3d-1ecadff32550 admin admin] PATH_INFO: `/v3/projects/f80767986b084a189b0fdad608f50d9d/users/7993ba72692444fa98ab7ba9309c5249/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:27.932899 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-479130c6-d736-4326-b7d4-c5c559a2dec2 admin admin] The token cache is being invalidate because project 438951c5455f4c10aee1f2ddffc99dec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:22:27.933186 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-479130c6-d736-4326-b7d4-c5c559a2dec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:27.933902 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-479130c6-d736-4326-b7d4-c5c559a2dec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:27.935671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 964/1925] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:22:27 2022] DELETE /identity/v3/projects/438951c5455f4c10aee1f2ddffc99dec => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:27.936289 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479130c6-d736-4326-b7d4-c5c559a2dec2 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:27.937230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905de81-aa5e-427a-8f3d-1ecadff32550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80767986b084a189b0fdad608f50d9d, user_id=7993ba72692444fa98ab7ba9309c5249, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:27.937717 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-479130c6-d736-4326-b7d4-c5c559a2dec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:27.939988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905de81-aa5e-427a-8f3d-1ecadff32550 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:27.950657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479130c6-d736-4326-b7d4-c5c559a2dec2 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:27.955252 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5779ada-febd-4aac-80e4-feff709fc392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:27.955901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5779ada-febd-4aac-80e4-feff709fc392 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:27.956180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5779ada-febd-4aac-80e4-feff709fc392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:27.956449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5779ada-febd-4aac-80e4-feff709fc392 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:27.957798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5779ada-febd-4aac-80e4-feff709fc392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:27.959676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5779ada-febd-4aac-80e4-feff709fc392 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:28.036526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 962/1926] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:27 2022] PUT /identity/v3/projects/f80767986b084a189b0fdad608f50d9d/users/7993ba72692444fa98ab7ba9309c5249/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:28.047547 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ab776-ac07-4fb9-b006-dcb0767e2948 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:28.047883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ab776-ac07-4fb9-b006-dcb0767e2948 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:28.048223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ab776-ac07-4fb9-b006-dcb0767e2948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:28.067584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-653ab776-ac07-4fb9-b006-dcb0767e2948 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:28.068799 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-653ab776-ac07-4fb9-b006-dcb0767e2948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:28.074582 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:28.095498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 965/1927] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:22:27 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:28.097955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd690a-2a09-4059-a72c-c7b17913c604 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:28.098508 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd690a-2a09-4059-a72c-c7b17913c604 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:28.098871 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd690a-2a09-4059-a72c-c7b17913c604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:28.130820 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-64cd690a-2a09-4059-a72c-c7b17913c604 None None] MFA Rules not processed for user `7993ba72692444fa98ab7ba9309c5249`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:28.132343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-64cd690a-2a09-4059-a72c-c7b17913c604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:28.157132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 963/1928] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:28.157948 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ab776-ac07-4fb9-b006-dcb0767e2948 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:28.169908 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ab776-ac07-4fb9-b006-dcb0767e2948 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:28.253163 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dca5b1-1cc8-4fa7-a338-0788483e0e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:28.255079 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dca5b1-1cc8-4fa7-a338-0788483e0e67 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:28.255442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dca5b1-1cc8-4fa7-a338-0788483e0e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:28.256115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 966/1929] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:28.256353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dca5b1-1cc8-4fa7-a338-0788483e0e67 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:28.257245 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dca5b1-1cc8-4fa7-a338-0788483e0e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:28.258195 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94e604-abd1-475b-aa81-6bcc4817d4db None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:28.258957 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94e604-abd1-475b-aa81-6bcc4817d4db None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:28.259248 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94e604-abd1-475b-aa81-6bcc4817d4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:28.259705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dca5b1-1cc8-4fa7-a338-0788483e0e67 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:28.289898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-1f94e604-abd1-475b-aa81-6bcc4817d4db None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:28.291137 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1f94e604-abd1-475b-aa81-6bcc4817d4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:28.299410 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 967/1930] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:28.300924 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94e604-abd1-475b-aa81-6bcc4817d4db None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:28.302420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1f94e604-abd1-475b-aa81-6bcc4817d4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:28.315012 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:28.377536 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94e604-abd1-475b-aa81-6bcc4817d4db None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:28.381824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b94fb-d499-4ac9-9e0f-2a38ce674567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:28.382485 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b94fb-d499-4ac9-9e0f-2a38ce674567 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:28.382770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b94fb-d499-4ac9-9e0f-2a38ce674567 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:28.383048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b94fb-d499-4ac9-9e0f-2a38ce674567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:28.392772 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b94fb-d499-4ac9-9e0f-2a38ce674567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:28.394365 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b94fb-d499-4ac9-9e0f-2a38ce674567 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:28.405210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 968/1931] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:28.406068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b94fb-d499-4ac9-9e0f-2a38ce674567 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:28.417183 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b94fb-d499-4ac9-9e0f-2a38ce674567 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:28.419282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 964/1932] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:22:28 2022] POST /identity/v3/users => generated 288 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:28.423239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dca5b1-1cc8-4fa7-a338-0788483e0e67 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:28.427516 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06efeed-3862-4490-9004-2f348424c5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:28.428416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06efeed-3862-4490-9004-2f348424c5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:28.429032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06efeed-3862-4490-9004-2f348424c5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:28.429448 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06efeed-3862-4490-9004-2f348424c5d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:28.430604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06efeed-3862-4490-9004-2f348424c5d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:22:28.431011 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06efeed-3862-4490-9004-2f348424c5d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:28.432699 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06efeed-3862-4490-9004-2f348424c5d9 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:28.439433 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dca5b1-1cc8-4fa7-a338-0788483e0e67 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:28.446253 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 969/1933] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:22:28.446725 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64579381-3041-4c3d-92ea-d75a11e6a945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:28.447186 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06efeed-3862-4490-9004-2f348424c5d9 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:28.447738 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64579381-3041-4c3d-92ea-d75a11e6a945 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:28.448211 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64579381-3041-4c3d-92ea-d75a11e6a945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:28.448488 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64579381-3041-4c3d-92ea-d75a11e6a945 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:28.449442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64579381-3041-4c3d-92ea-d75a11e6a945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:28.450039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f06efeed-3862-4490-9004-2f348424c5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:28.453087 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64579381-3041-4c3d-92ea-d75a11e6a945 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:28.465662 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06efeed-3862-4490-9004-2f348424c5d9 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:28.466345 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 965/1934] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:22:28.467182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64579381-3041-4c3d-92ea-d75a11e6a945 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:28.472952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552e755-d010-4729-8547-69871861da2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:28.473929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552e755-d010-4729-8547-69871861da2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:28.474282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552e755-d010-4729-8547-69871861da2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:28.474564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552e755-d010-4729-8547-69871861da2e admin admin] PATH_INFO: `/v3/users/7993ba72692444fa98ab7ba9309c5249` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:28.478178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552e755-d010-4729-8547-69871861da2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7993ba72692444fa98ab7ba9309c5249)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:28.480139 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552e755-d010-4729-8547-69871861da2e admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:28.486618 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64579381-3041-4c3d-92ea-d75a11e6a945 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:28.492650 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0026eca-7748-4baa-a831-a1ed5d6ea193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:28.496740 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0026eca-7748-4baa-a831-a1ed5d6ea193 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:28.496740 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0026eca-7748-4baa-a831-a1ed5d6ea193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:28.496740 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0026eca-7748-4baa-a831-a1ed5d6ea193 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:28.496740 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0026eca-7748-4baa-a831-a1ed5d6ea193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:28.496740 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0026eca-7748-4baa-a831-a1ed5d6ea193 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:28.698925 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 966/1935] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:22:28 2022] POST /identity/v3/projects => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:28.700449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0026eca-7748-4baa-a831-a1ed5d6ea193 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:28.804985 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0026eca-7748-4baa-a831-a1ed5d6ea193 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:28.810910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb5399-da7d-43fb-b441-4491628334cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:28.811859 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb5399-da7d-43fb-b441-4491628334cd admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:28.812637 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb5399-da7d-43fb-b441-4491628334cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:28.812637 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb5399-da7d-43fb-b441-4491628334cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:28.813508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb5399-da7d-43fb-b441-4491628334cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:28.815572 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb5399-da7d-43fb-b441-4491628334cd admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:28.830007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 967/1936] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:28.830946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb5399-da7d-43fb-b441-4491628334cd admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:28.841124 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:28.843315 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3552e755-d010-4729-8547-69871861da2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7993ba72692444fa98ab7ba9309c5249'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:28.845050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3552e755-d010-4729-8547-69871861da2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7993ba72692444fa98ab7ba9309c5249'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:28.846167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3552e755-d010-4729-8547-69871861da2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7993ba72692444fa98ab7ba9309c5249'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:28.851931 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb5399-da7d-43fb-b441-4491628334cd admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:28.862143 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3552e755-d010-4729-8547-69871861da2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7993ba72692444fa98ab7ba9309c5249'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:28.869102 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589a1bd-3a89-4df8-8d74-18ffd96d9e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:28.869799 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589a1bd-3a89-4df8-8d74-18ffd96d9e46 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:28.870081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589a1bd-3a89-4df8-8d74-18ffd96d9e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:28.870357 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589a1bd-3a89-4df8-8d74-18ffd96d9e46 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:28.871061 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589a1bd-3a89-4df8-8d74-18ffd96d9e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:28.873112 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589a1bd-3a89-4df8-8d74-18ffd96d9e46 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:28.882286 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3552e755-d010-4729-8547-69871861da2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7993ba72692444fa98ab7ba9309c5249'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:29.031349 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 968/1937] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:22:28 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:29.032690 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589a1bd-3a89-4df8-8d74-18ffd96d9e46 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:29.036835 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 970/1938] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:22:28 2022] DELETE /identity/v3/users/7993ba72692444fa98ab7ba9309c5249 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:29.038147 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552e755-d010-4729-8547-69871861da2e admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:29.039588 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-b589a1bd-3a89-4df8-8d74-18ffd96d9e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:29.043134 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3552e755-d010-4729-8547-69871861da2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:29.059936 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589a1bd-3a89-4df8-8d74-18ffd96d9e46 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:29.166229 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9260c32-57a0-41e4-b632-4f94f6fa5631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:29.168142 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9260c32-57a0-41e4-b632-4f94f6fa5631 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:29.168539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9260c32-57a0-41e4-b632-4f94f6fa5631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:29.178936 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9260c32-57a0-41e4-b632-4f94f6fa5631 admin admin] PATH_INFO: `/v3/projects/385f36ba49844a92ba40f05defa9ec88/users/e9fcbfd74522488fb71e76ffafa90208/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:29.185976 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552e755-d010-4729-8547-69871861da2e admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:29.189823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9260c32-57a0-41e4-b632-4f94f6fa5631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385f36ba49844a92ba40f05defa9ec88, user_id=e9fcbfd74522488fb71e76ffafa90208, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:29.195801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9260c32-57a0-41e4-b632-4f94f6fa5631 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:29.201450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1df95-ce13-4008-a6e9-12719e9e5d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:29.201450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1df95-ce13-4008-a6e9-12719e9e5d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:29.201450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1df95-ce13-4008-a6e9-12719e9e5d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:29.201450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1df95-ce13-4008-a6e9-12719e9e5d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:29.202724 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1df95-ce13-4008-a6e9-12719e9e5d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:29.206088 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1df95-ce13-4008-a6e9-12719e9e5d06 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:29.223809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 971/1939] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:29.225366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fef5f-d1f7-468d-aea9-5437e68d4ff9 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:29.225657 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fef5f-d1f7-468d-aea9-5437e68d4ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:29.225959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fef5f-d1f7-468d-aea9-5437e68d4ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:29.247044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-2b5fef5f-d1f7-468d-aea9-5437e68d4ff9 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:29.248313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2b5fef5f-d1f7-468d-aea9-5437e68d4ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:29.257311 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 972/1940] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:29.260642 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fef5f-d1f7-468d-aea9-5437e68d4ff9 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:29.268442 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fef5f-d1f7-468d-aea9-5437e68d4ff9 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:29.274228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b37b5e-15c9-458f-9944-8de68bb44629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:29.275097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b37b5e-15c9-458f-9944-8de68bb44629 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:29.275387 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b37b5e-15c9-458f-9944-8de68bb44629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:29.275673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b37b5e-15c9-458f-9944-8de68bb44629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:29.276419 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b37b5e-15c9-458f-9944-8de68bb44629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:29.278093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b37b5e-15c9-458f-9944-8de68bb44629 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:29.283067 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 969/1941] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:29 2022] PUT /identity/v3/projects/385f36ba49844a92ba40f05defa9ec88/users/e9fcbfd74522488fb71e76ffafa90208/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:29.284229 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9260c32-57a0-41e4-b632-4f94f6fa5631 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:29.287604 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f9260c32-57a0-41e4-b632-4f94f6fa5631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:29.290638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 973/1942] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:29.294850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b37b5e-15c9-458f-9944-8de68bb44629 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:29.305466 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b37b5e-15c9-458f-9944-8de68bb44629 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:29.360946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9260c32-57a0-41e4-b632-4f94f6fa5631 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:29.365690 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7cb07-509c-4908-ba8b-04368e82e4fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:29.366360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7cb07-509c-4908-ba8b-04368e82e4fd service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:29.366644 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7cb07-509c-4908-ba8b-04368e82e4fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:29.366973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7cb07-509c-4908-ba8b-04368e82e4fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:29.367637 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972348b-293a-4d62-ba47-507b0c2ee5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:29.368652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972348b-293a-4d62-ba47-507b0c2ee5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:29.369005 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972348b-293a-4d62-ba47-507b0c2ee5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:29.369350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972348b-293a-4d62-ba47-507b0c2ee5b3 admin admin] PATH_INFO: `/v3/projects/7de1f3976dbe4d4e8fa0495f764400e2/users/bc4926b4c67a4bd8af8361921c07c52e/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:29.378098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7cb07-509c-4908-ba8b-04368e82e4fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:29.380230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7cb07-509c-4908-ba8b-04368e82e4fd service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:29.390843 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 970/1943] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:29.391500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972348b-293a-4d62-ba47-507b0c2ee5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de1f3976dbe4d4e8fa0495f764400e2, user_id=bc4926b4c67a4bd8af8361921c07c52e, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:29.392080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62356ae1-5490-4a17-b738-50169e82da1b None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:29.392369 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62356ae1-5490-4a17-b738-50169e82da1b None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:29.392674 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62356ae1-5490-4a17-b738-50169e82da1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:29.396108 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972348b-293a-4d62-ba47-507b0c2ee5b3 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:29.420389 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-62356ae1-5490-4a17-b738-50169e82da1b None None] MFA Rules not processed for user `e9fcbfd74522488fb71e76ffafa90208`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:29.421661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-62356ae1-5490-4a17-b738-50169e82da1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:29.422797 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:29.482807 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 974/1944] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:29 2022] PUT /identity/v3/projects/7de1f3976dbe4d4e8fa0495f764400e2/users/bc4926b4c67a4bd8af8361921c07c52e/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:29.494172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d482190-74f0-42c1-84b2-87828f9ca6a4 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:29.494466 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d482190-74f0-42c1-84b2-87828f9ca6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:29.494745 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d482190-74f0-42c1-84b2-87828f9ca6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:29.501904 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 971/1945] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:29.507684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62356ae1-5490-4a17-b738-50169e82da1b None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:29.520083 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62356ae1-5490-4a17-b738-50169e82da1b None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:29.533240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-5d482190-74f0-42c1-84b2-87828f9ca6a4 None None] MFA Rules not processed for user `bc4926b4c67a4bd8af8361921c07c52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:29.534510 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-5d482190-74f0-42c1-84b2-87828f9ca6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:29.606978 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddb6b0-8238-436d-9954-3bb160ae1f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:29.608288 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddb6b0-8238-436d-9954-3bb160ae1f8e admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:29.608680 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddb6b0-8238-436d-9954-3bb160ae1f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:29.608967 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddb6b0-8238-436d-9954-3bb160ae1f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:29.609883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddb6b0-8238-436d-9954-3bb160ae1f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:29.612608 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddb6b0-8238-436d-9954-3bb160ae1f8e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:29.641671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 975/1946] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:22:29.651440 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d482190-74f0-42c1-84b2-87828f9ca6a4 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:29.653070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-5d482190-74f0-42c1-84b2-87828f9ca6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:29.740614 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:29.755459 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 972/1947] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:22:29 2022] POST /identity/v3/projects => generated 373 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:22:29.756711 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddb6b0-8238-436d-9954-3bb160ae1f8e admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:29.768021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d482190-74f0-42c1-84b2-87828f9ca6a4 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:29.851882 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374f303-f327-4f70-9371-db785e117e47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:29.852824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374f303-f327-4f70-9371-db785e117e47 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:29.853179 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374f303-f327-4f70-9371-db785e117e47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:29.853524 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374f303-f327-4f70-9371-db785e117e47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:29.876377 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddb6b0-8238-436d-9954-3bb160ae1f8e admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:29.882301 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d05e0-ca46-48c9-baa8-05260207ef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:29.883118 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d05e0-ca46-48c9-baa8-05260207ef99 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:29.883404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d05e0-ca46-48c9-baa8-05260207ef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:29.883677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d05e0-ca46-48c9-baa8-05260207ef99 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:29.884909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d05e0-ca46-48c9-baa8-05260207ef99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:29.886836 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d05e0-ca46-48c9-baa8-05260207ef99 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:29.920630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374f303-f327-4f70-9371-db785e117e47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:29.922074 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374f303-f327-4f70-9371-db785e117e47 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:29.932287 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 976/1948] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:22:29.951930 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374f303-f327-4f70-9371-db785e117e47 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:29.963096 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374f303-f327-4f70-9371-db785e117e47 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:29.967757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9494b-9e42-488b-bd85-6e7071dbb5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:29.968655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9494b-9e42-488b-bd85-6e7071dbb5e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:29.968942 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9494b-9e42-488b-bd85-6e7071dbb5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:29.969223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9494b-9e42-488b-bd85-6e7071dbb5e1 admin admin] PATH_INFO: `/v3/users/bc4926b4c67a4bd8af8361921c07c52e` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:29.971403 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9494b-9e42-488b-bd85-6e7071dbb5e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc4926b4c67a4bd8af8361921c07c52e)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:29.974120 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9494b-9e42-488b-bd85-6e7071dbb5e1 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:29.984380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 973/1949] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:22:29 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:29.988453 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d05e0-ca46-48c9-baa8-05260207ef99 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:30.006869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d05e0-ca46-48c9-baa8-05260207ef99 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:30.014012 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc04da-5985-4054-9932-711bb3058622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:30.014736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc04da-5985-4054-9932-711bb3058622 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:30.014965 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc04da-5985-4054-9932-711bb3058622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:30.015247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc04da-5985-4054-9932-711bb3058622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:30.016004 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc04da-5985-4054-9932-711bb3058622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:30.017660 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc04da-5985-4054-9932-711bb3058622 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:30.030174 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 974/1950] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:22:30.033666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc04da-5985-4054-9932-711bb3058622 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:30.035866 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-04cc04da-5985-4054-9932-711bb3058622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:30.048985 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc04da-5985-4054-9932-711bb3058622 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:30.053902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dde06-fd26-4f25-a062-cd4080220177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:30.058483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dde06-fd26-4f25-a062-cd4080220177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:30.058483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dde06-fd26-4f25-a062-cd4080220177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:30.058483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dde06-fd26-4f25-a062-cd4080220177 admin admin] PATH_INFO: `/v3/projects/f80767986b084a189b0fdad608f50d9d` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:30.058483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6dde06-fd26-4f25-a062-cd4080220177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80767986b084a189b0fdad608f50d9d)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:30.058483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6dde06-fd26-4f25-a062-cd4080220177 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:30.174010 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-65e9494b-9e42-488b-bd85-6e7071dbb5e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc4926b4c67a4bd8af8361921c07c52e'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:30.174739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-65e9494b-9e42-488b-bd85-6e7071dbb5e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc4926b4c67a4bd8af8361921c07c52e'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:30.175360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-65e9494b-9e42-488b-bd85-6e7071dbb5e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc4926b4c67a4bd8af8361921c07c52e'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:30.195612 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-65e9494b-9e42-488b-bd85-6e7071dbb5e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc4926b4c67a4bd8af8361921c07c52e'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:30.200827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-cf6dde06-fd26-4f25-a062-cd4080220177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80767986b084a189b0fdad608f50d9d', 'request_id': 'req-cf6dde06-fd26-4f25-a062-cd4080220177'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:30.206319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-65e9494b-9e42-488b-bd85-6e7071dbb5e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc4926b4c67a4bd8af8361921c07c52e'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:30.210028 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-cf6dde06-fd26-4f25-a062-cd4080220177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80767986b084a189b0fdad608f50d9d', 'request_id': 'req-cf6dde06-fd26-4f25-a062-cd4080220177'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:30.276200 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 977/1951] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:22:29 2022] DELETE /identity/v3/users/bc4926b4c67a4bd8af8361921c07c52e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:22:30.277153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9494b-9e42-488b-bd85-6e7071dbb5e1 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:30.278562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-65e9494b-9e42-488b-bd85-6e7071dbb5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:30.349018 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-cf6dde06-fd26-4f25-a062-cd4080220177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80767986b084a189b0fdad608f50d9d', 'request_id': 'req-cf6dde06-fd26-4f25-a062-cd4080220177'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:30.349275 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9494b-9e42-488b-bd85-6e7071dbb5e1 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:30.357714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbc65c-2693-41a4-a733-bbdbebeabb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:30.359048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbc65c-2693-41a4-a733-bbdbebeabb05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:30.359048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbc65c-2693-41a4-a733-bbdbebeabb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:30.359251 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbc65c-2693-41a4-a733-bbdbebeabb05 admin admin] PATH_INFO: `/v3/projects/0bfc35af8b3849c99f495582b0d973db/users/cd38236746fa40d3bd6f96293e62c2b8/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:30.365318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-cf6dde06-fd26-4f25-a062-cd4080220177 admin admin] The token cache is being invalidate because project f80767986b084a189b0fdad608f50d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:22:30.365691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-cf6dde06-fd26-4f25-a062-cd4080220177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:30.366271 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-cf6dde06-fd26-4f25-a062-cd4080220177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:30.367896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 975/1952] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:22:30 2022] DELETE /identity/v3/projects/f80767986b084a189b0fdad608f50d9d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:30.370326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c8f88-a6dc-442f-9960-de985d7a7b49 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:30.370326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c8f88-a6dc-442f-9960-de985d7a7b49 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:30.370326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c8f88-a6dc-442f-9960-de985d7a7b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:30.381972 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbc65c-2693-41a4-a733-bbdbebeabb05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bfc35af8b3849c99f495582b0d973db, user_id=cd38236746fa40d3bd6f96293e62c2b8, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:30.384776 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbc65c-2693-41a4-a733-bbdbebeabb05 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:30.388697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-721c8f88-a6dc-442f-9960-de985d7a7b49 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:30.389921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-721c8f88-a6dc-442f-9960-de985d7a7b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:30.398391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 976/1953] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:30.399708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085a374-3dfe-43d7-af8b-a828567eade6 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:30.399995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085a374-3dfe-43d7-af8b-a828567eade6 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:30.400274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085a374-3dfe-43d7-af8b-a828567eade6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:30.419560 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-6085a374-3dfe-43d7-af8b-a828567eade6 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:30.420707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6085a374-3dfe-43d7-af8b-a828567eade6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:30.429538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 977/1954] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:30.436012 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085a374-3dfe-43d7-af8b-a828567eade6 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:30.436012 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6085a374-3dfe-43d7-af8b-a828567eade6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:30.475853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 978/1955] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:30 2022] PUT /identity/v3/projects/0bfc35af8b3849c99f495582b0d973db/users/cd38236746fa40d3bd6f96293e62c2b8/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:30.477576 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b409f99-2cfb-43d8-a351-55a223be0bd3 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:30.478078 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b409f99-2cfb-43d8-a351-55a223be0bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:30.478560 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b409f99-2cfb-43d8-a351-55a223be0bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:30.499539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-1b409f99-2cfb-43d8-a351-55a223be0bd3 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:30.500913 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1b409f99-2cfb-43d8-a351-55a223be0bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:30.511788 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085a374-3dfe-43d7-af8b-a828567eade6 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:30.544676 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:30.574330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 979/1956] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:30.576976 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b409f99-2cfb-43d8-a351-55a223be0bd3 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:30.579979 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1b409f99-2cfb-43d8-a351-55a223be0bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:30.580254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:30.585559 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38693d-66ee-4fdc-be2a-0cbee6c1fe20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:30.587646 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38693d-66ee-4fdc-be2a-0cbee6c1fe20 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:30.587646 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38693d-66ee-4fdc-be2a-0cbee6c1fe20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:30.587646 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38693d-66ee-4fdc-be2a-0cbee6c1fe20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:30.595170 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b409f99-2cfb-43d8-a351-55a223be0bd3 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:30.601482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2d2dc-1312-4cb6-93ae-866c9679dd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:30.602079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2d2dc-1312-4cb6-93ae-866c9679dd3d admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:30.602928 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2d2dc-1312-4cb6-93ae-866c9679dd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:30.603214 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2d2dc-1312-4cb6-93ae-866c9679dd3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:30.603546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38693d-66ee-4fdc-be2a-0cbee6c1fe20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:30.604137 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2d2dc-1312-4cb6-93ae-866c9679dd3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:30.605051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38693d-66ee-4fdc-be2a-0cbee6c1fe20 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:30.605872 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2d2dc-1312-4cb6-93ae-866c9679dd3d admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:30.615456 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 978/1957] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:30.616404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38693d-66ee-4fdc-be2a-0cbee6c1fe20 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:30.620788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 980/1958] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:30.622017 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2d2dc-1312-4cb6-93ae-866c9679dd3d admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:30.626440 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38693d-66ee-4fdc-be2a-0cbee6c1fe20 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:30.631491 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029b785-d267-4d61-aebc-490298a85a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:30.632218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029b785-d267-4d61-aebc-490298a85a9b admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:30.633380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029b785-d267-4d61-aebc-490298a85a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:30.633807 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029b785-d267-4d61-aebc-490298a85a9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:30.633964 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2d2dc-1312-4cb6-93ae-866c9679dd3d admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:30.634562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029b785-d267-4d61-aebc-490298a85a9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:22:30.635433 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029b785-d267-4d61-aebc-490298a85a9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:30.636618 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029b785-d267-4d61-aebc-490298a85a9b admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:30.639764 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61fa2b-c1f8-4630-ad91-8ee7406c18d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:30.642819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61fa2b-c1f8-4630-ad91-8ee7406c18d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:30.642819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61fa2b-c1f8-4630-ad91-8ee7406c18d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:30.642819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61fa2b-c1f8-4630-ad91-8ee7406c18d9 admin admin] PATH_INFO: `/v3/projects/0bfc35af8b3849c99f495582b0d973db/users/cd38236746fa40d3bd6f96293e62c2b8/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:30.643870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61fa2b-c1f8-4630-ad91-8ee7406c18d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bfc35af8b3849c99f495582b0d973db, user_id=cd38236746fa40d3bd6f96293e62c2b8, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:30.647500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61fa2b-c1f8-4630-ad91-8ee7406c18d9 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:30.663638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 981/1959] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:30 2022] PUT /identity/v3/projects/0bfc35af8b3849c99f495582b0d973db/users/cd38236746fa40d3bd6f96293e62c2b8/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:30.667872 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 979/1960] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:22:30.676273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174f59c-119e-4cdd-be46-704675c158ba None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:30.676522 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174f59c-119e-4cdd-be46-704675c158ba None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:30.676811 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174f59c-119e-4cdd-be46-704675c158ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:30.687444 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029b785-d267-4d61-aebc-490298a85a9b admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:30.701146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029b785-d267-4d61-aebc-490298a85a9b admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:30.721200 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-b174f59c-119e-4cdd-be46-704675c158ba None None] MFA Rules not processed for user `cd38236746fa40d3bd6f96293e62c2b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:30.723485 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b174f59c-119e-4cdd-be46-704675c158ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:30.795053 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06390fb-a5c1-47da-9b88-297dd1b88bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:30.795734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06390fb-a5c1-47da-9b88-297dd1b88bcf admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:30.796012 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06390fb-a5c1-47da-9b88-297dd1b88bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:30.796283 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06390fb-a5c1-47da-9b88-297dd1b88bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:30.797010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06390fb-a5c1-47da-9b88-297dd1b88bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:30.799960 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06390fb-a5c1-47da-9b88-297dd1b88bcf admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:30.827293 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 982/1961] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:30.839374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174f59c-119e-4cdd-be46-704675c158ba None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:30.841150 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b174f59c-119e-4cdd-be46-704675c158ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:30.899836 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 980/1962] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:22:30 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:30.904390 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06390fb-a5c1-47da-9b88-297dd1b88bcf admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:30.937878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174f59c-119e-4cdd-be46-704675c158ba None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:30.967105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:30.990765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06390fb-a5c1-47da-9b88-297dd1b88bcf admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:30.995117 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:30.999883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8cd5a-7d96-4f35-9eb0-eb0a1fe312ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:31.001730 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8cd5a-7d96-4f35-9eb0-eb0a1fe312ae admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:31.001730 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8cd5a-7d96-4f35-9eb0-eb0a1fe312ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:31.001993 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8cd5a-7d96-4f35-9eb0-eb0a1fe312ae admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:31.003005 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8cd5a-7d96-4f35-9eb0-eb0a1fe312ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:31.005053 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8cd5a-7d96-4f35-9eb0-eb0a1fe312ae admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:31.039049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739e3e3-51c3-434e-8e21-c1ce1a645cde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:31.039915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739e3e3-51c3-434e-8e21-c1ce1a645cde service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:31.040101 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739e3e3-51c3-434e-8e21-c1ce1a645cde service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:31.040524 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739e3e3-51c3-434e-8e21-c1ce1a645cde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:31.042503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d739e3e3-51c3-434e-8e21-c1ce1a645cde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:31.125590 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739e3e3-51c3-434e-8e21-c1ce1a645cde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:31.127201 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739e3e3-51c3-434e-8e21-c1ce1a645cde service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:31.137556 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 983/1963] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:22:31.147737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 981/1964] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:22:30 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:31.153129 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739e3e3-51c3-434e-8e21-c1ce1a645cde service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:31.153303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8cd5a-7d96-4f35-9eb0-eb0a1fe312ae admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:31.155149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d739e3e3-51c3-434e-8e21-c1ce1a645cde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:31.171182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8cd5a-7d96-4f35-9eb0-eb0a1fe312ae admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:31.176701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487869e-d0c8-4b5f-bbbc-c84794b89bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:31.177772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487869e-d0c8-4b5f-bbbc-c84794b89bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:31.177772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487869e-d0c8-4b5f-bbbc-c84794b89bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:31.178109 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487869e-d0c8-4b5f-bbbc-c84794b89bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:31.178817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739e3e3-51c3-434e-8e21-c1ce1a645cde service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:31.178992 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487869e-d0c8-4b5f-bbbc-c84794b89bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:31.182082 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487869e-d0c8-4b5f-bbbc-c84794b89bd8 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:31.185494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce52d78-87a9-426a-acc5-49f4619f13ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:31.186691 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce52d78-87a9-426a-acc5-49f4619f13ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:31.187040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce52d78-87a9-426a-acc5-49f4619f13ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:31.187383 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce52d78-87a9-426a-acc5-49f4619f13ef admin admin] PATH_INFO: `/v3/projects/7de1f3976dbe4d4e8fa0495f764400e2` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:31.189329 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce52d78-87a9-426a-acc5-49f4619f13ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7de1f3976dbe4d4e8fa0495f764400e2)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:31.192122 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce52d78-87a9-426a-acc5-49f4619f13ef admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:31.195702 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 982/1965] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:31.203758 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487869e-d0c8-4b5f-bbbc-c84794b89bd8 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:31.214640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487869e-d0c8-4b5f-bbbc-c84794b89bd8 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:31.219904 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923daa6-3336-42e8-ba74-a73f1cc9066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:31.220925 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923daa6-3336-42e8-ba74-a73f1cc9066f admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:31.221428 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923daa6-3336-42e8-ba74-a73f1cc9066f admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:31.222171 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923daa6-3336-42e8-ba74-a73f1cc9066f admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:31.224006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923daa6-3336-42e8-ba74-a73f1cc9066f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:31.226177 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923daa6-3336-42e8-ba74-a73f1cc9066f admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:31.245935 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 983/1966] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:31.249698 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923daa6-3336-42e8-ba74-a73f1cc9066f admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:31.262016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923daa6-3336-42e8-ba74-a73f1cc9066f admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:31.267817 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b98216-8f59-4477-8be6-745fb714d0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:31.268826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b98216-8f59-4477-8be6-745fb714d0d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:31.269111 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b98216-8f59-4477-8be6-745fb714d0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:31.271940 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b98216-8f59-4477-8be6-745fb714d0d1 admin admin] PATH_INFO: `/v3/projects/909c1d6f7a7241b4bedac3d601e664fd/users/cd242fc06f584b3da8ad8f8dfb519f99/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:31.287794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b98216-8f59-4477-8be6-745fb714d0d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=909c1d6f7a7241b4bedac3d601e664fd, user_id=cd242fc06f584b3da8ad8f8dfb519f99, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:31.290456 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b98216-8f59-4477-8be6-745fb714d0d1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:31.406595 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 984/1967] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:31 2022] PUT /identity/v3/projects/909c1d6f7a7241b4bedac3d601e664fd/users/cd242fc06f584b3da8ad8f8dfb519f99/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:31.415084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-cce52d78-87a9-426a-acc5-49f4619f13ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7de1f3976dbe4d4e8fa0495f764400e2', 'request_id': 'req-cce52d78-87a9-426a-acc5-49f4619f13ef'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:31.417715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f7be8-a588-4e1c-b8d8-8f66c36e70a0 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:31.418008 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f7be8-a588-4e1c-b8d8-8f66c36e70a0 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:31.418324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f7be8-a588-4e1c-b8d8-8f66c36e70a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:31.446465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-4b6f7be8-a588-4e1c-b8d8-8f66c36e70a0 None None] MFA Rules not processed for user `cd242fc06f584b3da8ad8f8dfb519f99`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:31.447677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4b6f7be8-a588-4e1c-b8d8-8f66c36e70a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:31.503007 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-cce52d78-87a9-426a-acc5-49f4619f13ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7de1f3976dbe4d4e8fa0495f764400e2', 'request_id': 'req-cce52d78-87a9-426a-acc5-49f4619f13ef'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:31.510295 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-cce52d78-87a9-426a-acc5-49f4619f13ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7de1f3976dbe4d4e8fa0495f764400e2', 'request_id': 'req-cce52d78-87a9-426a-acc5-49f4619f13ef'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:31.513126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 985/1968] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:22:31.523047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-cce52d78-87a9-426a-acc5-49f4619f13ef admin admin] The token cache is being invalidate because project 7de1f3976dbe4d4e8fa0495f764400e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:22:31.523404 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-cce52d78-87a9-426a-acc5-49f4619f13ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:31.524062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-cce52d78-87a9-426a-acc5-49f4619f13ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:31.524880 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f7be8-a588-4e1c-b8d8-8f66c36e70a0 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:31.525641 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 984/1969] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:22:31 2022] DELETE /identity/v3/projects/7de1f3976dbe4d4e8fa0495f764400e2 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:31.529561 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4b6f7be8-a588-4e1c-b8d8-8f66c36e70a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:31.532220 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a073c-a03b-4ed3-be5d-b55e6ece93b4 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:31.532503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a073c-a03b-4ed3-be5d-b55e6ece93b4 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:31.532803 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a073c-a03b-4ed3-be5d-b55e6ece93b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:31.553798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-1f4a073c-a03b-4ed3-be5d-b55e6ece93b4 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:31.555013 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1f4a073c-a03b-4ed3-be5d-b55e6ece93b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:31.604558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f7be8-a588-4e1c-b8d8-8f66c36e70a0 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:31.609282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca278289-1391-45ef-aad8-71dccd96a936 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:31.609948 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca278289-1391-45ef-aad8-71dccd96a936 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:31.610232 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca278289-1391-45ef-aad8-71dccd96a936 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:31.610623 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca278289-1391-45ef-aad8-71dccd96a936 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:31.612709 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ca278289-1391-45ef-aad8-71dccd96a936 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:31.627498 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca278289-1391-45ef-aad8-71dccd96a936 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:31.629407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 985/1970] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:31.630117 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca278289-1391-45ef-aad8-71dccd96a936 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:31.638327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683835e-0391-4425-a203-3833ff750ad1 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:31.638763 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683835e-0391-4425-a203-3833ff750ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:31.639074 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683835e-0391-4425-a203-3833ff750ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:31.649028 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 986/1971] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:31.658665 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:31.660766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-a683835e-0391-4425-a203-3833ff750ad1 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:31.662120 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a683835e-0391-4425-a203-3833ff750ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:31.673355 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 986/1972] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:31.678599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca278289-1391-45ef-aad8-71dccd96a936 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:31.703954 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca278289-1391-45ef-aad8-71dccd96a936 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:31.710696 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8df33-b89b-4fc1-97e1-d0bfccec3c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:31.711379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8df33-b89b-4fc1-97e1-d0bfccec3c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:31.711665 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8df33-b89b-4fc1-97e1-d0bfccec3c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:31.711995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8df33-b89b-4fc1-97e1-d0bfccec3c72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:31.713096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8df33-b89b-4fc1-97e1-d0bfccec3c72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:22:31.713411 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8df33-b89b-4fc1-97e1-d0bfccec3c72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:31.715297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8df33-b89b-4fc1-97e1-d0bfccec3c72 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:31.728320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 987/1973] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:22:31.733109 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683835e-0391-4425-a203-3833ff750ad1 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:31.745298 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683835e-0391-4425-a203-3833ff750ad1 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:31.751766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85925d60-edb6-492c-ab0e-c3203384b0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:31.752543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85925d60-edb6-492c-ab0e-c3203384b0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:31.752792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85925d60-edb6-492c-ab0e-c3203384b0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:31.753250 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85925d60-edb6-492c-ab0e-c3203384b0d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:31.754506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85925d60-edb6-492c-ab0e-c3203384b0d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:31.757312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85925d60-edb6-492c-ab0e-c3203384b0d0 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:31.874885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:31.885702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 987/1974] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:22:31 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:31.886884 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8df33-b89b-4fc1-97e1-d0bfccec3c72 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:31.897803 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8df33-b89b-4fc1-97e1-d0bfccec3c72 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:31.971921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce180bcd-faa8-4495-a0e0-9bf33efb958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:31.973302 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce180bcd-faa8-4495-a0e0-9bf33efb958b admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:31.973588 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce180bcd-faa8-4495-a0e0-9bf33efb958b admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:31.973866 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce180bcd-faa8-4495-a0e0-9bf33efb958b admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:31.974798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce180bcd-faa8-4495-a0e0-9bf33efb958b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:31.977639 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce180bcd-faa8-4495-a0e0-9bf33efb958b admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:32.096330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 988/1975] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:22:31 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:32.097962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85925d60-edb6-492c-ab0e-c3203384b0d0 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:32.108374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85925d60-edb6-492c-ab0e-c3203384b0d0 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:32.116708 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1376a-ade7-4023-96b9-c2cdd716d920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:32.117372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1376a-ade7-4023-96b9-c2cdd716d920 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:32.117655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1376a-ade7-4023-96b9-c2cdd716d920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:32.117989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1376a-ade7-4023-96b9-c2cdd716d920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:32.118757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1376a-ade7-4023-96b9-c2cdd716d920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:32.120617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1376a-ade7-4023-96b9-c2cdd716d920 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:32.150748 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 988/1976] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:22:32.155192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce180bcd-faa8-4495-a0e0-9bf33efb958b admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:32.170846 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce180bcd-faa8-4495-a0e0-9bf33efb958b admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:32.176405 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b99d43-4a3e-4af7-95a2-f4d17f8189d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:32.177129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b99d43-4a3e-4af7-95a2-f4d17f8189d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:32.177419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b99d43-4a3e-4af7-95a2-f4d17f8189d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:32.177695 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b99d43-4a3e-4af7-95a2-f4d17f8189d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:32.178430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b99d43-4a3e-4af7-95a2-f4d17f8189d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:32.180316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b99d43-4a3e-4af7-95a2-f4d17f8189d0 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:32.205936 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 989/1977] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:32.210182 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1376a-ade7-4023-96b9-c2cdd716d920 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:32.223009 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1376a-ade7-4023-96b9-c2cdd716d920 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:32.227815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddf1ad-1239-4ec0-beee-ae8831cfee5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:32.228961 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddf1ad-1239-4ec0-beee-ae8831cfee5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:32.229124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddf1ad-1239-4ec0-beee-ae8831cfee5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:32.229523 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddf1ad-1239-4ec0-beee-ae8831cfee5b admin admin] PATH_INFO: `/v3/projects/7af23cbd925d4896b69b2af345b75c0a/users/b0832cd2dda743ffafc60ae7f2c88167/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:32.247344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddf1ad-1239-4ec0-beee-ae8831cfee5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7af23cbd925d4896b69b2af345b75c0a, user_id=b0832cd2dda743ffafc60ae7f2c88167, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:32.250382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddf1ad-1239-4ec0-beee-ae8831cfee5b admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:32.350110 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 989/1978] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:32 2022] PUT /identity/v3/projects/7af23cbd925d4896b69b2af345b75c0a/users/b0832cd2dda743ffafc60ae7f2c88167/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:32.362298 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313d961-e52d-41d6-bab2-7e010f0bcc2c None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:32.362687 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313d961-e52d-41d6-bab2-7e010f0bcc2c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:32.363030 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313d961-e52d-41d6-bab2-7e010f0bcc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:32.397706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-e313d961-e52d-41d6-bab2-7e010f0bcc2c None None] MFA Rules not processed for user `b0832cd2dda743ffafc60ae7f2c88167`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:32.397706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e313d961-e52d-41d6-bab2-7e010f0bcc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:32.496110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 990/1979] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:32.511884 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddf1ad-1239-4ec0-beee-ae8831cfee5b admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:32.515189 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-41ddf1ad-1239-4ec0-beee-ae8831cfee5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:32.588196 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddf1ad-1239-4ec0-beee-ae8831cfee5b admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:32.592456 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1caa4-34f4-4419-9bde-e79d18878a06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:32.593217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1caa4-34f4-4419-9bde-e79d18878a06 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:32.593596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1caa4-34f4-4419-9bde-e79d18878a06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:32.593929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1caa4-34f4-4419-9bde-e79d18878a06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:32.603407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1caa4-34f4-4419-9bde-e79d18878a06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:32.604899 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1caa4-34f4-4419-9bde-e79d18878a06 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:32.615328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 990/1980] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:32.657879 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:35.765489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313d961-e52d-41d6-bab2-7e010f0bcc2c None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:35.767049 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e313d961-e52d-41d6-bab2-7e010f0bcc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:35.813936 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:35.855871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313d961-e52d-41d6-bab2-7e010f0bcc2c None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:35.865647 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e811ef-6b9d-4cb0-91c8-a7d249f7bcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:35.867909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e811ef-6b9d-4cb0-91c8-a7d249f7bcf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:35.867909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e811ef-6b9d-4cb0-91c8-a7d249f7bcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:35.867909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e811ef-6b9d-4cb0-91c8-a7d249f7bcf7 admin admin] PATH_INFO: `/v3/users/e9fcbfd74522488fb71e76ffafa90208` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:35.870436 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e811ef-6b9d-4cb0-91c8-a7d249f7bcf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9fcbfd74522488fb71e76ffafa90208)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:35.874316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e811ef-6b9d-4cb0-91c8-a7d249f7bcf7 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:35.952529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1caa4-34f4-4419-9bde-e79d18878a06 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:35.977019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-eab1caa4-34f4-4419-9bde-e79d18878a06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:35.977019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1caa4-34f4-4419-9bde-e79d18878a06 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:35.977019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d293e-c5b8-4515-9509-7311cf34cb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:35.977465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d293e-c5b8-4515-9509-7311cf34cb17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:35.977465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d293e-c5b8-4515-9509-7311cf34cb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:35.977465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d293e-c5b8-4515-9509-7311cf34cb17 admin admin] PATH_INFO: `/v3/users/cd242fc06f584b3da8ad8f8dfb519f99` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:35.977465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d293e-c5b8-4515-9509-7311cf34cb17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd242fc06f584b3da8ad8f8dfb519f99)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:35.979236 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d293e-c5b8-4515-9509-7311cf34cb17 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:36.261994 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-22e811ef-6b9d-4cb0-91c8-a7d249f7bcf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9fcbfd74522488fb71e76ffafa90208'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:36.286380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ce9d293e-c5b8-4515-9509-7311cf34cb17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd242fc06f584b3da8ad8f8dfb519f99'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:36.287093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ce9d293e-c5b8-4515-9509-7311cf34cb17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd242fc06f584b3da8ad8f8dfb519f99'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:36.287832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ce9d293e-c5b8-4515-9509-7311cf34cb17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd242fc06f584b3da8ad8f8dfb519f99'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:36.297793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:36.303788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ce9d293e-c5b8-4515-9509-7311cf34cb17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd242fc06f584b3da8ad8f8dfb519f99'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:36.311564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ce9d293e-c5b8-4515-9509-7311cf34cb17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd242fc06f584b3da8ad8f8dfb519f99'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:36.361067 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-22e811ef-6b9d-4cb0-91c8-a7d249f7bcf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9fcbfd74522488fb71e76ffafa90208'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:36.361758 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-22e811ef-6b9d-4cb0-91c8-a7d249f7bcf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9fcbfd74522488fb71e76ffafa90208'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:36.376924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-22e811ef-6b9d-4cb0-91c8-a7d249f7bcf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9fcbfd74522488fb71e76ffafa90208'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:36.379509 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-22e811ef-6b9d-4cb0-91c8-a7d249f7bcf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9fcbfd74522488fb71e76ffafa90208'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:36.394181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 991/1981] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:22:35 2022] DELETE /identity/v3/users/e9fcbfd74522488fb71e76ffafa90208 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:36.399819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eada7af-e99b-4f85-9d82-45370822a786 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:36.399819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eada7af-e99b-4f85-9d82-45370822a786 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:36.399819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eada7af-e99b-4f85-9d82-45370822a786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:36.417922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-3eada7af-e99b-4f85-9d82-45370822a786 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:36.419522 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3eada7af-e99b-4f85-9d82-45370822a786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:36.443173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 991/1982] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:22:35 2022] DELETE /identity/v3/users/cd242fc06f584b3da8ad8f8dfb519f99 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:36.449569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ff3ca-8450-459f-be69-3efb32e25e2a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:36.449569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ff3ca-8450-459f-be69-3efb32e25e2a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:36.449569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ff3ca-8450-459f-be69-3efb32e25e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:36.470364 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-d52ff3ca-8450-459f-be69-3efb32e25e2a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:36.472289 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d52ff3ca-8450-459f-be69-3efb32e25e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:36.536359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 992/1983] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:36.548442 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 992/1984] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:36.556923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eada7af-e99b-4f85-9d82-45370822a786 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:36.558719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3eada7af-e99b-4f85-9d82-45370822a786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:36.560160 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ff3ca-8450-459f-be69-3efb32e25e2a None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:36.561575 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d52ff3ca-8450-459f-be69-3efb32e25e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:36.657438 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ff3ca-8450-459f-be69-3efb32e25e2a None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:36.663876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b28427-ecc5-4c04-ba99-d39b84033f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:36.664908 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b28427-ecc5-4c04-ba99-d39b84033f79 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:36.666033 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b28427-ecc5-4c04-ba99-d39b84033f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:36.666508 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b28427-ecc5-4c04-ba99-d39b84033f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:36.672365 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eada7af-e99b-4f85-9d82-45370822a786 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:36.679474 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e933937-9e36-4405-adfd-cf6cf1349855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:36.680122 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e933937-9e36-4405-adfd-cf6cf1349855 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:36.680490 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e933937-9e36-4405-adfd-cf6cf1349855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:36.681034 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e933937-9e36-4405-adfd-cf6cf1349855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:36.685639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b28427-ecc5-4c04-ba99-d39b84033f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:36.688784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b28427-ecc5-4c04-ba99-d39b84033f79 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:36.693339 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e933937-9e36-4405-adfd-cf6cf1349855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:36.694835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e933937-9e36-4405-adfd-cf6cf1349855 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:36.700625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:36.709704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 993/1985] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:36.711825 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 993/1986] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:37.407240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b28427-ecc5-4c04-ba99-d39b84033f79 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:37.408790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-89b28427-ecc5-4c04-ba99-d39b84033f79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:37.414522 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e933937-9e36-4405-adfd-cf6cf1349855 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:37.416475 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-2e933937-9e36-4405-adfd-cf6cf1349855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:37.439127 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b28427-ecc5-4c04-ba99-d39b84033f79 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:37.442859 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e933937-9e36-4405-adfd-cf6cf1349855 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:37.452663 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7198d-d56e-43d6-9e8c-1a36f6f737db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:37.457831 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a1bbb-eb50-45d5-b90e-b67b9e48348c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:37.457831 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a1bbb-eb50-45d5-b90e-b67b9e48348c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:37.457831 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a1bbb-eb50-45d5-b90e-b67b9e48348c admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:37.457831 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a1bbb-eb50-45d5-b90e-b67b9e48348c admin admin] PATH_INFO: `/v3/projects/909c1d6f7a7241b4bedac3d601e664fd` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:37.467435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7198d-d56e-43d6-9e8c-1a36f6f737db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:37.467731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7198d-d56e-43d6-9e8c-1a36f6f737db admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:37.473691 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7198d-d56e-43d6-9e8c-1a36f6f737db admin admin] PATH_INFO: `/v3/projects/385f36ba49844a92ba40f05defa9ec88` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:37.476056 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a1bbb-eb50-45d5-b90e-b67b9e48348c admin admin] RBAC: Authorizing `identity:delete_project(project_id=909c1d6f7a7241b4bedac3d601e664fd)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:37.476938 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7198d-d56e-43d6-9e8c-1a36f6f737db admin admin] RBAC: Authorizing `identity:delete_project(project_id=385f36ba49844a92ba40f05defa9ec88)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:37.479067 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a1bbb-eb50-45d5-b90e-b67b9e48348c admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:37.481230 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7198d-d56e-43d6-9e8c-1a36f6f737db admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:37.655475 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-afa7198d-d56e-43d6-9e8c-1a36f6f737db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385f36ba49844a92ba40f05defa9ec88', 'request_id': 'req-afa7198d-d56e-43d6-9e8c-1a36f6f737db'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:37.671028 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-b64a1bbb-eb50-45d5-b90e-b67b9e48348c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '909c1d6f7a7241b4bedac3d601e664fd', 'request_id': 'req-b64a1bbb-eb50-45d5-b90e-b67b9e48348c'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:37.679507 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-b64a1bbb-eb50-45d5-b90e-b67b9e48348c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '909c1d6f7a7241b4bedac3d601e664fd', 'request_id': 'req-b64a1bbb-eb50-45d5-b90e-b67b9e48348c'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:37.720655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-afa7198d-d56e-43d6-9e8c-1a36f6f737db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385f36ba49844a92ba40f05defa9ec88', 'request_id': 'req-afa7198d-d56e-43d6-9e8c-1a36f6f737db'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:37.731857 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-afa7198d-d56e-43d6-9e8c-1a36f6f737db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385f36ba49844a92ba40f05defa9ec88', 'request_id': 'req-afa7198d-d56e-43d6-9e8c-1a36f6f737db'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:37.738911 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:37.747139 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-afa7198d-d56e-43d6-9e8c-1a36f6f737db admin admin] The token cache is being invalidate because project 385f36ba49844a92ba40f05defa9ec88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:22:37.747488 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-afa7198d-d56e-43d6-9e8c-1a36f6f737db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:37.748190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-afa7198d-d56e-43d6-9e8c-1a36f6f737db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:37.749896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 994/1987] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:22:37 2022] DELETE /identity/v3/projects/385f36ba49844a92ba40f05defa9ec88 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:37.754350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7198d-d56e-43d6-9e8c-1a36f6f737db admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:37.756216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-afa7198d-d56e-43d6-9e8c-1a36f6f737db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:37.789448 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-b64a1bbb-eb50-45d5-b90e-b67b9e48348c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '909c1d6f7a7241b4bedac3d601e664fd', 'request_id': 'req-b64a1bbb-eb50-45d5-b90e-b67b9e48348c'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:37.803035 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-b64a1bbb-eb50-45d5-b90e-b67b9e48348c admin admin] The token cache is being invalidate because project 909c1d6f7a7241b4bedac3d601e664fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:22:37.803481 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-b64a1bbb-eb50-45d5-b90e-b67b9e48348c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:37.804225 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-b64a1bbb-eb50-45d5-b90e-b67b9e48348c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:37.806277 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 994/1988] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:22:37 2022] DELETE /identity/v3/projects/909c1d6f7a7241b4bedac3d601e664fd => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:37.811391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713fc8b-74e9-4ab9-af92-2bcc4ecaa5e3 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:37.811937 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713fc8b-74e9-4ab9-af92-2bcc4ecaa5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:37.812065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713fc8b-74e9-4ab9-af92-2bcc4ecaa5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:37.837057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-c713fc8b-74e9-4ab9-af92-2bcc4ecaa5e3 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:37.838837 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-c713fc8b-74e9-4ab9-af92-2bcc4ecaa5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:37.839514 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7198d-d56e-43d6-9e8c-1a36f6f737db admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:37.922804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbc800-0a04-4bd1-9559-ae073b46bb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:37.924072 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbc800-0a04-4bd1-9559-ae073b46bb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:37.924428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbc800-0a04-4bd1-9559-ae073b46bb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:37.925090 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbc800-0a04-4bd1-9559-ae073b46bb54 admin admin] PATH_INFO: `/v3/users/cd38236746fa40d3bd6f96293e62c2b8` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:37.926632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbc800-0a04-4bd1-9559-ae073b46bb54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd38236746fa40d3bd6f96293e62c2b8)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:37.928940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbc800-0a04-4bd1-9559-ae073b46bb54 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:37.931096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 995/1989] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:22:37.940211 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68427f-4bc5-4e2d-9580-cc7a7258fef2 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:37.940497 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68427f-4bc5-4e2d-9580-cc7a7258fef2 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:37.941323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68427f-4bc5-4e2d-9580-cc7a7258fef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:37.964337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-2f68427f-4bc5-4e2d-9580-cc7a7258fef2 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:37.965550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-2f68427f-4bc5-4e2d-9580-cc7a7258fef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:37.975956 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 996/1990] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:37.980288 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68427f-4bc5-4e2d-9580-cc7a7258fef2 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:37.990341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68427f-4bc5-4e2d-9580-cc7a7258fef2 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:37.995457 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76ec48-a073-4775-9f1c-cd390a2ff53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:37.996152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76ec48-a073-4775-9f1c-cd390a2ff53c admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:37.996434 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76ec48-a073-4775-9f1c-cd390a2ff53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:37.998274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76ec48-a073-4775-9f1c-cd390a2ff53c admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:37.998274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76ec48-a073-4775-9f1c-cd390a2ff53c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:22:37.998274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76ec48-a073-4775-9f1c-cd390a2ff53c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:37.999534 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76ec48-a073-4775-9f1c-cd390a2ff53c admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:38.012746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 997/1991] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:22:38.016985 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76ec48-a073-4775-9f1c-cd390a2ff53c admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:38.028483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76ec48-a073-4775-9f1c-cd390a2ff53c admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:38.034491 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae8d83-fbe2-4874-a7db-395fa7f40b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:38.041151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae8d83-fbe2-4874-a7db-395fa7f40b81 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:38.041151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae8d83-fbe2-4874-a7db-395fa7f40b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:38.041151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae8d83-fbe2-4874-a7db-395fa7f40b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:38.041151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae8d83-fbe2-4874-a7db-395fa7f40b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:38.041151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae8d83-fbe2-4874-a7db-395fa7f40b81 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:38.150313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-b2fbc800-0a04-4bd1-9559-ae073b46bb54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd38236746fa40d3bd6f96293e62c2b8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:38.151093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-b2fbc800-0a04-4bd1-9559-ae073b46bb54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd38236746fa40d3bd6f96293e62c2b8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:38.151770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-b2fbc800-0a04-4bd1-9559-ae073b46bb54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd38236746fa40d3bd6f96293e62c2b8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:38.179199 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 998/1992] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:22:38 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:38.181975 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae8d83-fbe2-4874-a7db-395fa7f40b81 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:38.186290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e1ae8d83-fbe2-4874-a7db-395fa7f40b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:38.190302 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-b2fbc800-0a04-4bd1-9559-ae073b46bb54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd38236746fa40d3bd6f96293e62c2b8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:38.199824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-b2fbc800-0a04-4bd1-9559-ae073b46bb54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd38236746fa40d3bd6f96293e62c2b8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:38.244340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:38.267783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae8d83-fbe2-4874-a7db-395fa7f40b81 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:38.273841 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f0365-77a7-40f7-99f2-429f8070b221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:38.274604 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f0365-77a7-40f7-99f2-429f8070b221 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:38.274941 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f0365-77a7-40f7-99f2-429f8070b221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:38.275164 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f0365-77a7-40f7-99f2-429f8070b221 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:38.276158 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f0365-77a7-40f7-99f2-429f8070b221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:38.278258 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f0365-77a7-40f7-99f2-429f8070b221 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:38.344521 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 995/1993] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:22:37 2022] DELETE /identity/v3/users/cd38236746fa40d3bd6f96293e62c2b8 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:22:38.381608 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 999/1994] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:22:38 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:38.386437 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbc800-0a04-4bd1-9559-ae073b46bb54 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:38.428231 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:38.468515 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbc800-0a04-4bd1-9559-ae073b46bb54 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:38.475894 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159484dd-d156-4270-be45-d29305652c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:38.476749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159484dd-d156-4270-be45-d29305652c52 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:38.476907 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159484dd-d156-4270-be45-d29305652c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:38.477190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159484dd-d156-4270-be45-d29305652c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:38.477936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159484dd-d156-4270-be45-d29305652c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:38.479615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159484dd-d156-4270-be45-d29305652c52 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:38.492831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 996/1995] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:38.495591 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f0365-77a7-40f7-99f2-429f8070b221 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:38.507160 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f0365-77a7-40f7-99f2-429f8070b221 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:38.517719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb35c75-643c-408e-92b3-f0d3c69b1edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:38.518563 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb35c75-643c-408e-92b3-f0d3c69b1edc admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:38.518743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb35c75-643c-408e-92b3-f0d3c69b1edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:38.519033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb35c75-643c-408e-92b3-f0d3c69b1edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:38.519814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb35c75-643c-408e-92b3-f0d3c69b1edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:38.521479 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb35c75-643c-408e-92b3-f0d3c69b1edc admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:38.536866 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1000/1996] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:38.539181 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159484dd-d156-4270-be45-d29305652c52 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:38.551798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159484dd-d156-4270-be45-d29305652c52 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:38.570887 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc43e11-36ac-42ab-b865-d55b089d336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:38.570887 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc43e11-36ac-42ab-b865-d55b089d336d admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:38.570887 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc43e11-36ac-42ab-b865-d55b089d336d admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:38.570887 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc43e11-36ac-42ab-b865-d55b089d336d admin admin] PATH_INFO: `/v3/projects/9e10dcba12ef48aa8be65c4628572c22/users/b3efa221fe5843cbb3671f4a3512f83b/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:38.599299 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc43e11-36ac-42ab-b865-d55b089d336d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e10dcba12ef48aa8be65c4628572c22, user_id=b3efa221fe5843cbb3671f4a3512f83b, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:38.602046 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc43e11-36ac-42ab-b865-d55b089d336d admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:38.675324 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 997/1997] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:38 2022] PUT /identity/v3/projects/9e10dcba12ef48aa8be65c4628572c22/users/b3efa221fe5843cbb3671f4a3512f83b/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:38.686936 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e0b31-41fe-4507-99f8-e79095a3c832 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:38.687228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e0b31-41fe-4507-99f8-e79095a3c832 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:38.687507 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e0b31-41fe-4507-99f8-e79095a3c832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:38.707999 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-0e0e0b31-41fe-4507-99f8-e79095a3c832 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:38.709583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0e0e0b31-41fe-4507-99f8-e79095a3c832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:38.787551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1001/1998] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:38.797997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc43e11-36ac-42ab-b865-d55b089d336d admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:38.799864 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2cc43e11-36ac-42ab-b865-d55b089d336d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:38.832277 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e0b31-41fe-4507-99f8-e79095a3c832 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:38.834551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0e0e0b31-41fe-4507-99f8-e79095a3c832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:38.852018 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e0b31-41fe-4507-99f8-e79095a3c832 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:38.856935 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b249a49-2ef1-420b-8fc2-4b501632015b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:38.857813 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b249a49-2ef1-420b-8fc2-4b501632015b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:38.858178 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b249a49-2ef1-420b-8fc2-4b501632015b admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:38.858466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b249a49-2ef1-420b-8fc2-4b501632015b admin admin] PATH_INFO: `/v3/projects/0bfc35af8b3849c99f495582b0d973db` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:38.859874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b249a49-2ef1-420b-8fc2-4b501632015b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bfc35af8b3849c99f495582b0d973db)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:38.861830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b249a49-2ef1-420b-8fc2-4b501632015b admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:38.870113 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc43e11-36ac-42ab-b865-d55b089d336d admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:38.874546 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84318f70-a793-4866-9fd2-869c6b06066e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:38.875387 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84318f70-a793-4866-9fd2-869c6b06066e service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:38.875834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84318f70-a793-4866-9fd2-869c6b06066e service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:38.876260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84318f70-a793-4866-9fd2-869c6b06066e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:38.889824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84318f70-a793-4866-9fd2-869c6b06066e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:38.891293 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84318f70-a793-4866-9fd2-869c6b06066e service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:38.904303 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 998/1999] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:38.984437 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-1b249a49-2ef1-420b-8fc2-4b501632015b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bfc35af8b3849c99f495582b0d973db', 'request_id': 'req-1b249a49-2ef1-420b-8fc2-4b501632015b'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:38.990930 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-1b249a49-2ef1-420b-8fc2-4b501632015b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bfc35af8b3849c99f495582b0d973db', 'request_id': 'req-1b249a49-2ef1-420b-8fc2-4b501632015b'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:39.125360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-1b249a49-2ef1-420b-8fc2-4b501632015b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bfc35af8b3849c99f495582b0d973db', 'request_id': 'req-1b249a49-2ef1-420b-8fc2-4b501632015b'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:39.137109 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-1b249a49-2ef1-420b-8fc2-4b501632015b admin admin] The token cache is being invalidate because project 0bfc35af8b3849c99f495582b0d973db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:22:39.137398 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-1b249a49-2ef1-420b-8fc2-4b501632015b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:39.138145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-1b249a49-2ef1-420b-8fc2-4b501632015b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:39.139782 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1002/2000] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:22:38 2022] DELETE /identity/v3/projects/0bfc35af8b3849c99f495582b0d973db => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:39.145499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2684f-7ef9-48a3-932c-ca0989314645 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:39.145785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2684f-7ef9-48a3-932c-ca0989314645 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:39.146062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2684f-7ef9-48a3-932c-ca0989314645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:39.165233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-97d2684f-7ef9-48a3-932c-ca0989314645 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:39.166432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-97d2684f-7ef9-48a3-932c-ca0989314645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:39.229239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 999/2001] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:39.237028 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87265d20-d4f8-46c3-8881-7bab109c40ad None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:39.237217 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87265d20-d4f8-46c3-8881-7bab109c40ad None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:39.237501 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87265d20-d4f8-46c3-8881-7bab109c40ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:39.265263 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-87265d20-d4f8-46c3-8881-7bab109c40ad None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:39.266536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-87265d20-d4f8-46c3-8881-7bab109c40ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:39.275051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1003/2002] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:39.279699 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2684f-7ef9-48a3-932c-ca0989314645 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:39.290348 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2684f-7ef9-48a3-932c-ca0989314645 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:39.294951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ad04c-31d9-4b83-aadc-a169b6d8cf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:39.295770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ad04c-31d9-4b83-aadc-a169b6d8cf7b admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:39.296064 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ad04c-31d9-4b83-aadc-a169b6d8cf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:39.296495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ad04c-31d9-4b83-aadc-a169b6d8cf7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:39.297267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ad04c-31d9-4b83-aadc-a169b6d8cf7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:22:39.297578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ad04c-31d9-4b83-aadc-a169b6d8cf7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:39.299337 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ad04c-31d9-4b83-aadc-a169b6d8cf7b admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:39.312319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1000/2003] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:22:39.317485 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87265d20-d4f8-46c3-8881-7bab109c40ad None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:39.326761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87265d20-d4f8-46c3-8881-7bab109c40ad None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:39.331477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8ec19-fa23-4075-abc6-9d1f1bcab5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:39.332778 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8ec19-fa23-4075-abc6-9d1f1bcab5fb admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:39.333060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8ec19-fa23-4075-abc6-9d1f1bcab5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:39.333335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8ec19-fa23-4075-abc6-9d1f1bcab5fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:39.334042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8ec19-fa23-4075-abc6-9d1f1bcab5fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:39.335990 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8ec19-fa23-4075-abc6-9d1f1bcab5fb admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:39.450107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1004/2004] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:22:39 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:39.454473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ad04c-31d9-4b83-aadc-a169b6d8cf7b admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:39.465196 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ad04c-31d9-4b83-aadc-a169b6d8cf7b admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:39.498810 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:39.534209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eec9a8-88ba-45cc-bc7c-96dbc767c27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:39.534937 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eec9a8-88ba-45cc-bc7c-96dbc767c27a admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:39.535216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eec9a8-88ba-45cc-bc7c-96dbc767c27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:39.535544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eec9a8-88ba-45cc-bc7c-96dbc767c27a admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:39.536252 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eec9a8-88ba-45cc-bc7c-96dbc767c27a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:39.538371 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eec9a8-88ba-45cc-bc7c-96dbc767c27a admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:39.669029 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1001/2005] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:22:39 2022] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:39.670250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8ec19-fa23-4075-abc6-9d1f1bcab5fb admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:39.682287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8ec19-fa23-4075-abc6-9d1f1bcab5fb admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:39.688708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4252b-26c5-4a1f-bd42-e67e31c93d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:39.689402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4252b-26c5-4a1f-bd42-e67e31c93d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:39.689758 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4252b-26c5-4a1f-bd42-e67e31c93d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:39.690047 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4252b-26c5-4a1f-bd42-e67e31c93d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:39.690794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4252b-26c5-4a1f-bd42-e67e31c93d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:39.693050 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4252b-26c5-4a1f-bd42-e67e31c93d06 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:39.707425 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1005/2006] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:39.708880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eec9a8-88ba-45cc-bc7c-96dbc767c27a admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:39.721192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eec9a8-88ba-45cc-bc7c-96dbc767c27a admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:39.736185 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618a655-b321-46a0-9888-dde6698de7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:39.736941 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618a655-b321-46a0-9888-dde6698de7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:39.737226 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618a655-b321-46a0-9888-dde6698de7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:39.737590 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618a655-b321-46a0-9888-dde6698de7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:39.738905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618a655-b321-46a0-9888-dde6698de7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:39.741008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618a655-b321-46a0-9888-dde6698de7b3 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:39.753323 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1002/2007] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:39.758363 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4252b-26c5-4a1f-bd42-e67e31c93d06 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:39.764674 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:39.770254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4252b-26c5-4a1f-bd42-e67e31c93d06 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:39.788972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b6396-c547-4bcb-b2ac-6d518e4af04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:39.794308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b6396-c547-4bcb-b2ac-6d518e4af04b admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:39.794308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b6396-c547-4bcb-b2ac-6d518e4af04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:39.794308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b6396-c547-4bcb-b2ac-6d518e4af04b admin admin] PATH_INFO: `/v3/projects/b60f240b38bb491ba35b87e2687ede89/users/28298596614e408d9bfc0173c758be7f/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:39.817504 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b6396-c547-4bcb-b2ac-6d518e4af04b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60f240b38bb491ba35b87e2687ede89, user_id=28298596614e408d9bfc0173c758be7f, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:39.820081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b6396-c547-4bcb-b2ac-6d518e4af04b admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:39.875706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1006/2008] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:39 2022] PUT /identity/v3/projects/b60f240b38bb491ba35b87e2687ede89/users/28298596614e408d9bfc0173c758be7f/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:22:39.886031 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3aaccc-dec8-4ec7-8aa0-3271abcc2671 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:39.886327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3aaccc-dec8-4ec7-8aa0-3271abcc2671 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:39.886611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3aaccc-dec8-4ec7-8aa0-3271abcc2671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:39.914857 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-1b3aaccc-dec8-4ec7-8aa0-3271abcc2671 None None] MFA Rules not processed for user `28298596614e408d9bfc0173c758be7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:39.916084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1b3aaccc-dec8-4ec7-8aa0-3271abcc2671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:39.982601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1003/2009] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:39.994745 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b6396-c547-4bcb-b2ac-6d518e4af04b admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:39.998297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3f1b6396-c547-4bcb-b2ac-6d518e4af04b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:40.059247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b6396-c547-4bcb-b2ac-6d518e4af04b admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:40.062971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816150ad-cd13-4151-bd6c-c46600a03c67 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdb2d75e4025a5d73ea713c690b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:40.066456 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816150ad-cd13-4151-bd6c-c46600a03c67 service glance] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:40.066456 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816150ad-cd13-4151-bd6c-c46600a03c67 service glance] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:40.066456 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816150ad-cd13-4151-bd6c-c46600a03c67 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:40.073605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816150ad-cd13-4151-bd6c-c46600a03c67 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:40.075035 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816150ad-cd13-4151-bd6c-c46600a03c67 service glance] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:40.084014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1007/2010] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:46.401375 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3aaccc-dec8-4ec7-8aa0-3271abcc2671 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:46.403014 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1b3aaccc-dec8-4ec7-8aa0-3271abcc2671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:46.596141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:46.637546 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3aaccc-dec8-4ec7-8aa0-3271abcc2671 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:46.643273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a976d89-eb87-4e92-91a4-15be66046258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:46.644955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a976d89-eb87-4e92-91a4-15be66046258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:46.645311 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a976d89-eb87-4e92-91a4-15be66046258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:46.645586 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a976d89-eb87-4e92-91a4-15be66046258 admin admin] PATH_INFO: `/v3/users/b0832cd2dda743ffafc60ae7f2c88167` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:46.647020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a976d89-eb87-4e92-91a4-15be66046258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0832cd2dda743ffafc60ae7f2c88167)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:46.649110 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a976d89-eb87-4e92-91a4-15be66046258 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:46.900808 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2a976d89-eb87-4e92-91a4-15be66046258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0832cd2dda743ffafc60ae7f2c88167'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:46.901697 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2a976d89-eb87-4e92-91a4-15be66046258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0832cd2dda743ffafc60ae7f2c88167'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:46.908420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2a976d89-eb87-4e92-91a4-15be66046258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0832cd2dda743ffafc60ae7f2c88167'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:46.927559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2a976d89-eb87-4e92-91a4-15be66046258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0832cd2dda743ffafc60ae7f2c88167'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:46.935835 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2a976d89-eb87-4e92-91a4-15be66046258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0832cd2dda743ffafc60ae7f2c88167'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:47.009958 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1004/2011] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:22:46 2022] DELETE /identity/v3/users/b0832cd2dda743ffafc60ae7f2c88167 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:47.014788 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be125310-c22f-4e09-af0b-0340d3739052 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:47.015285 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be125310-c22f-4e09-af0b-0340d3739052 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:47.015479 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be125310-c22f-4e09-af0b-0340d3739052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:47.046545 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-be125310-c22f-4e09-af0b-0340d3739052 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:47.049217 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-be125310-c22f-4e09-af0b-0340d3739052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:47.076936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31934f-d831-46e0-ab41-6b6401495bde None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:47.077229 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31934f-d831-46e0-ab41-6b6401495bde None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:47.077537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31934f-d831-46e0-ab41-6b6401495bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:47.113831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-9a31934f-d831-46e0-ab41-6b6401495bde None None] MFA Rules not processed for user `b3efa221fe5843cbb3671f4a3512f83b`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:47.113831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-9a31934f-d831-46e0-ab41-6b6401495bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:47.162751 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1008/2012] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:22:47.173890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be125310-c22f-4e09-af0b-0340d3739052 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:47.176699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-be125310-c22f-4e09-af0b-0340d3739052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:47.246263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1005/2013] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:47.251746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31934f-d831-46e0-ab41-6b6401495bde None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:47.253668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-9a31934f-d831-46e0-ab41-6b6401495bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:47.270514 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31934f-d831-46e0-ab41-6b6401495bde None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:47.278025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3d0e5-d825-4bdd-ae44-6aa71dd2c452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:47.280569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3d0e5-d825-4bdd-ae44-6aa71dd2c452 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:47.281125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3d0e5-d825-4bdd-ae44-6aa71dd2c452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:47.281590 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3d0e5-d825-4bdd-ae44-6aa71dd2c452 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:47.282784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3d0e5-d825-4bdd-ae44-6aa71dd2c452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:47.285570 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3d0e5-d825-4bdd-ae44-6aa71dd2c452 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:47.336857 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:47.371473 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be125310-c22f-4e09-af0b-0340d3739052 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:47.373588 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765aa672-9833-414d-8d97-30b61deb79f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:47.374325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765aa672-9833-414d-8d97-30b61deb79f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:47.374620 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765aa672-9833-414d-8d97-30b61deb79f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:47.374898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765aa672-9833-414d-8d97-30b61deb79f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:47.386219 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765aa672-9833-414d-8d97-30b61deb79f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:47.388988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765aa672-9833-414d-8d97-30b61deb79f0 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:47.398703 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1006/2014] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:22:47 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:47.405511 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3d0e5-d825-4bdd-ae44-6aa71dd2c452 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:47.406898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1009/2015] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:22:47.439985 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:47.487660 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3d0e5-d825-4bdd-ae44-6aa71dd2c452 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:47.493804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db626dc3-7e9e-445a-9a83-ac8c6882ecc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:47.495481 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db626dc3-7e9e-445a-9a83-ac8c6882ecc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:47.495481 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db626dc3-7e9e-445a-9a83-ac8c6882ecc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:47.495481 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db626dc3-7e9e-445a-9a83-ac8c6882ecc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:47.496363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db626dc3-7e9e-445a-9a83-ac8c6882ecc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:47.498704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db626dc3-7e9e-445a-9a83-ac8c6882ecc9 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:47.598739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1007/2016] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:22:47 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:47.600080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765aa672-9833-414d-8d97-30b61deb79f0 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:47.610858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765aa672-9833-414d-8d97-30b61deb79f0 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:47.616301 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0daca4-e5c5-4746-b8c1-b11a16964f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:47.622569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0daca4-e5c5-4746-b8c1-b11a16964f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:47.622569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0daca4-e5c5-4746-b8c1-b11a16964f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:47.622569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0daca4-e5c5-4746-b8c1-b11a16964f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:47.622569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0daca4-e5c5-4746-b8c1-b11a16964f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:47.622569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0daca4-e5c5-4746-b8c1-b11a16964f97 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:47.631308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1010/2017] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:47.635600 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db626dc3-7e9e-445a-9a83-ac8c6882ecc9 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:47.646634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db626dc3-7e9e-445a-9a83-ac8c6882ecc9 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:47.652491 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd5132-c4ca-4964-8cb0-1e5f2a895930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:47.654762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd5132-c4ca-4964-8cb0-1e5f2a895930 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:47.654762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd5132-c4ca-4964-8cb0-1e5f2a895930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:47.654762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd5132-c4ca-4964-8cb0-1e5f2a895930 admin admin] PATH_INFO: `/v3/projects/6077a9ad8129406fa21a539127ffaabc/users/ca36e7e448704171ab6253d15fe80dd4/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:47.672693 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd5132-c4ca-4964-8cb0-1e5f2a895930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6077a9ad8129406fa21a539127ffaabc, user_id=ca36e7e448704171ab6253d15fe80dd4, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:47.675431 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd5132-c4ca-4964-8cb0-1e5f2a895930 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:47.772834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1008/2018] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:47 2022] PUT /identity/v3/projects/6077a9ad8129406fa21a539127ffaabc/users/ca36e7e448704171ab6253d15fe80dd4/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:47.777257 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0daca4-e5c5-4746-b8c1-b11a16964f97 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:47.788192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0daca4-e5c5-4746-b8c1-b11a16964f97 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:47.864066 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf18d1-a537-40ca-9773-8d32558a5a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:47.864835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf18d1-a537-40ca-9773-8d32558a5a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:47.865123 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf18d1-a537-40ca-9773-8d32558a5a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:47.865405 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf18d1-a537-40ca-9773-8d32558a5a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:47.866150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf18d1-a537-40ca-9773-8d32558a5a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:47.867810 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf18d1-a537-40ca-9773-8d32558a5a86 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:47.883811 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1011/2019] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:47.885701 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd5132-c4ca-4964-8cb0-1e5f2a895930 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:47.901273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd5132-c4ca-4964-8cb0-1e5f2a895930 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:47.909042 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423be5d-6cf4-4275-a228-88a097d2e00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:47.910026 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423be5d-6cf4-4275-a228-88a097d2e00a admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:47.910301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423be5d-6cf4-4275-a228-88a097d2e00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:47.910584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423be5d-6cf4-4275-a228-88a097d2e00a admin admin] PATH_INFO: `/v3/projects/6077a9ad8129406fa21a539127ffaabc/users/ca36e7e448704171ab6253d15fe80dd4/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:47.913816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423be5d-6cf4-4275-a228-88a097d2e00a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6077a9ad8129406fa21a539127ffaabc, user_id=ca36e7e448704171ab6253d15fe80dd4, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:47.918211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423be5d-6cf4-4275-a228-88a097d2e00a admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:47.926605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf18d1-a537-40ca-9773-8d32558a5a86 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:47.928818 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4faf18d1-a537-40ca-9773-8d32558a5a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:47.952308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf18d1-a537-40ca-9773-8d32558a5a86 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:47.958379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1009/2020] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:47 2022] PUT /identity/v3/projects/6077a9ad8129406fa21a539127ffaabc/users/ca36e7e448704171ab6253d15fe80dd4/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:22:48.036139 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a723c8-1e0c-42c0-9523-0da43bb28e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:48.037218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a723c8-1e0c-42c0-9523-0da43bb28e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:48.037593 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a723c8-1e0c-42c0-9523-0da43bb28e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:48.037950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a723c8-1e0c-42c0-9523-0da43bb28e4f admin admin] PATH_INFO: `/v3/projects/7af23cbd925d4896b69b2af345b75c0a` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:48.040904 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a723c8-1e0c-42c0-9523-0da43bb28e4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7af23cbd925d4896b69b2af345b75c0a)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:48.042678 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a723c8-1e0c-42c0-9523-0da43bb28e4f admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:48.185695 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-04a723c8-1e0c-42c0-9523-0da43bb28e4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7af23cbd925d4896b69b2af345b75c0a', 'request_id': 'req-04a723c8-1e0c-42c0-9523-0da43bb28e4f'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:48.194602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-04a723c8-1e0c-42c0-9523-0da43bb28e4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7af23cbd925d4896b69b2af345b75c0a', 'request_id': 'req-04a723c8-1e0c-42c0-9523-0da43bb28e4f'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:48.252541 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-04a723c8-1e0c-42c0-9523-0da43bb28e4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7af23cbd925d4896b69b2af345b75c0a', 'request_id': 'req-04a723c8-1e0c-42c0-9523-0da43bb28e4f'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:48.262715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:48.268333 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-04a723c8-1e0c-42c0-9523-0da43bb28e4f admin admin] The token cache is being invalidate because project 7af23cbd925d4896b69b2af345b75c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:22:48.268753 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-04a723c8-1e0c-42c0-9523-0da43bb28e4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:48.270106 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-04a723c8-1e0c-42c0-9523-0da43bb28e4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:48.275849 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1012/2021] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:22:47 2022] DELETE /identity/v3/projects/7af23cbd925d4896b69b2af345b75c0a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:22:48.280124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ff0cc-3f97-4e11-9fb3-909e33ae6ceb None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:48.280478 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ff0cc-3f97-4e11-9fb3-909e33ae6ceb None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:48.280830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ff0cc-3f97-4e11-9fb3-909e33ae6ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:48.330042 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-ba4ff0cc-3f97-4e11-9fb3-909e33ae6ceb None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:48.331260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ba4ff0cc-3f97-4e11-9fb3-909e33ae6ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:48.409878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1010/2022] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:48.417770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e72d2c-1034-4de1-8e95-be321a0821d2 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:48.418128 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e72d2c-1034-4de1-8e95-be321a0821d2 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:48.418488 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e72d2c-1034-4de1-8e95-be321a0821d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:48.492766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-23e72d2c-1034-4de1-8e95-be321a0821d2 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:48.494126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-23e72d2c-1034-4de1-8e95-be321a0821d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:48.521025 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1013/2023] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:22:48.528969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ff0cc-3f97-4e11-9fb3-909e33ae6ceb None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:48.557908 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ff0cc-3f97-4e11-9fb3-909e33ae6ceb None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:48.567588 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32781da-d25f-4305-8e6d-5123cdc0a266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:48.568762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32781da-d25f-4305-8e6d-5123cdc0a266 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:48.569175 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32781da-d25f-4305-8e6d-5123cdc0a266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:48.570006 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32781da-d25f-4305-8e6d-5123cdc0a266 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:48.570899 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32781da-d25f-4305-8e6d-5123cdc0a266 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:22:48.571315 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32781da-d25f-4305-8e6d-5123cdc0a266 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:48.577238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32781da-d25f-4305-8e6d-5123cdc0a266 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:48.601945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1011/2024] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:22:48.606824 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e72d2c-1034-4de1-8e95-be321a0821d2 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:48.619247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e72d2c-1034-4de1-8e95-be321a0821d2 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:48.626796 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce03b9c-3b00-42b4-a785-6b701b7b5ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:48.627708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce03b9c-3b00-42b4-a785-6b701b7b5ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:48.628108 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce03b9c-3b00-42b4-a785-6b701b7b5ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:48.628488 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce03b9c-3b00-42b4-a785-6b701b7b5ef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:48.629489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce03b9c-3b00-42b4-a785-6b701b7b5ef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:48.632943 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce03b9c-3b00-42b4-a785-6b701b7b5ef9 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:48.716322 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1014/2025] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:22:48 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:48.725425 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32781da-d25f-4305-8e6d-5123cdc0a266 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:48.739999 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32781da-d25f-4305-8e6d-5123cdc0a266 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:48.840014 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:48.855836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc63477-cdb0-4209-b029-2f0a41c29863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:48.862470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc63477-cdb0-4209-b029-2f0a41c29863 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:48.862470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc63477-cdb0-4209-b029-2f0a41c29863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:48.862470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc63477-cdb0-4209-b029-2f0a41c29863 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:48.862470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc63477-cdb0-4209-b029-2f0a41c29863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:48.862470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc63477-cdb0-4209-b029-2f0a41c29863 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:48.964843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1012/2026] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:22:48 2022] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:48.973260 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce03b9c-3b00-42b4-a785-6b701b7b5ef9 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:48.989231 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce03b9c-3b00-42b4-a785-6b701b7b5ef9 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:49.000525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b7bb9-998a-46e6-adac-68d00d0785ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:49.000525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b7bb9-998a-46e6-adac-68d00d0785ac admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:49.004080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b7bb9-998a-46e6-adac-68d00d0785ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:49.004697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b7bb9-998a-46e6-adac-68d00d0785ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:49.005649 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b7bb9-998a-46e6-adac-68d00d0785ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:49.007862 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b7bb9-998a-46e6-adac-68d00d0785ac admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:49.027414 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1015/2027] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:49.033013 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc63477-cdb0-4209-b029-2f0a41c29863 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:49.050630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc63477-cdb0-4209-b029-2f0a41c29863 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:49.050630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7c2cf-239b-47ce-8784-085cbde5b46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:49.051778 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7c2cf-239b-47ce-8784-085cbde5b46e admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:49.052070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7c2cf-239b-47ce-8784-085cbde5b46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:49.052353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7c2cf-239b-47ce-8784-085cbde5b46e admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:49.053453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7c2cf-239b-47ce-8784-085cbde5b46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:49.055235 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7c2cf-239b-47ce-8784-085cbde5b46e admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:49.077361 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1013/2028] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:49.079185 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b7bb9-998a-46e6-adac-68d00d0785ac admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:49.093581 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b7bb9-998a-46e6-adac-68d00d0785ac admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:49.100947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1f13b-bd15-419f-838e-ca5d5449107c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:49.105597 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1f13b-bd15-419f-838e-ca5d5449107c admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:49.106104 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1f13b-bd15-419f-838e-ca5d5449107c admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:49.107272 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1f13b-bd15-419f-838e-ca5d5449107c admin admin] PATH_INFO: `/v3/projects/e3348ae2e1f44e6a96b197c9984cbe13/users/2e5babe25f6f4101ae24cd35e4447fda/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:49.132522 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba1f13b-bd15-419f-838e-ca5d5449107c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3348ae2e1f44e6a96b197c9984cbe13, user_id=2e5babe25f6f4101ae24cd35e4447fda, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:49.135073 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba1f13b-bd15-419f-838e-ca5d5449107c admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:49.224672 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1016/2029] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:49 2022] PUT /identity/v3/projects/e3348ae2e1f44e6a96b197c9984cbe13/users/2e5babe25f6f4101ae24cd35e4447fda/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:49.233413 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69879198-5939-461c-abcc-db5b144f5be6 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:49.233710 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69879198-5939-461c-abcc-db5b144f5be6 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:49.234015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69879198-5939-461c-abcc-db5b144f5be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:49.272057 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-69879198-5939-461c-abcc-db5b144f5be6 None None] MFA Rules not processed for user `2e5babe25f6f4101ae24cd35e4447fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:49.273304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-69879198-5939-461c-abcc-db5b144f5be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:49.387642 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1014/2030] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:49.388232 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1f13b-bd15-419f-838e-ca5d5449107c admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:49.490182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1f13b-bd15-419f-838e-ca5d5449107c admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:49.495485 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25043a-a8ae-4be5-a09d-686c93f2455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:49.496475 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25043a-a8ae-4be5-a09d-686c93f2455b admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:49.496797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25043a-a8ae-4be5-a09d-686c93f2455b admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:49.497111 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25043a-a8ae-4be5-a09d-686c93f2455b admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:49.497910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25043a-a8ae-4be5-a09d-686c93f2455b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:49.500284 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25043a-a8ae-4be5-a09d-686c93f2455b admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:49.638110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1017/2031] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:22:49 2022] POST /identity/v3/projects => generated 385 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:49.643870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69879198-5939-461c-abcc-db5b144f5be6 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:49.664616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69879198-5939-461c-abcc-db5b144f5be6 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:49.809606 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01e8da-752c-498e-a310-1fe75ef68a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:49.811271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01e8da-752c-498e-a310-1fe75ef68a7d admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:49.812895 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01e8da-752c-498e-a310-1fe75ef68a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:49.814345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01e8da-752c-498e-a310-1fe75ef68a7d admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:49.815172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01e8da-752c-498e-a310-1fe75ef68a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:49.819968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01e8da-752c-498e-a310-1fe75ef68a7d admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:49.920626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1015/2032] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:22:49 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:49.927864 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25043a-a8ae-4be5-a09d-686c93f2455b admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:49.955243 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25043a-a8ae-4be5-a09d-686c93f2455b admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:49.970082 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac71966-d82d-4527-8e47-919cc99a41be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:49.974014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac71966-d82d-4527-8e47-919cc99a41be admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:49.975983 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac71966-d82d-4527-8e47-919cc99a41be admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:49.976461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac71966-d82d-4527-8e47-919cc99a41be admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:49.977407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac71966-d82d-4527-8e47-919cc99a41be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:49.984843 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac71966-d82d-4527-8e47-919cc99a41be admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:50.020137 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1018/2033] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:50.020454 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01e8da-752c-498e-a310-1fe75ef68a7d admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:50.036025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01e8da-752c-498e-a310-1fe75ef68a7d admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:50.043168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbba274-0017-47b1-9f8b-4f85594c321d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:50.048506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbba274-0017-47b1-9f8b-4f85594c321d admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:50.048506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbba274-0017-47b1-9f8b-4f85594c321d admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:50.048506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbba274-0017-47b1-9f8b-4f85594c321d admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:50.048506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbba274-0017-47b1-9f8b-4f85594c321d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:50.048506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbba274-0017-47b1-9f8b-4f85594c321d admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:50.063541 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1016/2034] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:50.068098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac71966-d82d-4527-8e47-919cc99a41be admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:50.080239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac71966-d82d-4527-8e47-919cc99a41be admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:50.085900 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a581d53-ef5a-44d1-b5ea-cb7ee0ccdd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:50.086823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a581d53-ef5a-44d1-b5ea-cb7ee0ccdd02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:50.087106 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a581d53-ef5a-44d1-b5ea-cb7ee0ccdd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:50.087416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a581d53-ef5a-44d1-b5ea-cb7ee0ccdd02 admin admin] PATH_INFO: `/v3/projects/4660068bc0fc4347ba52f2e3ce11d0b1/users/77aefd3492824eedb81a0c978890ed20/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:50.107534 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a581d53-ef5a-44d1-b5ea-cb7ee0ccdd02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4660068bc0fc4347ba52f2e3ce11d0b1, user_id=77aefd3492824eedb81a0c978890ed20, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:50.110294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a581d53-ef5a-44d1-b5ea-cb7ee0ccdd02 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:50.207506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1019/2035] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:50 2022] PUT /identity/v3/projects/4660068bc0fc4347ba52f2e3ce11d0b1/users/77aefd3492824eedb81a0c978890ed20/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:50.219795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b53af-472d-4270-82ae-11742518c777 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:50.220038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b53af-472d-4270-82ae-11742518c777 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:50.220321 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b53af-472d-4270-82ae-11742518c777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:50.258788 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-9c9b53af-472d-4270-82ae-11742518c777 None None] MFA Rules not processed for user `77aefd3492824eedb81a0c978890ed20`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:50.261109 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-9c9b53af-472d-4270-82ae-11742518c777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:50.286234 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:50.412624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1017/2036] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:50.417684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a581d53-ef5a-44d1-b5ea-cb7ee0ccdd02 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:50.528395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:50.565119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a581d53-ef5a-44d1-b5ea-cb7ee0ccdd02 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:50.584859 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb9738-e1e6-40f0-9fe8-593dd4813fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:50.585592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb9738-e1e6-40f0-9fe8-593dd4813fca admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:50.585885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb9738-e1e6-40f0-9fe8-593dd4813fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:50.586223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb9738-e1e6-40f0-9fe8-593dd4813fca admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:50.586966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb9738-e1e6-40f0-9fe8-593dd4813fca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:50.590135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb9738-e1e6-40f0-9fe8-593dd4813fca admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:50.713099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1020/2037] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:22:50 2022] POST /identity/v3/projects => generated 385 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:50.717249 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b53af-472d-4270-82ae-11742518c777 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:50.731719 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b53af-472d-4270-82ae-11742518c777 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:50.842329 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732016c-73a1-43cb-8517-96497d3b9608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:50.843205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732016c-73a1-43cb-8517-96497d3b9608 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:50.843653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732016c-73a1-43cb-8517-96497d3b9608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:50.844060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732016c-73a1-43cb-8517-96497d3b9608 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:50.844825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732016c-73a1-43cb-8517-96497d3b9608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:50.846813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732016c-73a1-43cb-8517-96497d3b9608 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:50.943517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1018/2038] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:22:50 2022] POST /identity/v3/users => generated 299 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:22:50.947937 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb9738-e1e6-40f0-9fe8-593dd4813fca admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:50.971765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb9738-e1e6-40f0-9fe8-593dd4813fca admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:50.978390 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746332e2-310a-4dbc-9f49-209334cb9647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:50.979378 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746332e2-310a-4dbc-9f49-209334cb9647 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:50.979934 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746332e2-310a-4dbc-9f49-209334cb9647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:50.980641 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746332e2-310a-4dbc-9f49-209334cb9647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:50.981965 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746332e2-310a-4dbc-9f49-209334cb9647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:50.984428 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746332e2-310a-4dbc-9f49-209334cb9647 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:51.007340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1021/2039] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:51.012028 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732016c-73a1-43cb-8517-96497d3b9608 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:51.032299 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732016c-73a1-43cb-8517-96497d3b9608 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:51.044939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ef82c-4a48-4a0e-bdd8-b4196c351bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:51.046115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ef82c-4a48-4a0e-bdd8-b4196c351bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:51.046499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ef82c-4a48-4a0e-bdd8-b4196c351bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:51.046917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ef82c-4a48-4a0e-bdd8-b4196c351bd7 admin admin] PATH_INFO: `/v3/projects/23bd2f29bce246b7979077cf80e0477b/users/88c306811c9942519114548a85d56a8f/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:51.067553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ef82c-4a48-4a0e-bdd8-b4196c351bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23bd2f29bce246b7979077cf80e0477b, user_id=88c306811c9942519114548a85d56a8f, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:51.070846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ef82c-4a48-4a0e-bdd8-b4196c351bd7 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:51.168981 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1019/2040] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:51 2022] PUT /identity/v3/projects/23bd2f29bce246b7979077cf80e0477b/users/88c306811c9942519114548a85d56a8f/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:51.170385 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746332e2-310a-4dbc-9f49-209334cb9647 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:51.199621 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746332e2-310a-4dbc-9f49-209334cb9647 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:51.308367 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84036192-2c87-4f10-9c8c-a646ed72444b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:51.308367 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84036192-2c87-4f10-9c8c-a646ed72444b admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:51.308367 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84036192-2c87-4f10-9c8c-a646ed72444b admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:51.308367 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84036192-2c87-4f10-9c8c-a646ed72444b admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:51.308860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84036192-2c87-4f10-9c8c-a646ed72444b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:51.308860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84036192-2c87-4f10-9c8c-a646ed72444b admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:51.327636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1022/2041] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:51.329043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ef82c-4a48-4a0e-bdd8-b4196c351bd7 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:51.341023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ef82c-4a48-4a0e-bdd8-b4196c351bd7 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:51.349558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100013b-9d55-4d74-9f97-bf856f0d1f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:51.351936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100013b-9d55-4d74-9f97-bf856f0d1f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:51.352335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100013b-9d55-4d74-9f97-bf856f0d1f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:51.353219 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100013b-9d55-4d74-9f97-bf856f0d1f32 admin admin] PATH_INFO: `/v3/projects/23bd2f29bce246b7979077cf80e0477b/users/88c306811c9942519114548a85d56a8f/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:51.355458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100013b-9d55-4d74-9f97-bf856f0d1f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23bd2f29bce246b7979077cf80e0477b, user_id=88c306811c9942519114548a85d56a8f, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:51.358377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100013b-9d55-4d74-9f97-bf856f0d1f32 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:51.371912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1020/2042] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:51 2022] PUT /identity/v3/projects/23bd2f29bce246b7979077cf80e0477b/users/88c306811c9942519114548a85d56a8f/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:51.388928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa35c64-d2ec-44b9-9727-ff13f4ff69b1 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:51.388928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa35c64-d2ec-44b9-9727-ff13f4ff69b1 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:51.388928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa35c64-d2ec-44b9-9727-ff13f4ff69b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:51.426272 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-5aa35c64-d2ec-44b9-9727-ff13f4ff69b1 None None] MFA Rules not processed for user `88c306811c9942519114548a85d56a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:51.430095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-5aa35c64-d2ec-44b9-9727-ff13f4ff69b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:51.527548 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1023/2043] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:51.541478 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100013b-9d55-4d74-9f97-bf856f0d1f32 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:51.543354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-0100013b-9d55-4d74-9f97-bf856f0d1f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:51.632343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100013b-9d55-4d74-9f97-bf856f0d1f32 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:51.636257 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45be63-4f95-49ac-9d15-143408581d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:51.636986 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45be63-4f95-49ac-9d15-143408581d24 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:51.637435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45be63-4f95-49ac-9d15-143408581d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:51.637727 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45be63-4f95-49ac-9d15-143408581d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:51.676570 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:51.705456 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45be63-4f95-49ac-9d15-143408581d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:51.707549 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45be63-4f95-49ac-9d15-143408581d24 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:51.716920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1021/2044] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:52.237632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ef263-8eec-4f17-aa81-94da1f758988 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:52.238233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ef263-8eec-4f17-aa81-94da1f758988 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:52.238233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ef263-8eec-4f17-aa81-94da1f758988 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:52.239828 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1024/2045] 10.222.0.66 () {54 vars in 921 bytes} [Thu May 26 21:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:22:52.251330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4c283-1bbc-427d-9a0e-b51b9344ec6e None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:52.252488 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4c283-1bbc-427d-9a0e-b51b9344ec6e None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:52.252488 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4c283-1bbc-427d-9a0e-b51b9344ec6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:52.280132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-2cd4c283-1bbc-427d-9a0e-b51b9344ec6e None None] MFA Rules not processed for user `2d68ccb9b89843078c40b13f79a72dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:52.281820 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2cd4c283-1bbc-427d-9a0e-b51b9344ec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:52.420089 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1022/2046] 10.222.0.66 () {58 vars in 1018 bytes} [Thu May 26 21:22:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:52.430046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ef263-8eec-4f17-aa81-94da1f758988 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:52.432233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-a00ef263-8eec-4f17-aa81-94da1f758988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:52.477508 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4c283-1bbc-427d-9a0e-b51b9344ec6e None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:52.477508 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2cd4c283-1bbc-427d-9a0e-b51b9344ec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:52.485965 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ef263-8eec-4f17-aa81-94da1f758988 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:52.508870 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7401f-f791-4c08-96a2-666d11c9af70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:52.509538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7401f-f791-4c08-96a2-666d11c9af70 service placement] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:52.509813 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7401f-f791-4c08-96a2-666d11c9af70 service placement] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:52.513614 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7401f-f791-4c08-96a2-666d11c9af70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:52.527371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7401f-f791-4c08-96a2-666d11c9af70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:52.529734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7401f-f791-4c08-96a2-666d11c9af70 service placement] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:52.569415 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1025/2047] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:22:52.627342 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4c283-1bbc-427d-9a0e-b51b9344ec6e None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:52.634651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e2633-75f5-4662-b2f0-f6a677dd0ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:52.634818 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e2633-75f5-4662-b2f0-f6a677dd0ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:52.635057 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e2633-75f5-4662-b2f0-f6a677dd0ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:52.635342 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e2633-75f5-4662-b2f0-f6a677dd0ee8 admin admin] PATH_INFO: `/v3/users/ce2de523c23948c8b9b652c9263b9240` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:52.636632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e2633-75f5-4662-b2f0-f6a677dd0ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce2de523c23948c8b9b652c9263b9240)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:52.638694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e2633-75f5-4662-b2f0-f6a677dd0ee8 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:52.943743 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-226e2633-75f5-4662-b2f0-f6a677dd0ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce2de523c23948c8b9b652c9263b9240'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:52.944934 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-226e2633-75f5-4662-b2f0-f6a677dd0ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce2de523c23948c8b9b652c9263b9240'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:52.945763 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-226e2633-75f5-4662-b2f0-f6a677dd0ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce2de523c23948c8b9b652c9263b9240'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:52.962518 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-226e2633-75f5-4662-b2f0-f6a677dd0ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce2de523c23948c8b9b652c9263b9240'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:52.965365 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:52.972552 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-226e2633-75f5-4662-b2f0-f6a677dd0ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce2de523c23948c8b9b652c9263b9240'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:53.062822 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1023/2048] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:22:52 2022] DELETE /identity/v3/users/ce2de523c23948c8b9b652c9263b9240 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:53.408912 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7401f-f791-4c08-96a2-666d11c9af70 service placement] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:53.426228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7401f-f791-4c08-96a2-666d11c9af70 service placement] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:53.469982 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:53.514031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778b1eb-9232-468e-ab1c-128dca1ef335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:53.515151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778b1eb-9232-468e-ab1c-128dca1ef335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:53.515701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778b1eb-9232-468e-ab1c-128dca1ef335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:53.516126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778b1eb-9232-468e-ab1c-128dca1ef335 admin admin] PATH_INFO: `/v3/projects/90703a330f8940989ec1fa3b82fe4976` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:53.522167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778b1eb-9232-468e-ab1c-128dca1ef335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90703a330f8940989ec1fa3b82fe4976)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:53.526886 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778b1eb-9232-468e-ab1c-128dca1ef335 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:53.741721 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-c778b1eb-9232-468e-ab1c-128dca1ef335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90703a330f8940989ec1fa3b82fe4976', 'request_id': 'req-c778b1eb-9232-468e-ab1c-128dca1ef335'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:53.748607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-c778b1eb-9232-468e-ab1c-128dca1ef335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90703a330f8940989ec1fa3b82fe4976', 'request_id': 'req-c778b1eb-9232-468e-ab1c-128dca1ef335'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:53.875506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-c778b1eb-9232-468e-ab1c-128dca1ef335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90703a330f8940989ec1fa3b82fe4976', 'request_id': 'req-c778b1eb-9232-468e-ab1c-128dca1ef335'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:53.896242 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-c778b1eb-9232-468e-ab1c-128dca1ef335 admin admin] The token cache is being invalidate because project 90703a330f8940989ec1fa3b82fe4976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:22:53.896815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-c778b1eb-9232-468e-ab1c-128dca1ef335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:53.898263 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-c778b1eb-9232-468e-ab1c-128dca1ef335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:22:53.903796 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1026/2049] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:22:53 2022] DELETE /identity/v3/projects/90703a330f8940989ec1fa3b82fe4976 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:53.907024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b04232-f04c-4af8-998a-e7dc0a10647a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:53.907603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b04232-f04c-4af8-998a-e7dc0a10647a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:53.908288 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b04232-f04c-4af8-998a-e7dc0a10647a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:53.935503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-72b04232-f04c-4af8-998a-e7dc0a10647a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:53.936790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-72b04232-f04c-4af8-998a-e7dc0a10647a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:54.035841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1024/2050] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:54.044755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a69fbc-50b3-43b2-a6f2-1d4e16a4ade2 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:54.048879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a69fbc-50b3-43b2-a6f2-1d4e16a4ade2 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:54.049329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a69fbc-50b3-43b2-a6f2-1d4e16a4ade2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:54.070321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-d4a69fbc-50b3-43b2-a6f2-1d4e16a4ade2 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:54.071612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d4a69fbc-50b3-43b2-a6f2-1d4e16a4ade2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:54.094982 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b04232-f04c-4af8-998a-e7dc0a10647a None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:54.095712 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1027/2051] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:54.107068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b04232-f04c-4af8-998a-e7dc0a10647a None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:54.113507 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23410153-57cd-4d6d-87ac-e9ad93b8dfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:54.114479 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23410153-57cd-4d6d-87ac-e9ad93b8dfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:54.118616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23410153-57cd-4d6d-87ac-e9ad93b8dfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:54.119086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23410153-57cd-4d6d-87ac-e9ad93b8dfa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:54.120244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23410153-57cd-4d6d-87ac-e9ad93b8dfa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:22:54.120764 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23410153-57cd-4d6d-87ac-e9ad93b8dfa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:54.122780 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23410153-57cd-4d6d-87ac-e9ad93b8dfa4 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:54.139482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1025/2052] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:22:54.144078 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a69fbc-50b3-43b2-a6f2-1d4e16a4ade2 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:54.159621 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a69fbc-50b3-43b2-a6f2-1d4e16a4ade2 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:54.165966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc36a3-3447-4f28-952f-c331c6f811b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:54.177690 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc36a3-3447-4f28-952f-c331c6f811b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:54.177690 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc36a3-3447-4f28-952f-c331c6f811b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:54.177690 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc36a3-3447-4f28-952f-c331c6f811b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:54.177690 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc36a3-3447-4f28-952f-c331c6f811b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:54.177690 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc36a3-3447-4f28-952f-c331c6f811b1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:54.268116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1028/2053] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:22:54 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:22:54.271085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23410153-57cd-4d6d-87ac-e9ad93b8dfa4 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:54.290090 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23410153-57cd-4d6d-87ac-e9ad93b8dfa4 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:54.408978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b56d28-61fe-4a15-9e76-3547d092d8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:54.409924 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b56d28-61fe-4a15-9e76-3547d092d8e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:54.411345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b56d28-61fe-4a15-9e76-3547d092d8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:54.411639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b56d28-61fe-4a15-9e76-3547d092d8e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:54.412425 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b56d28-61fe-4a15-9e76-3547d092d8e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:54.414654 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b56d28-61fe-4a15-9e76-3547d092d8e8 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:54.507753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1026/2054] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:22:54 2022] POST /identity/v3/users => generated 292 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:22:54.511940 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc36a3-3447-4f28-952f-c331c6f811b1 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:54.523359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc36a3-3447-4f28-952f-c331c6f811b1 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:54.532891 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54396144-01c8-4f4e-9f89-deb0725ce9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:54.533610 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54396144-01c8-4f4e-9f89-deb0725ce9cc admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:54.533920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54396144-01c8-4f4e-9f89-deb0725ce9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:54.534183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54396144-01c8-4f4e-9f89-deb0725ce9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:54.534946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54396144-01c8-4f4e-9f89-deb0725ce9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:54.537403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54396144-01c8-4f4e-9f89-deb0725ce9cc admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:54.553799 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1029/2055] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:54.559493 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b56d28-61fe-4a15-9e76-3547d092d8e8 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:54.571278 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b56d28-61fe-4a15-9e76-3547d092d8e8 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:54.576360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4716a62-b180-4bb9-84c0-7cd7a1963c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:54.577122 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4716a62-b180-4bb9-84c0-7cd7a1963c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:54.577431 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4716a62-b180-4bb9-84c0-7cd7a1963c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:54.577864 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4716a62-b180-4bb9-84c0-7cd7a1963c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:54.578493 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4716a62-b180-4bb9-84c0-7cd7a1963c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:54.584128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4716a62-b180-4bb9-84c0-7cd7a1963c4c admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:54.596738 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1027/2056] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:22:54.601218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54396144-01c8-4f4e-9f89-deb0725ce9cc admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:54.612198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54396144-01c8-4f4e-9f89-deb0725ce9cc admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:54.618528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123b89d-cca2-4377-b92a-e18a3934e1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:54.619897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123b89d-cca2-4377-b92a-e18a3934e1e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:54.620658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123b89d-cca2-4377-b92a-e18a3934e1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:54.621392 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123b89d-cca2-4377-b92a-e18a3934e1e5 admin admin] PATH_INFO: `/v3/projects/9ad28914703a493b9b86ffbf5061f362/users/90f99e434798434c93041c3c62fd153f/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:54.641043 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123b89d-cca2-4377-b92a-e18a3934e1e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad28914703a493b9b86ffbf5061f362, user_id=90f99e434798434c93041c3c62fd153f, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:54.645349 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123b89d-cca2-4377-b92a-e18a3934e1e5 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:54.726636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1030/2057] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:22:54 2022] PUT /identity/v3/projects/9ad28914703a493b9b86ffbf5061f362/users/90f99e434798434c93041c3c62fd153f/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:22:54.739168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d3af3-f140-4211-9e26-1970c65cda82 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:54.739168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d3af3-f140-4211-9e26-1970c65cda82 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:54.739466 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d3af3-f140-4211-9e26-1970c65cda82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:54.790738 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-ae1d3af3-f140-4211-9e26-1970c65cda82 None None] MFA Rules not processed for user `90f99e434798434c93041c3c62fd153f`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:54.791964 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ae1d3af3-f140-4211-9e26-1970c65cda82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:54.885027 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:54.947383 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1028/2058] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:54.955200 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123b89d-cca2-4377-b92a-e18a3934e1e5 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:54.957852 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3123b89d-cca2-4377-b92a-e18a3934e1e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:55.101635 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:55.166965 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123b89d-cca2-4377-b92a-e18a3934e1e5 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:55.175023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c3915-3031-4a97-9e23-356919cfd185 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:55.176795 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c3915-3031-4a97-9e23-356919cfd185 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:55.190958 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c3915-3031-4a97-9e23-356919cfd185 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:55.190958 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c3915-3031-4a97-9e23-356919cfd185 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:55.209675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c3915-3031-4a97-9e23-356919cfd185 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:55.209675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c3915-3031-4a97-9e23-356919cfd185 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:55.209987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce74b4-091a-4950-898c-016df28ca12d None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:55.209987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce74b4-091a-4950-898c-016df28ca12d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:55.209987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce74b4-091a-4950-898c-016df28ca12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:55.211156 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1031/2059] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:55.270921 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-20ce74b4-091a-4950-898c-016df28ca12d None None] MFA Rules not processed for user `ca36e7e448704171ab6253d15fe80dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:22:55.272122 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c3915-3031-4a97-9e23-356919cfd185 service nova] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:55.272239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-20ce74b4-091a-4950-898c-016df28ca12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:55.274172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-797c3915-3031-4a97-9e23-356919cfd185 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:55.385385 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c3915-3031-4a97-9e23-356919cfd185 service nova] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:55.391209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d9ab5-6dcb-4fb2-806b-c7c9fc0e830a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:55.391883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d9ab5-6dcb-4fb2-806b-c7c9fc0e830a service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:55.392167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d9ab5-6dcb-4fb2-806b-c7c9fc0e830a service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:55.392443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d9ab5-6dcb-4fb2-806b-c7c9fc0e830a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:55.397275 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-5c6d9ab5-6dcb-4fb2-806b-c7c9fc0e830a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:55.403070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1029/2060] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:22:55.403780 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce74b4-091a-4950-898c-016df28ca12d None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:55.405553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-20ce74b4-091a-4950-898c-016df28ca12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:55.426651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce74b4-091a-4950-898c-016df28ca12d None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:55.434497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19305ff2-0d51-40f4-a518-64dd7aa2adf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:55.435449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19305ff2-0d51-40f4-a518-64dd7aa2adf3 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:55.435849 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19305ff2-0d51-40f4-a518-64dd7aa2adf3 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:55.436211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19305ff2-0d51-40f4-a518-64dd7aa2adf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:55.445338 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-19305ff2-0d51-40f4-a518-64dd7aa2adf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:55.480410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d9ab5-6dcb-4fb2-806b-c7c9fc0e830a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:55.483377 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d9ab5-6dcb-4fb2-806b-c7c9fc0e830a service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:55.494786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1032/2061] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:22:55.513183 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19305ff2-0d51-40f4-a518-64dd7aa2adf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:55.515719 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19305ff2-0d51-40f4-a518-64dd7aa2adf3 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:55.526787 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1030/2062] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:57.389632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d9ab5-6dcb-4fb2-806b-c7c9fc0e830a service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:57.391832 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-5c6d9ab5-6dcb-4fb2-806b-c7c9fc0e830a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:57.404960 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d9ab5-6dcb-4fb2-806b-c7c9fc0e830a service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:57.409442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9008a65-fa86-4d99-a840-c116c926aba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:57.410890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9008a65-fa86-4d99-a840-c116c926aba9 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:57.411495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9008a65-fa86-4d99-a840-c116c926aba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:57.411770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9008a65-fa86-4d99-a840-c116c926aba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:57.413969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f9008a65-fa86-4d99-a840-c116c926aba9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:57.493449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9008a65-fa86-4d99-a840-c116c926aba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:57.495039 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9008a65-fa86-4d99-a840-c116c926aba9 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:57.508536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1033/2063] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:22:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:23:05.521919 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=71 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:07.502920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=88 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:10.731333 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19305ff2-0d51-40f4-a518-64dd7aa2adf3 service nova] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:10.795675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19305ff2-0d51-40f4-a518-64dd7aa2adf3 service nova] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:10.800562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20548f44-3fbe-47cb-bd4c-8fd5a25eb62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:10.801523 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20548f44-3fbe-47cb-bd4c-8fd5a25eb62e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:10.801804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20548f44-3fbe-47cb-bd4c-8fd5a25eb62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:10.802111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20548f44-3fbe-47cb-bd4c-8fd5a25eb62e admin admin] PATH_INFO: `/v3/users/90f99e434798434c93041c3c62fd153f` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:10.803323 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20548f44-3fbe-47cb-bd4c-8fd5a25eb62e admin admin] RBAC: Authorizing `identity:delete_user(user_id=90f99e434798434c93041c3c62fd153f)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:10.805309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20548f44-3fbe-47cb-bd4c-8fd5a25eb62e admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:11.017813 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9008a65-fa86-4d99-a840-c116c926aba9 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:11.020712 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f9008a65-fa86-4d99-a840-c116c926aba9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:11.034319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-20548f44-3fbe-47cb-bd4c-8fd5a25eb62e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90f99e434798434c93041c3c62fd153f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:11.035789 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-20548f44-3fbe-47cb-bd4c-8fd5a25eb62e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90f99e434798434c93041c3c62fd153f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:11.036564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-20548f44-3fbe-47cb-bd4c-8fd5a25eb62e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90f99e434798434c93041c3c62fd153f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:11.037219 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9008a65-fa86-4d99-a840-c116c926aba9 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:11.042034 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf1936-e212-4a9f-b340-8503b7be6ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:11.042914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf1936-e212-4a9f-b340-8503b7be6ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:11.043198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf1936-e212-4a9f-b340-8503b7be6ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:11.043478 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf1936-e212-4a9f-b340-8503b7be6ff6 admin admin] PATH_INFO: `/v3/users/2e5babe25f6f4101ae24cd35e4447fda` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:11.044823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf1936-e212-4a9f-b340-8503b7be6ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e5babe25f6f4101ae24cd35e4447fda)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:11.046772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf1936-e212-4a9f-b340-8503b7be6ff6 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:11.055421 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-20548f44-3fbe-47cb-bd4c-8fd5a25eb62e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90f99e434798434c93041c3c62fd153f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:11.070659 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-20548f44-3fbe-47cb-bd4c-8fd5a25eb62e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90f99e434798434c93041c3c62fd153f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:11.189617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1031/2064] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:23:10 2022] DELETE /identity/v3/users/90f99e434798434c93041c3c62fd153f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:23:11.194929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bab634-c56a-4353-a571-cfb0652dc970 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:11.195221 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bab634-c56a-4353-a571-cfb0652dc970 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:11.195501 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bab634-c56a-4353-a571-cfb0652dc970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:11.216491 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-87bab634-c56a-4353-a571-cfb0652dc970 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:11.217782 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-87bab634-c56a-4353-a571-cfb0652dc970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:11.289086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1032/2065] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:23:11.298879 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bab634-c56a-4353-a571-cfb0652dc970 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:11.301487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-87bab634-c56a-4353-a571-cfb0652dc970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:11.307723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-6baf1936-e212-4a9f-b340-8503b7be6ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e5babe25f6f4101ae24cd35e4447fda'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:11.324492 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:11.361610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bab634-c56a-4353-a571-cfb0652dc970 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:11.365442 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208940a-5bd3-4287-b6fe-e4666dcaa121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:11.366095 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208940a-5bd3-4287-b6fe-e4666dcaa121 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:11.366377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208940a-5bd3-4287-b6fe-e4666dcaa121 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:11.366653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208940a-5bd3-4287-b6fe-e4666dcaa121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:11.376639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208940a-5bd3-4287-b6fe-e4666dcaa121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:11.378149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208940a-5bd3-4287-b6fe-e4666dcaa121 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:11.383213 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-6baf1936-e212-4a9f-b340-8503b7be6ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e5babe25f6f4101ae24cd35e4447fda'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:11.383876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-6baf1936-e212-4a9f-b340-8503b7be6ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e5babe25f6f4101ae24cd35e4447fda'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:11.390159 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1033/2066] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:23:11.399297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-6baf1936-e212-4a9f-b340-8503b7be6ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e5babe25f6f4101ae24cd35e4447fda'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:11.402951 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-6baf1936-e212-4a9f-b340-8503b7be6ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e5babe25f6f4101ae24cd35e4447fda'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:11.418274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1034/2067] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:23:11 2022] DELETE /identity/v3/users/2e5babe25f6f4101ae24cd35e4447fda => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:23:11.422998 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d7ab6-a082-483a-a100-2db8d8098bc4 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:11.423639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d7ab6-a082-483a-a100-2db8d8098bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:11.424092 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d7ab6-a082-483a-a100-2db8d8098bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:11.450581 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-d94d7ab6-a082-483a-a100-2db8d8098bc4 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:11.450581 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d94d7ab6-a082-483a-a100-2db8d8098bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:11.522231 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1034/2068] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:23:11.534232 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf1936-e212-4a9f-b340-8503b7be6ff6 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:11.535739 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6baf1936-e212-4a9f-b340-8503b7be6ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:11.607989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf1936-e212-4a9f-b340-8503b7be6ff6 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:11.611826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b5a84-b93e-4bef-b2e5-7bf5b26c784d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:11.612475 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b5a84-b93e-4bef-b2e5-7bf5b26c784d service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:11.612799 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b5a84-b93e-4bef-b2e5-7bf5b26c784d service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:11.613612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b5a84-b93e-4bef-b2e5-7bf5b26c784d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:11.623485 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b5a84-b93e-4bef-b2e5-7bf5b26c784d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:11.624980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b5a84-b93e-4bef-b2e5-7bf5b26c784d service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:11.636467 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1035/2069] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:23:12.033638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d7ab6-a082-483a-a100-2db8d8098bc4 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:12.035319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d94d7ab6-a082-483a-a100-2db8d8098bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:12.050517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d7ab6-a082-483a-a100-2db8d8098bc4 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:12.060958 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7199d-8079-4e80-b2bc-45e7cfd1147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:12.062392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7199d-8079-4e80-b2bc-45e7cfd1147a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:12.062877 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7199d-8079-4e80-b2bc-45e7cfd1147a admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:12.063324 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7199d-8079-4e80-b2bc-45e7cfd1147a admin admin] PATH_INFO: `/v3/projects/9ad28914703a493b9b86ffbf5061f362` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:12.064868 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7199d-8079-4e80-b2bc-45e7cfd1147a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad28914703a493b9b86ffbf5061f362)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:12.067638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7199d-8079-4e80-b2bc-45e7cfd1147a admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:12.225399 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-54b7199d-8079-4e80-b2bc-45e7cfd1147a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad28914703a493b9b86ffbf5061f362', 'request_id': 'req-54b7199d-8079-4e80-b2bc-45e7cfd1147a'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:12.260407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b5a84-b93e-4bef-b2e5-7bf5b26c784d service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:12.262040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f84b5a84-b93e-4bef-b2e5-7bf5b26c784d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:12.282627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b5a84-b93e-4bef-b2e5-7bf5b26c784d service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:12.309558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-54b7199d-8079-4e80-b2bc-45e7cfd1147a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad28914703a493b9b86ffbf5061f362', 'request_id': 'req-54b7199d-8079-4e80-b2bc-45e7cfd1147a'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:12.319104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-54b7199d-8079-4e80-b2bc-45e7cfd1147a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad28914703a493b9b86ffbf5061f362', 'request_id': 'req-54b7199d-8079-4e80-b2bc-45e7cfd1147a'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:12.332082 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-54b7199d-8079-4e80-b2bc-45e7cfd1147a admin admin] The token cache is being invalidate because project 9ad28914703a493b9b86ffbf5061f362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:23:12.332372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-54b7199d-8079-4e80-b2bc-45e7cfd1147a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:12.333072 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-54b7199d-8079-4e80-b2bc-45e7cfd1147a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:12.334626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1035/2070] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:23:12 2022] DELETE /identity/v3/projects/9ad28914703a493b9b86ffbf5061f362 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:23:12.339513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc35b06-b241-4076-bc8e-ac9d295821af None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:12.339800 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc35b06-b241-4076-bc8e-ac9d295821af None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:12.340082 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc35b06-b241-4076-bc8e-ac9d295821af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:12.354401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28896f-2ae3-412e-b7e9-75941e4a90a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:12.355294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28896f-2ae3-412e-b7e9-75941e4a90a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:12.355609 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28896f-2ae3-412e-b7e9-75941e4a90a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:12.355891 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28896f-2ae3-412e-b7e9-75941e4a90a3 admin admin] PATH_INFO: `/v3/projects/e3348ae2e1f44e6a96b197c9984cbe13` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:12.357142 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28896f-2ae3-412e-b7e9-75941e4a90a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3348ae2e1f44e6a96b197c9984cbe13)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:12.359065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28896f-2ae3-412e-b7e9-75941e4a90a3 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:12.373873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-5dc35b06-b241-4076-bc8e-ac9d295821af None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:12.375101 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-5dc35b06-b241-4076-bc8e-ac9d295821af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:12.381672 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:12.383955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1036/2071] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:23:12.393664 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633abd0e-cb0e-4be6-8e03-037ea1e80713 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:12.393946 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633abd0e-cb0e-4be6-8e03-037ea1e80713 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:12.394217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633abd0e-cb0e-4be6-8e03-037ea1e80713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:12.414777 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-633abd0e-cb0e-4be6-8e03-037ea1e80713 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:12.415969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-633abd0e-cb0e-4be6-8e03-037ea1e80713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:12.424448 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1037/2072] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:23:12.429487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633abd0e-cb0e-4be6-8e03-037ea1e80713 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:12.439852 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633abd0e-cb0e-4be6-8e03-037ea1e80713 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:12.445584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792488ec-e7d8-432a-8de9-cc9851dae718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:12.446260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792488ec-e7d8-432a-8de9-cc9851dae718 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:12.446623 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792488ec-e7d8-432a-8de9-cc9851dae718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:12.446910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792488ec-e7d8-432a-8de9-cc9851dae718 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:12.447668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792488ec-e7d8-432a-8de9-cc9851dae718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:23:12.448019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792488ec-e7d8-432a-8de9-cc9851dae718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:12.449679 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792488ec-e7d8-432a-8de9-cc9851dae718 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:12.463859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1038/2073] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:23:12.468158 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792488ec-e7d8-432a-8de9-cc9851dae718 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:12.477545 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ac28896f-2ae3-412e-b7e9-75941e4a90a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3348ae2e1f44e6a96b197c9984cbe13', 'request_id': 'req-ac28896f-2ae3-412e-b7e9-75941e4a90a3'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:12.483457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792488ec-e7d8-432a-8de9-cc9851dae718 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:12.485013 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ac28896f-2ae3-412e-b7e9-75941e4a90a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3348ae2e1f44e6a96b197c9984cbe13', 'request_id': 'req-ac28896f-2ae3-412e-b7e9-75941e4a90a3'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:12.492111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:12.542550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f314a0-5bea-42ae-8f3b-cb679493f5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:12.543168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f314a0-5bea-42ae-8f3b-cb679493f5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:12.543451 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f314a0-5bea-42ae-8f3b-cb679493f5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:12.543726 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f314a0-5bea-42ae-8f3b-cb679493f5b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:12.544424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f314a0-5bea-42ae-8f3b-cb679493f5b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:12.546382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f314a0-5bea-42ae-8f3b-cb679493f5b3 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:12.561487 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ac28896f-2ae3-412e-b7e9-75941e4a90a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3348ae2e1f44e6a96b197c9984cbe13', 'request_id': 'req-ac28896f-2ae3-412e-b7e9-75941e4a90a3'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:12.574419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ac28896f-2ae3-412e-b7e9-75941e4a90a3 admin admin] The token cache is being invalidate because project e3348ae2e1f44e6a96b197c9984cbe13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:23:12.574705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ac28896f-2ae3-412e-b7e9-75941e4a90a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:12.575375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ac28896f-2ae3-412e-b7e9-75941e4a90a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:12.579326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1036/2074] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:23:12 2022] DELETE /identity/v3/projects/e3348ae2e1f44e6a96b197c9984cbe13 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:23:12.581533 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28896f-2ae3-412e-b7e9-75941e4a90a3 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:12.583590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ac28896f-2ae3-412e-b7e9-75941e4a90a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:12.596622 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28896f-2ae3-412e-b7e9-75941e4a90a3 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:12.602012 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca34fb-90c3-43ed-8ace-74a224f5e1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:12.602908 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca34fb-90c3-43ed-8ace-74a224f5e1ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:12.603185 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca34fb-90c3-43ed-8ace-74a224f5e1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:12.603459 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca34fb-90c3-43ed-8ace-74a224f5e1ce admin admin] PATH_INFO: `/v3/users/77aefd3492824eedb81a0c978890ed20` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:12.604832 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca34fb-90c3-43ed-8ace-74a224f5e1ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=77aefd3492824eedb81a0c978890ed20)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:12.606798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca34fb-90c3-43ed-8ace-74a224f5e1ce admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:12.642776 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1039/2075] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:23:12 2022] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:23:12.648126 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f314a0-5bea-42ae-8f3b-cb679493f5b3 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:12.650730 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f5f314a0-5bea-42ae-8f3b-cb679493f5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:12.725486 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f314a0-5bea-42ae-8f3b-cb679493f5b3 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:12.730685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f6ba1-7f36-4b2b-9c9a-aa609bc08e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:12.731613 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f6ba1-7f36-4b2b-9c9a-aa609bc08e37 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:12.731899 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f6ba1-7f36-4b2b-9c9a-aa609bc08e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:12.732177 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f6ba1-7f36-4b2b-9c9a-aa609bc08e37 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:12.733076 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f6ba1-7f36-4b2b-9c9a-aa609bc08e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:12.735012 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f6ba1-7f36-4b2b-9c9a-aa609bc08e37 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:12.788730 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-58ca34fb-90c3-43ed-8ace-74a224f5e1ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77aefd3492824eedb81a0c978890ed20'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:12.869625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1040/2076] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:23:12 2022] POST /identity/v3/users => generated 283 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:23:12.873864 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f6ba1-7f36-4b2b-9c9a-aa609bc08e37 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:12.874709 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-58ca34fb-90c3-43ed-8ace-74a224f5e1ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77aefd3492824eedb81a0c978890ed20'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:12.875376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-58ca34fb-90c3-43ed-8ace-74a224f5e1ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77aefd3492824eedb81a0c978890ed20'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:12.889049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f6ba1-7f36-4b2b-9c9a-aa609bc08e37 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:12.890250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-58ca34fb-90c3-43ed-8ace-74a224f5e1ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77aefd3492824eedb81a0c978890ed20'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:12.891083 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-58ca34fb-90c3-43ed-8ace-74a224f5e1ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77aefd3492824eedb81a0c978890ed20'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:12.894085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73407b3c-81e7-48ff-9e0e-003c8a79c27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:12.895335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73407b3c-81e7-48ff-9e0e-003c8a79c27e admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:12.895614 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73407b3c-81e7-48ff-9e0e-003c8a79c27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:12.895885 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73407b3c-81e7-48ff-9e0e-003c8a79c27e admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:12.896647 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73407b3c-81e7-48ff-9e0e-003c8a79c27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:12.898258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73407b3c-81e7-48ff-9e0e-003c8a79c27e admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:12.905272 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1037/2077] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:23:12 2022] DELETE /identity/v3/users/77aefd3492824eedb81a0c978890ed20 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:23:12.909486 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1041/2078] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:23:12.913418 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca34fb-90c3-43ed-8ace-74a224f5e1ce admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:12.914923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-58ca34fb-90c3-43ed-8ace-74a224f5e1ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:12.990105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca34fb-90c3-43ed-8ace-74a224f5e1ce admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:12.995294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da42d4a-cc80-43c5-a7f2-96b34b70c18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:12.996066 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da42d4a-cc80-43c5-a7f2-96b34b70c18e admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:12.996425 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da42d4a-cc80-43c5-a7f2-96b34b70c18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:12.996870 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da42d4a-cc80-43c5-a7f2-96b34b70c18e admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:12.998032 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da42d4a-cc80-43c5-a7f2-96b34b70c18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:13.000115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da42d4a-cc80-43c5-a7f2-96b34b70c18e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:13.013935 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1038/2079] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:23:13.020151 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73407b3c-81e7-48ff-9e0e-003c8a79c27e admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:13.038506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73407b3c-81e7-48ff-9e0e-003c8a79c27e admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:13.046525 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08f90f-49ee-4920-be0a-f0bc83f62b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:13.049513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08f90f-49ee-4920-be0a-f0bc83f62b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:13.049513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08f90f-49ee-4920-be0a-f0bc83f62b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:13.049513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08f90f-49ee-4920-be0a-f0bc83f62b66 admin admin] PATH_INFO: `/v3/projects/37bf7611c27d41c291bfeef263418035/users/b7ee77c5e44e4830b4ddfd55f51301ae/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:13.074047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08f90f-49ee-4920-be0a-f0bc83f62b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37bf7611c27d41c291bfeef263418035, user_id=b7ee77c5e44e4830b4ddfd55f51301ae, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:13.079449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08f90f-49ee-4920-be0a-f0bc83f62b66 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:13.201991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1042/2080] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:23:13 2022] PUT /identity/v3/projects/37bf7611c27d41c291bfeef263418035/users/b7ee77c5e44e4830b4ddfd55f51301ae/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:23:13.212909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8375e-c53a-4e76-935f-2a7a0521cf61 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:13.213939 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8375e-c53a-4e76-935f-2a7a0521cf61 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:13.214368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8375e-c53a-4e76-935f-2a7a0521cf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:13.241258 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:13.245013 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-aac8375e-c53a-4e76-935f-2a7a0521cf61 None None] MFA Rules not processed for user `b7ee77c5e44e4830b4ddfd55f51301ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:13.246266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-aac8375e-c53a-4e76-935f-2a7a0521cf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:13.315220 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1039/2081] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:23:13.326899 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08f90f-49ee-4920-be0a-f0bc83f62b66 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:13.328632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ce08f90f-49ee-4920-be0a-f0bc83f62b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:13.385363 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8375e-c53a-4e76-935f-2a7a0521cf61 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:13.386631 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-aac8375e-c53a-4e76-935f-2a7a0521cf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:13.397068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08f90f-49ee-4920-be0a-f0bc83f62b66 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:13.401507 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471f92b-18b7-4450-9bc9-dcd9ffaea54f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:13.402106 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471f92b-18b7-4450-9bc9-dcd9ffaea54f service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:13.402393 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471f92b-18b7-4450-9bc9-dcd9ffaea54f service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:13.402666 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471f92b-18b7-4450-9bc9-dcd9ffaea54f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:13.408827 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:13.413491 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471f92b-18b7-4450-9bc9-dcd9ffaea54f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:13.415063 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471f92b-18b7-4450-9bc9-dcd9ffaea54f service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:13.426628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1043/2082] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:23:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:23:13.468826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8375e-c53a-4e76-935f-2a7a0521cf61 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:13.475288 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48a552-1aff-46d9-932d-6d7983c7e8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:13.476172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48a552-1aff-46d9-932d-6d7983c7e8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:13.476459 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48a552-1aff-46d9-932d-6d7983c7e8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:13.476786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48a552-1aff-46d9-932d-6d7983c7e8e6 admin admin] PATH_INFO: `/v3/projects/4660068bc0fc4347ba52f2e3ce11d0b1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:13.478020 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48a552-1aff-46d9-932d-6d7983c7e8e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4660068bc0fc4347ba52f2e3ce11d0b1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:13.479980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48a552-1aff-46d9-932d-6d7983c7e8e6 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:13.617846 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-9a48a552-1aff-46d9-932d-6d7983c7e8e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4660068bc0fc4347ba52f2e3ce11d0b1', 'request_id': 'req-9a48a552-1aff-46d9-932d-6d7983c7e8e6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:13.623439 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-9a48a552-1aff-46d9-932d-6d7983c7e8e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4660068bc0fc4347ba52f2e3ce11d0b1', 'request_id': 'req-9a48a552-1aff-46d9-932d-6d7983c7e8e6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:13.703699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-9a48a552-1aff-46d9-932d-6d7983c7e8e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4660068bc0fc4347ba52f2e3ce11d0b1', 'request_id': 'req-9a48a552-1aff-46d9-932d-6d7983c7e8e6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:13.715906 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-9a48a552-1aff-46d9-932d-6d7983c7e8e6 admin admin] The token cache is being invalidate because project 4660068bc0fc4347ba52f2e3ce11d0b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:23:13.724634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-9a48a552-1aff-46d9-932d-6d7983c7e8e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:13.724634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-9a48a552-1aff-46d9-932d-6d7983c7e8e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:13.724634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1040/2083] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:23:13 2022] DELETE /identity/v3/projects/4660068bc0fc4347ba52f2e3ce11d0b1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:23:13.724959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471f92b-18b7-4450-9bc9-dcd9ffaea54f service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:13.734520 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471f92b-18b7-4450-9bc9-dcd9ffaea54f service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:13.799897 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153f59c-4e6d-414e-a7d8-e2d76bdc7cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:13.800808 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153f59c-4e6d-414e-a7d8-e2d76bdc7cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:13.801091 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153f59c-4e6d-414e-a7d8-e2d76bdc7cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:13.801368 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153f59c-4e6d-414e-a7d8-e2d76bdc7cd8 admin admin] PATH_INFO: `/v3/users/88c306811c9942519114548a85d56a8f` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:13.802740 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153f59c-4e6d-414e-a7d8-e2d76bdc7cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c306811c9942519114548a85d56a8f)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:13.804845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153f59c-4e6d-414e-a7d8-e2d76bdc7cd8 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:14.040644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-8153f59c-4e6d-414e-a7d8-e2d76bdc7cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c306811c9942519114548a85d56a8f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:14.041737 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-8153f59c-4e6d-414e-a7d8-e2d76bdc7cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c306811c9942519114548a85d56a8f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:14.042441 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-8153f59c-4e6d-414e-a7d8-e2d76bdc7cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c306811c9942519114548a85d56a8f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:14.055477 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-8153f59c-4e6d-414e-a7d8-e2d76bdc7cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c306811c9942519114548a85d56a8f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:14.062832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-8153f59c-4e6d-414e-a7d8-e2d76bdc7cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c306811c9942519114548a85d56a8f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:14.199430 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1044/2084] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:23:13 2022] DELETE /identity/v3/users/88c306811c9942519114548a85d56a8f => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:23:14.770038 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48a552-1aff-46d9-932d-6d7983c7e8e6 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:14.771476 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-9a48a552-1aff-46d9-932d-6d7983c7e8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:14.785675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48a552-1aff-46d9-932d-6d7983c7e8e6 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:14.824083 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:14.851720 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa13b8-d85b-4414-a193-0c95cf4f2e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:14.852716 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa13b8-d85b-4414-a193-0c95cf4f2e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:14.853009 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa13b8-d85b-4414-a193-0c95cf4f2e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:14.853289 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa13b8-d85b-4414-a193-0c95cf4f2e75 admin admin] PATH_INFO: `/v3/projects/23bd2f29bce246b7979077cf80e0477b` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:14.854605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa13b8-d85b-4414-a193-0c95cf4f2e75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23bd2f29bce246b7979077cf80e0477b)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:14.856544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa13b8-d85b-4414-a193-0c95cf4f2e75 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:15.009053 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-c5aa13b8-d85b-4414-a193-0c95cf4f2e75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23bd2f29bce246b7979077cf80e0477b', 'request_id': 'req-c5aa13b8-d85b-4414-a193-0c95cf4f2e75'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:15.017696 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-c5aa13b8-d85b-4414-a193-0c95cf4f2e75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23bd2f29bce246b7979077cf80e0477b', 'request_id': 'req-c5aa13b8-d85b-4414-a193-0c95cf4f2e75'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:15.166329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-c5aa13b8-d85b-4414-a193-0c95cf4f2e75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23bd2f29bce246b7979077cf80e0477b', 'request_id': 'req-c5aa13b8-d85b-4414-a193-0c95cf4f2e75'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:15.181207 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-c5aa13b8-d85b-4414-a193-0c95cf4f2e75 admin admin] The token cache is being invalidate because project 23bd2f29bce246b7979077cf80e0477b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:23:15.181502 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-c5aa13b8-d85b-4414-a193-0c95cf4f2e75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:15.182210 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-c5aa13b8-d85b-4414-a193-0c95cf4f2e75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:15.183741 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1041/2085] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:23:14 2022] DELETE /identity/v3/projects/23bd2f29bce246b7979077cf80e0477b => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:23:15.188594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc584c-a6bf-4922-93a1-271ce829b693 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:15.189081 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc584c-a6bf-4922-93a1-271ce829b693 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:15.189180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc584c-a6bf-4922-93a1-271ce829b693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:15.217304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-3ddc584c-a6bf-4922-93a1-271ce829b693 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:15.217304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3ddc584c-a6bf-4922-93a1-271ce829b693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:15.282291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1045/2086] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:23:15.290943 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725191e-d05e-44cc-9b12-e83a47fc4fb4 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:15.291228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725191e-d05e-44cc-9b12-e83a47fc4fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:15.291506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725191e-d05e-44cc-9b12-e83a47fc4fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:15.310177 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-c725191e-d05e-44cc-9b12-e83a47fc4fb4 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:15.311414 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-c725191e-d05e-44cc-9b12-e83a47fc4fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:15.319559 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1042/2087] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:23:15.324148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc584c-a6bf-4922-93a1-271ce829b693 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:15.334962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc584c-a6bf-4922-93a1-271ce829b693 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:15.339757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae00a5c-50bd-4613-9709-a4088a1b7ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:15.340428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae00a5c-50bd-4613-9709-a4088a1b7ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:15.340753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae00a5c-50bd-4613-9709-a4088a1b7ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:15.341068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae00a5c-50bd-4613-9709-a4088a1b7ac5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:15.341807 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae00a5c-50bd-4613-9709-a4088a1b7ac5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:23:15.342119 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae00a5c-50bd-4613-9709-a4088a1b7ac5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:15.343768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae00a5c-50bd-4613-9709-a4088a1b7ac5 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:15.353992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:15.357315 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1046/2088] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:23:15.361709 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725191e-d05e-44cc-9b12-e83a47fc4fb4 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:15.371353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725191e-d05e-44cc-9b12-e83a47fc4fb4 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:15.376340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e08683-c952-45c7-8901-04c861720fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:15.377087 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e08683-c952-45c7-8901-04c861720fdb admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:15.377535 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e08683-c952-45c7-8901-04c861720fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:15.377828 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e08683-c952-45c7-8901-04c861720fdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:15.378977 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e08683-c952-45c7-8901-04c861720fdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:15.380896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e08683-c952-45c7-8901-04c861720fdb admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:15.510891 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1043/2089] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:23:15 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:23:15.515156 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae00a5c-50bd-4613-9709-a4088a1b7ac5 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:15.525817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae00a5c-50bd-4613-9709-a4088a1b7ac5 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:15.584033 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae4c66-0bd0-40cf-9e2a-3d50bbe6ddda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:15.584756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae4c66-0bd0-40cf-9e2a-3d50bbe6ddda admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:15.585099 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae4c66-0bd0-40cf-9e2a-3d50bbe6ddda admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:15.585325 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae4c66-0bd0-40cf-9e2a-3d50bbe6ddda admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:15.586033 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae4c66-0bd0-40cf-9e2a-3d50bbe6ddda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:15.588054 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae4c66-0bd0-40cf-9e2a-3d50bbe6ddda admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:15.715385 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1047/2090] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:23:15 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:23:15.720768 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e08683-c952-45c7-8901-04c861720fdb admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:15.731129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e08683-c952-45c7-8901-04c861720fdb admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:15.737903 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec176485-5ab3-4076-85e2-2290a9952603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:15.738722 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec176485-5ab3-4076-85e2-2290a9952603 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:15.739016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec176485-5ab3-4076-85e2-2290a9952603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:15.739308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec176485-5ab3-4076-85e2-2290a9952603 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:15.740129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec176485-5ab3-4076-85e2-2290a9952603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:15.741770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec176485-5ab3-4076-85e2-2290a9952603 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:15.752644 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1044/2091] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:23:15.757127 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae4c66-0bd0-40cf-9e2a-3d50bbe6ddda admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:15.767932 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae4c66-0bd0-40cf-9e2a-3d50bbe6ddda admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:15.774337 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcbcdc-c6f8-441b-8781-44c776eb59ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:15.775048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcbcdc-c6f8-441b-8781-44c776eb59ae admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:15.775363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcbcdc-c6f8-441b-8781-44c776eb59ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:15.775648 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcbcdc-c6f8-441b-8781-44c776eb59ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:15.776515 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcbcdc-c6f8-441b-8781-44c776eb59ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:15.778146 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcbcdc-c6f8-441b-8781-44c776eb59ae admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:15.792759 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1048/2092] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:23:15.794017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec176485-5ab3-4076-85e2-2290a9952603 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:15.804190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec176485-5ab3-4076-85e2-2290a9952603 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:15.808961 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d50ecd-6ce7-45bc-ae92-5c9d597d85e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:15.809859 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d50ecd-6ce7-45bc-ae92-5c9d597d85e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:15.810140 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d50ecd-6ce7-45bc-ae92-5c9d597d85e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:15.810412 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d50ecd-6ce7-45bc-ae92-5c9d597d85e4 admin admin] PATH_INFO: `/v3/projects/8c5f36ef25b441e4a4e019765530f370/users/596dd83622cd4fddbccbb70a98a970bc/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:15.827527 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d50ecd-6ce7-45bc-ae92-5c9d597d85e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5f36ef25b441e4a4e019765530f370, user_id=596dd83622cd4fddbccbb70a98a970bc, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:15.830246 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d50ecd-6ce7-45bc-ae92-5c9d597d85e4 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:15.921209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1045/2093] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:23:15 2022] PUT /identity/v3/projects/8c5f36ef25b441e4a4e019765530f370/users/596dd83622cd4fddbccbb70a98a970bc/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:23:15.926867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03c86b-d805-4085-9315-d9f60efdefb6 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:15.927160 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03c86b-d805-4085-9315-d9f60efdefb6 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:15.927474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03c86b-d805-4085-9315-d9f60efdefb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:15.948047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-fe03c86b-d805-4085-9315-d9f60efdefb6 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:15.949476 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-fe03c86b-d805-4085-9315-d9f60efdefb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:16.020403 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1049/2094] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:23:16.030392 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d50ecd-6ce7-45bc-ae92-5c9d597d85e4 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:16.032105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f2d50ecd-6ce7-45bc-ae92-5c9d597d85e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:16.091097 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d50ecd-6ce7-45bc-ae92-5c9d597d85e4 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:16.095066 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09ca00-4518-4af4-9ae5-2cc61e9946fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:16.095739 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09ca00-4518-4af4-9ae5-2cc61e9946fd service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:16.096023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09ca00-4518-4af4-9ae5-2cc61e9946fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:16.096302 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09ca00-4518-4af4-9ae5-2cc61e9946fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:16.107660 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09ca00-4518-4af4-9ae5-2cc61e9946fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:16.109135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09ca00-4518-4af4-9ae5-2cc61e9946fd service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:16.119018 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1046/2095] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:23:17.608067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace1e9e-207c-4933-abaa-1fd0875a0045 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:17.608547 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace1e9e-207c-4933-abaa-1fd0875a0045 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:17.609228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace1e9e-207c-4933-abaa-1fd0875a0045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:17.637186 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-8ace1e9e-207c-4933-abaa-1fd0875a0045 None None] MFA Rules not processed for user `596dd83622cd4fddbccbb70a98a970bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:17.638420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-8ace1e9e-207c-4933-abaa-1fd0875a0045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:17.709773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1050/2096] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:23:17.720946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09ca00-4518-4af4-9ae5-2cc61e9946fd service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:17.722341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0a09ca00-4518-4af4-9ae5-2cc61e9946fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:17.728312 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:17.779986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09ca00-4518-4af4-9ae5-2cc61e9946fd service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:17.783656 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6048785-10ec-46d6-9dc1-4d47d6315efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:17.784335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6048785-10ec-46d6-9dc1-4d47d6315efd service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:17.784651 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6048785-10ec-46d6-9dc1-4d47d6315efd service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:17.784951 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6048785-10ec-46d6-9dc1-4d47d6315efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:17.794361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6048785-10ec-46d6-9dc1-4d47d6315efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:17.795874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6048785-10ec-46d6-9dc1-4d47d6315efd service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:17.805318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1047/2097] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:23:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:23:27.706178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:27.827835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=25 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:27.987500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca4ada-d030-4562-a7d6-27c7a1787523 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:27.987786 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca4ada-d030-4562-a7d6-27c7a1787523 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:27.988070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca4ada-d030-4562-a7d6-27c7a1787523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:28.006596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-ccca4ada-d030-4562-a7d6-27c7a1787523 None None] MFA Rules not processed for user `596dd83622cd4fddbccbb70a98a970bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:28.007846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ccca4ada-d030-4562-a7d6-27c7a1787523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:28.015590 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1051/2098] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:23:38.000575 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:41.353393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6048785-10ec-46d6-9dc1-4d47d6315efd service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:41.355078 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f6048785-10ec-46d6-9dc1-4d47d6315efd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:41.369820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6048785-10ec-46d6-9dc1-4d47d6315efd service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:41.374468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f715798-92b2-4654-a1e8-bb2134620643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:41.375371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f715798-92b2-4654-a1e8-bb2134620643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:41.375649 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f715798-92b2-4654-a1e8-bb2134620643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:41.375993 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f715798-92b2-4654-a1e8-bb2134620643 admin admin] PATH_INFO: `/v3/users/b7ee77c5e44e4830b4ddfd55f51301ae` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:41.377307 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f715798-92b2-4654-a1e8-bb2134620643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ee77c5e44e4830b4ddfd55f51301ae)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:41.379259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f715798-92b2-4654-a1e8-bb2134620643 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:41.523787 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-1f715798-92b2-4654-a1e8-bb2134620643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ee77c5e44e4830b4ddfd55f51301ae'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:41.583410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-1f715798-92b2-4654-a1e8-bb2134620643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ee77c5e44e4830b4ddfd55f51301ae'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:41.584469 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-1f715798-92b2-4654-a1e8-bb2134620643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ee77c5e44e4830b4ddfd55f51301ae'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:41.597446 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-1f715798-92b2-4654-a1e8-bb2134620643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ee77c5e44e4830b4ddfd55f51301ae'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:41.606867 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-1f715798-92b2-4654-a1e8-bb2134620643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ee77c5e44e4830b4ddfd55f51301ae'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:41.610956 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1048/2099] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:23:41 2022] DELETE /identity/v3/users/b7ee77c5e44e4830b4ddfd55f51301ae => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:23:41.615992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161a3ac-9aef-48ed-b835-8e1b86a2bf3a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:41.616487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161a3ac-9aef-48ed-b835-8e1b86a2bf3a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:41.616603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161a3ac-9aef-48ed-b835-8e1b86a2bf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:41.633497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-5161a3ac-9aef-48ed-b835-8e1b86a2bf3a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:41.634669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-5161a3ac-9aef-48ed-b835-8e1b86a2bf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:41.692746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1052/2100] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:23:41.702934 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f715798-92b2-4654-a1e8-bb2134620643 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:41.704318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1f715798-92b2-4654-a1e8-bb2134620643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:41.761858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f715798-92b2-4654-a1e8-bb2134620643 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:41.765777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb1dac-94f6-4861-895f-d3cd8b9d6457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:41.767692 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb1dac-94f6-4861-895f-d3cd8b9d6457 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:41.767692 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb1dac-94f6-4861-895f-d3cd8b9d6457 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:41.767692 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb1dac-94f6-4861-895f-d3cd8b9d6457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:41.777285 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb1dac-94f6-4861-895f-d3cd8b9d6457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:41.778729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb1dac-94f6-4861-895f-d3cd8b9d6457 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:41.790227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1049/2101] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:23:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:23:42.206900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161a3ac-9aef-48ed-b835-8e1b86a2bf3a None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:42.208412 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-5161a3ac-9aef-48ed-b835-8e1b86a2bf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:42.221420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161a3ac-9aef-48ed-b835-8e1b86a2bf3a None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:42.227084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0882f-5431-4c58-98bb-c2e96fa6db8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:42.228097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0882f-5431-4c58-98bb-c2e96fa6db8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:42.228384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0882f-5431-4c58-98bb-c2e96fa6db8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:42.228700 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0882f-5431-4c58-98bb-c2e96fa6db8b admin admin] PATH_INFO: `/v3/projects/37bf7611c27d41c291bfeef263418035` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:42.229935 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0882f-5431-4c58-98bb-c2e96fa6db8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=37bf7611c27d41c291bfeef263418035)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:42.231883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0882f-5431-4c58-98bb-c2e96fa6db8b admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:42.380138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-4db0882f-5431-4c58-98bb-c2e96fa6db8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37bf7611c27d41c291bfeef263418035', 'request_id': 'req-4db0882f-5431-4c58-98bb-c2e96fa6db8b'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:42.451017 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-4db0882f-5431-4c58-98bb-c2e96fa6db8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37bf7611c27d41c291bfeef263418035', 'request_id': 'req-4db0882f-5431-4c58-98bb-c2e96fa6db8b'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:42.457935 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-4db0882f-5431-4c58-98bb-c2e96fa6db8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37bf7611c27d41c291bfeef263418035', 'request_id': 'req-4db0882f-5431-4c58-98bb-c2e96fa6db8b'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:42.468891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-4db0882f-5431-4c58-98bb-c2e96fa6db8b admin admin] The token cache is being invalidate because project 37bf7611c27d41c291bfeef263418035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:23:42.469180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-4db0882f-5431-4c58-98bb-c2e96fa6db8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:42.469864 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-4db0882f-5431-4c58-98bb-c2e96fa6db8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:42.471403 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1053/2102] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:23:42 2022] DELETE /identity/v3/projects/37bf7611c27d41c291bfeef263418035 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:23:42.476516 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1cc79-a614-4ebf-9068-7167cf48797e None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:42.477131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1cc79-a614-4ebf-9068-7167cf48797e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:42.477131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1cc79-a614-4ebf-9068-7167cf48797e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:42.496955 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-1cb1cc79-a614-4ebf-9068-7167cf48797e None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:42.498168 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1cb1cc79-a614-4ebf-9068-7167cf48797e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:42.563539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1050/2103] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:23:42.566797 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27a0a2-c796-4cb2-a8af-547ad35dac2b None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:42.567085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27a0a2-c796-4cb2-a8af-547ad35dac2b None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:42.567363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27a0a2-c796-4cb2-a8af-547ad35dac2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:42.586431 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-ed27a0a2-c796-4cb2-a8af-547ad35dac2b None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:42.587401 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ed27a0a2-c796-4cb2-a8af-547ad35dac2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:42.595675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1054/2104] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:23:42.600337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1cc79-a614-4ebf-9068-7167cf48797e None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:42.610020 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1cc79-a614-4ebf-9068-7167cf48797e None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:42.614701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0df937-996f-418f-943e-18c8eb19a8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:42.616184 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0df937-996f-418f-943e-18c8eb19a8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:42.616464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0df937-996f-418f-943e-18c8eb19a8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:42.616771 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0df937-996f-418f-943e-18c8eb19a8aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:42.617510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0df937-996f-418f-943e-18c8eb19a8aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:23:42.617816 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0df937-996f-418f-943e-18c8eb19a8aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:42.619416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0df937-996f-418f-943e-18c8eb19a8aa admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:42.632395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1051/2105] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:23:42.636416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27a0a2-c796-4cb2-a8af-547ad35dac2b None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:42.645629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27a0a2-c796-4cb2-a8af-547ad35dac2b None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:42.655156 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce44158-92b2-49f2-95fa-471327d92444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:42.655831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce44158-92b2-49f2-95fa-471327d92444 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:42.656111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce44158-92b2-49f2-95fa-471327d92444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:42.656384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce44158-92b2-49f2-95fa-471327d92444 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:42.657174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce44158-92b2-49f2-95fa-471327d92444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:42.659057 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce44158-92b2-49f2-95fa-471327d92444 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:42.751091 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1055/2106] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:23:42 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:23:42.755240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0df937-996f-418f-943e-18c8eb19a8aa admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:42.761237 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:42.766684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0df937-996f-418f-943e-18c8eb19a8aa admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:42.823012 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6657a8-3cb9-409d-822e-22dd4760a571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:42.823684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6657a8-3cb9-409d-822e-22dd4760a571 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:42.823970 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6657a8-3cb9-409d-822e-22dd4760a571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:42.824250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6657a8-3cb9-409d-822e-22dd4760a571 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:42.824968 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6657a8-3cb9-409d-822e-22dd4760a571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:42.826912 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6657a8-3cb9-409d-822e-22dd4760a571 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:42.950523 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1052/2107] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:23:42 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:23:42.954809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce44158-92b2-49f2-95fa-471327d92444 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:42.965427 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce44158-92b2-49f2-95fa-471327d92444 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:42.970160 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea14762-f32c-417e-86c1-4aaab609d3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:42.970826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea14762-f32c-417e-86c1-4aaab609d3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:42.971110 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea14762-f32c-417e-86c1-4aaab609d3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:42.971393 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea14762-f32c-417e-86c1-4aaab609d3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:42.972224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea14762-f32c-417e-86c1-4aaab609d3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:42.973938 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea14762-f32c-417e-86c1-4aaab609d3e3 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:42.984529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1056/2108] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:23:42.988569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6657a8-3cb9-409d-822e-22dd4760a571 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:42.999615 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6657a8-3cb9-409d-822e-22dd4760a571 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:43.004438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c7393-da54-4b13-a162-d7335f6995b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:43.006101 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c7393-da54-4b13-a162-d7335f6995b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:43.006101 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c7393-da54-4b13-a162-d7335f6995b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:43.006293 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c7393-da54-4b13-a162-d7335f6995b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:43.007011 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c7393-da54-4b13-a162-d7335f6995b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:43.008780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c7393-da54-4b13-a162-d7335f6995b0 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:43.019980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1053/2109] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:23:43.024665 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea14762-f32c-417e-86c1-4aaab609d3e3 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:43.035299 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea14762-f32c-417e-86c1-4aaab609d3e3 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:43.041172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bcdbc-8524-4a2f-b00e-988df98a3508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:43.042240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bcdbc-8524-4a2f-b00e-988df98a3508 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:43.042699 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bcdbc-8524-4a2f-b00e-988df98a3508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:43.043208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bcdbc-8524-4a2f-b00e-988df98a3508 admin admin] PATH_INFO: `/v3/projects/e6a7b0d3b0a644879c202ec01e2a0e86/users/54508e21100543b6a36d57e6b7aa6a45/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:43.059920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704bcdbc-8524-4a2f-b00e-988df98a3508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a7b0d3b0a644879c202ec01e2a0e86, user_id=54508e21100543b6a36d57e6b7aa6a45, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:43.062651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704bcdbc-8524-4a2f-b00e-988df98a3508 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:43.162321 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1057/2110] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:23:43 2022] PUT /identity/v3/projects/e6a7b0d3b0a644879c202ec01e2a0e86/users/54508e21100543b6a36d57e6b7aa6a45/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:23:43.173829 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fdf07-9c94-4a16-a19b-fba5fb2df101 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:43.174406 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fdf07-9c94-4a16-a19b-fba5fb2df101 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:43.174685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fdf07-9c94-4a16-a19b-fba5fb2df101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:43.204074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-2e0fdf07-9c94-4a16-a19b-fba5fb2df101 None None] MFA Rules not processed for user `54508e21100543b6a36d57e6b7aa6a45`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:43.205453 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-2e0fdf07-9c94-4a16-a19b-fba5fb2df101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:43.277510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1054/2111] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:23:43.282262 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bcdbc-8524-4a2f-b00e-988df98a3508 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:43.304362 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:43.346106 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bcdbc-8524-4a2f-b00e-988df98a3508 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:43.350961 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f00eda-e2ac-47ee-8a3c-121cc1e44ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:43.351648 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f00eda-e2ac-47ee-8a3c-121cc1e44ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:43.351930 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f00eda-e2ac-47ee-8a3c-121cc1e44ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:43.352205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f00eda-e2ac-47ee-8a3c-121cc1e44ac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:43.352939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f00eda-e2ac-47ee-8a3c-121cc1e44ac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:43.354890 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f00eda-e2ac-47ee-8a3c-121cc1e44ac4 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:43.488271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1058/2112] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:23:43 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:23:43.492512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fdf07-9c94-4a16-a19b-fba5fb2df101 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:43.503203 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fdf07-9c94-4a16-a19b-fba5fb2df101 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:43.563426 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b7c80-3f1a-4e45-897b-95880508ac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:43.564142 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b7c80-3f1a-4e45-897b-95880508ac72 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:43.564430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b7c80-3f1a-4e45-897b-95880508ac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:43.564757 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b7c80-3f1a-4e45-897b-95880508ac72 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:43.565452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b7c80-3f1a-4e45-897b-95880508ac72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:43.567374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b7c80-3f1a-4e45-897b-95880508ac72 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:43.699773 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:43.705003 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1055/2113] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:23:43 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:23:43.709005 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f00eda-e2ac-47ee-8a3c-121cc1e44ac4 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:43.719709 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f00eda-e2ac-47ee-8a3c-121cc1e44ac4 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:43.724322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68a67b-b469-4eed-8840-3065b6f28ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:43.725019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68a67b-b469-4eed-8840-3065b6f28ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:43.725300 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68a67b-b469-4eed-8840-3065b6f28ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:43.725573 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68a67b-b469-4eed-8840-3065b6f28ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:43.726344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68a67b-b469-4eed-8840-3065b6f28ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:43.727946 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68a67b-b469-4eed-8840-3065b6f28ed1 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:43.739040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1059/2114] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:23:43.743738 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b7c80-3f1a-4e45-897b-95880508ac72 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:43.754088 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b7c80-3f1a-4e45-897b-95880508ac72 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:43.759726 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a7cfc-912e-489a-9e7b-4672058cd0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:43.760692 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a7cfc-912e-489a-9e7b-4672058cd0e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:43.761014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a7cfc-912e-489a-9e7b-4672058cd0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:43.761291 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a7cfc-912e-489a-9e7b-4672058cd0e6 admin admin] PATH_INFO: `/v3/projects/f02a3bce86964431aa70533b32373af3/users/5d73d21058674364ade7ee1498fb58ef/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:43.776416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a7cfc-912e-489a-9e7b-4672058cd0e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02a3bce86964431aa70533b32373af3, user_id=5d73d21058674364ade7ee1498fb58ef, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:43.779064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a7cfc-912e-489a-9e7b-4672058cd0e6 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:43.852452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1056/2115] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:23:43 2022] PUT /identity/v3/projects/f02a3bce86964431aa70533b32373af3/users/5d73d21058674364ade7ee1498fb58ef/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:23:43.856463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68a67b-b469-4eed-8840-3065b6f28ed1 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:43.867015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68a67b-b469-4eed-8840-3065b6f28ed1 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:43.928651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad1b11-8029-45ad-b549-8b650eed90fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:43.929337 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad1b11-8029-45ad-b549-8b650eed90fc admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:43.929625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad1b11-8029-45ad-b549-8b650eed90fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:43.929927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad1b11-8029-45ad-b549-8b650eed90fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:43.930685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad1b11-8029-45ad-b549-8b650eed90fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:43.932287 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad1b11-8029-45ad-b549-8b650eed90fc admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:43.942599 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1060/2116] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:23:43.947477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a7cfc-912e-489a-9e7b-4672058cd0e6 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:43.958216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a7cfc-912e-489a-9e7b-4672058cd0e6 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:43.963775 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295128e8-911c-4804-a342-dede1ede956d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:43.964690 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295128e8-911c-4804-a342-dede1ede956d admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:43.964971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295128e8-911c-4804-a342-dede1ede956d admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:43.965245 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295128e8-911c-4804-a342-dede1ede956d admin admin] PATH_INFO: `/v3/projects/f02a3bce86964431aa70533b32373af3/users/5d73d21058674364ade7ee1498fb58ef/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:43.967215 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295128e8-911c-4804-a342-dede1ede956d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02a3bce86964431aa70533b32373af3, user_id=5d73d21058674364ade7ee1498fb58ef, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:43.969876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295128e8-911c-4804-a342-dede1ede956d admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:43.982206 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1057/2117] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:23:43 2022] PUT /identity/v3/projects/f02a3bce86964431aa70533b32373af3/users/5d73d21058674364ade7ee1498fb58ef/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:23:43.994176 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c380c-2b59-4f33-b68c-2718dbd50499 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:43.994457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c380c-2b59-4f33-b68c-2718dbd50499 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:43.994729 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c380c-2b59-4f33-b68c-2718dbd50499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:44.021046 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-e36c380c-2b59-4f33-b68c-2718dbd50499 None None] MFA Rules not processed for user `5d73d21058674364ade7ee1498fb58ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:44.022238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-e36c380c-2b59-4f33-b68c-2718dbd50499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:44.095840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1061/2118] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:23:44.108110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295128e8-911c-4804-a342-dede1ede956d admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:44.109889 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-295128e8-911c-4804-a342-dede1ede956d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:44.190877 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295128e8-911c-4804-a342-dede1ede956d admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:44.195415 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5705c-7022-4554-b39e-9fa748ffa0de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:44.196069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5705c-7022-4554-b39e-9fa748ffa0de service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:44.196358 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5705c-7022-4554-b39e-9fa748ffa0de service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:44.196661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5705c-7022-4554-b39e-9fa748ffa0de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:44.205802 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5705c-7022-4554-b39e-9fa748ffa0de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:44.207171 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5705c-7022-4554-b39e-9fa748ffa0de service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:44.217070 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1058/2119] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:23:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:23:44.437609 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c380c-2b59-4f33-b68c-2718dbd50499 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:44.449866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c380c-2b59-4f33-b68c-2718dbd50499 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:44.454293 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d9670-cf8c-4194-bf9e-e2bc46e2ae9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:44.455036 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d9670-cf8c-4194-bf9e-e2bc46e2ae9b service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:44.455290 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d9670-cf8c-4194-bf9e-e2bc46e2ae9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:44.455568 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d9670-cf8c-4194-bf9e-e2bc46e2ae9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:44.470119 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:44.515038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d9670-cf8c-4194-bf9e-e2bc46e2ae9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:44.516682 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d9670-cf8c-4194-bf9e-e2bc46e2ae9b service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:44.526003 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1062/2120] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:23:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:23:47.205291 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107b020-8d98-4b1b-a6c7-d1898b4053dc None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:47.205729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107b020-8d98-4b1b-a6c7-d1898b4053dc None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:47.206082 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107b020-8d98-4b1b-a6c7-d1898b4053dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:47.223783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-8107b020-8d98-4b1b-a6c7-d1898b4053dc None None] MFA Rules not processed for user `b3efa221fe5843cbb3671f4a3512f83b`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:47.225071 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8107b020-8d98-4b1b-a6c7-d1898b4053dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:47.284026 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1059/2121] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:23:47.683387 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d9670-cf8c-4194-bf9e-e2bc46e2ae9b service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:47.684906 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d79d9670-cf8c-4194-bf9e-e2bc46e2ae9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:47.775587 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d9670-cf8c-4194-bf9e-e2bc46e2ae9b service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:47.781099 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448de829-a8ab-4a23-8036-b0a2dc60d982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:47.781994 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448de829-a8ab-4a23-8036-b0a2dc60d982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:47.782277 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448de829-a8ab-4a23-8036-b0a2dc60d982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:47.782584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448de829-a8ab-4a23-8036-b0a2dc60d982 admin admin] PATH_INFO: `/v3/users/28298596614e408d9bfc0173c758be7f` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:47.783799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448de829-a8ab-4a23-8036-b0a2dc60d982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28298596614e408d9bfc0173c758be7f)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:47.785813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448de829-a8ab-4a23-8036-b0a2dc60d982 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:47.975939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-448de829-a8ab-4a23-8036-b0a2dc60d982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28298596614e408d9bfc0173c758be7f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:47.976839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-448de829-a8ab-4a23-8036-b0a2dc60d982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28298596614e408d9bfc0173c758be7f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:47.977462 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-448de829-a8ab-4a23-8036-b0a2dc60d982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28298596614e408d9bfc0173c758be7f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:47.996145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-448de829-a8ab-4a23-8036-b0a2dc60d982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28298596614e408d9bfc0173c758be7f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:48.003320 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-448de829-a8ab-4a23-8036-b0a2dc60d982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28298596614e408d9bfc0173c758be7f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:48.081132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1063/2122] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:23:47 2022] DELETE /identity/v3/users/28298596614e408d9bfc0173c758be7f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:23:48.086452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf760e-bf8e-4769-a23d-2e1f14bc847b None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:48.086774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf760e-bf8e-4769-a23d-2e1f14bc847b None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:48.087055 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf760e-bf8e-4769-a23d-2e1f14bc847b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:48.110540 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-fdaf760e-bf8e-4769-a23d-2e1f14bc847b None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:48.111748 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-fdaf760e-bf8e-4769-a23d-2e1f14bc847b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:48.160510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:48.175240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1060/2123] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:23:48.185040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448de829-a8ab-4a23-8036-b0a2dc60d982 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:48.186473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-448de829-a8ab-4a23-8036-b0a2dc60d982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:48.225188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:48.248194 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448de829-a8ab-4a23-8036-b0a2dc60d982 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:48.254398 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83951424-f686-4f0b-9537-748851b6396f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:48.256096 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83951424-f686-4f0b-9537-748851b6396f service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:48.256603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83951424-f686-4f0b-9537-748851b6396f service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:48.257098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83951424-f686-4f0b-9537-748851b6396f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:48.268831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83951424-f686-4f0b-9537-748851b6396f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:48.270265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83951424-f686-4f0b-9537-748851b6396f service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:48.282612 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1064/2124] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:23:48.677202 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf760e-bf8e-4769-a23d-2e1f14bc847b None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:48.682414 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-fdaf760e-bf8e-4769-a23d-2e1f14bc847b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:48.695511 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf760e-bf8e-4769-a23d-2e1f14bc847b None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:48.701821 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0cc42-c418-44c9-89c4-b577764b80bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:48.702665 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0cc42-c418-44c9-89c4-b577764b80bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:48.702886 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0cc42-c418-44c9-89c4-b577764b80bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:48.703246 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0cc42-c418-44c9-89c4-b577764b80bf admin admin] PATH_INFO: `/v3/projects/b60f240b38bb491ba35b87e2687ede89` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:48.704522 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0cc42-c418-44c9-89c4-b577764b80bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b60f240b38bb491ba35b87e2687ede89)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:48.706601 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0cc42-c418-44c9-89c4-b577764b80bf admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:48.841333 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ddb0cc42-c418-44c9-89c4-b577764b80bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b60f240b38bb491ba35b87e2687ede89', 'request_id': 'req-ddb0cc42-c418-44c9-89c4-b577764b80bf'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:48.853354 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ddb0cc42-c418-44c9-89c4-b577764b80bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b60f240b38bb491ba35b87e2687ede89', 'request_id': 'req-ddb0cc42-c418-44c9-89c4-b577764b80bf'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:48.933126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ddb0cc42-c418-44c9-89c4-b577764b80bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b60f240b38bb491ba35b87e2687ede89', 'request_id': 'req-ddb0cc42-c418-44c9-89c4-b577764b80bf'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:48.945768 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ddb0cc42-c418-44c9-89c4-b577764b80bf admin admin] The token cache is being invalidate because project b60f240b38bb491ba35b87e2687ede89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:23:48.946055 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ddb0cc42-c418-44c9-89c4-b577764b80bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:48.946689 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ddb0cc42-c418-44c9-89c4-b577764b80bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:23:48.948375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1061/2125] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:23:48 2022] DELETE /identity/v3/projects/b60f240b38bb491ba35b87e2687ede89 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:23:48.953210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701e083-e138-4e42-98aa-8175fd912966 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:48.953679 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701e083-e138-4e42-98aa-8175fd912966 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:48.953768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701e083-e138-4e42-98aa-8175fd912966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:48.972745 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-a701e083-e138-4e42-98aa-8175fd912966 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:48.974102 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a701e083-e138-4e42-98aa-8175fd912966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:49.034052 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1065/2126] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:23:49.042572 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670af038-fb10-4221-946b-01821cac9c58 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:49.042847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670af038-fb10-4221-946b-01821cac9c58 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:49.043127 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670af038-fb10-4221-946b-01821cac9c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:49.061823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-670af038-fb10-4221-946b-01821cac9c58 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:49.063027 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-670af038-fb10-4221-946b-01821cac9c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:49.075188 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1062/2127] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:23:49.079629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701e083-e138-4e42-98aa-8175fd912966 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:49.090361 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701e083-e138-4e42-98aa-8175fd912966 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:49.095069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc001509-d478-4772-86c8-a4da2785821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:49.095747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc001509-d478-4772-86c8-a4da2785821d admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:49.096035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc001509-d478-4772-86c8-a4da2785821d admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:49.096313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc001509-d478-4772-86c8-a4da2785821d admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:49.097086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc001509-d478-4772-86c8-a4da2785821d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:23:49.097399 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc001509-d478-4772-86c8-a4da2785821d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:49.099007 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc001509-d478-4772-86c8-a4da2785821d admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:49.116610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1066/2128] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:23:49.121088 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670af038-fb10-4221-946b-01821cac9c58 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:49.131092 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670af038-fb10-4221-946b-01821cac9c58 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:49.135784 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4adf9-662b-4247-811d-4f8817ca52ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:49.136468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4adf9-662b-4247-811d-4f8817ca52ae admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:49.136771 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4adf9-662b-4247-811d-4f8817ca52ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:49.137050 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4adf9-662b-4247-811d-4f8817ca52ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:49.137760 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4adf9-662b-4247-811d-4f8817ca52ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:49.139658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4adf9-662b-4247-811d-4f8817ca52ae admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:49.291822 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1063/2129] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:23:49 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:23:49.294576 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc001509-d478-4772-86c8-a4da2785821d admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:49.305003 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc001509-d478-4772-86c8-a4da2785821d admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:49.363131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b2418-c553-4033-8b96-ac02ca93b5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:49.363811 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b2418-c553-4033-8b96-ac02ca93b5ee admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:49.364096 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b2418-c553-4033-8b96-ac02ca93b5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:49.364372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b2418-c553-4033-8b96-ac02ca93b5ee admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:49.365159 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b2418-c553-4033-8b96-ac02ca93b5ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:49.367229 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b2418-c553-4033-8b96-ac02ca93b5ee admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:49.460109 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1067/2130] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:23:49 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:23:49.464244 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4adf9-662b-4247-811d-4f8817ca52ae admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:49.473404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4adf9-662b-4247-811d-4f8817ca52ae admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:49.479232 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b81ce6-8ab2-4de0-8910-976ac2b58008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:49.479911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b81ce6-8ab2-4de0-8910-976ac2b58008 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:49.480248 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b81ce6-8ab2-4de0-8910-976ac2b58008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:49.480619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b81ce6-8ab2-4de0-8910-976ac2b58008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:49.481353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b81ce6-8ab2-4de0-8910-976ac2b58008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:49.483093 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b81ce6-8ab2-4de0-8910-976ac2b58008 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:49.505965 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1064/2131] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:23:49.509945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b2418-c553-4033-8b96-ac02ca93b5ee admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:49.520241 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b2418-c553-4033-8b96-ac02ca93b5ee admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:49.525892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554df1b-4fa5-4429-9e0c-53c0849bfed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:49.526639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554df1b-4fa5-4429-9e0c-53c0849bfed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:49.530296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554df1b-4fa5-4429-9e0c-53c0849bfed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:49.530296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554df1b-4fa5-4429-9e0c-53c0849bfed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:49.530296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554df1b-4fa5-4429-9e0c-53c0849bfed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:49.530296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554df1b-4fa5-4429-9e0c-53c0849bfed3 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:49.540634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1068/2132] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:23:49.545086 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b81ce6-8ab2-4de0-8910-976ac2b58008 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:49.555447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b81ce6-8ab2-4de0-8910-976ac2b58008 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:49.560999 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e0ad1-388e-48f3-b7db-3398154e5924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:49.562111 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e0ad1-388e-48f3-b7db-3398154e5924 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:49.562681 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e0ad1-388e-48f3-b7db-3398154e5924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:49.563031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e0ad1-388e-48f3-b7db-3398154e5924 admin admin] PATH_INFO: `/v3/projects/31ea80663206487ca3ea28c5bb4239f0/users/f45b8987f3c24cf19de0fa81482c050a/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:49.580832 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e0ad1-388e-48f3-b7db-3398154e5924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31ea80663206487ca3ea28c5bb4239f0, user_id=f45b8987f3c24cf19de0fa81482c050a, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:49.584159 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e0ad1-388e-48f3-b7db-3398154e5924 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:49.652120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1065/2133] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:23:49 2022] PUT /identity/v3/projects/31ea80663206487ca3ea28c5bb4239f0/users/f45b8987f3c24cf19de0fa81482c050a/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:23:49.657567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20620869-335b-416d-8840-b6aa44f9d76d None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:49.657884 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20620869-335b-416d-8840-b6aa44f9d76d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:49.658165 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20620869-335b-416d-8840-b6aa44f9d76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:49.676469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-20620869-335b-416d-8840-b6aa44f9d76d None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:49.678289 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-20620869-335b-416d-8840-b6aa44f9d76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:49.717732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:49.737534 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1069/2134] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:23:49.748408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e0ad1-388e-48f3-b7db-3398154e5924 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:49.750387 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-a07e0ad1-388e-48f3-b7db-3398154e5924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:49.809258 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e0ad1-388e-48f3-b7db-3398154e5924 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:49.812965 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5ac09-ed41-4cc5-92b6-0aed8e089c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:49.813617 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5ac09-ed41-4cc5-92b6-0aed8e089c65 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:49.813899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5ac09-ed41-4cc5-92b6-0aed8e089c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:49.814179 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5ac09-ed41-4cc5-92b6-0aed8e089c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:49.824452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5ac09-ed41-4cc5-92b6-0aed8e089c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:49.825924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5ac09-ed41-4cc5-92b6-0aed8e089c65 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:49.835838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1066/2135] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:23:51.482084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed12f2-8355-4e39-8b01-2db92a65964a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:51.482633 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed12f2-8355-4e39-8b01-2db92a65964a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:51.482727 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed12f2-8355-4e39-8b01-2db92a65964a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:51.511793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-e0ed12f2-8355-4e39-8b01-2db92a65964a None None] MFA Rules not processed for user `f45b8987f3c24cf19de0fa81482c050a`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:51.513071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-e0ed12f2-8355-4e39-8b01-2db92a65964a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:51.591239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1070/2136] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:23:51.602455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5ac09-ed41-4cc5-92b6-0aed8e089c65 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:23:51.604627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-58b5ac09-ed41-4cc5-92b6-0aed8e089c65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:51.619228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:51.664732 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5ac09-ed41-4cc5-92b6-0aed8e089c65 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:23:51.668781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c09135-2edb-4501-9711-1ddeba79ce29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:23:51.669587 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c09135-2edb-4501-9711-1ddeba79ce29 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:51.669963 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c09135-2edb-4501-9711-1ddeba79ce29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:51.670367 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c09135-2edb-4501-9711-1ddeba79ce29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:51.681424 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c09135-2edb-4501-9711-1ddeba79ce29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:23:51.682871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c09135-2edb-4501-9711-1ddeba79ce29 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:23:51.692462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1067/2137] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:23:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:23:55.585309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a319108-7193-4e4e-a130-92fc5fd724aa None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:23:55.585777 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a319108-7193-4e4e-a130-92fc5fd724aa None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:23:55.586277 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a319108-7193-4e4e-a130-92fc5fd724aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:23:55.606847 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-8a319108-7193-4e4e-a130-92fc5fd724aa None None] MFA Rules not processed for user `f45b8987f3c24cf19de0fa81482c050a`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:23:55.608163 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-8a319108-7193-4e4e-a130-92fc5fd724aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:23:55.617464 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1071/2138] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:23:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:24:01.073480 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c09135-2edb-4501-9711-1ddeba79ce29 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:01.075205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-19c09135-2edb-4501-9711-1ddeba79ce29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:01.187695 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c09135-2edb-4501-9711-1ddeba79ce29 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:01.193088 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4c8fb-36f9-4d24-a916-2c422491d984 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:01.198812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4c8fb-36f9-4d24-a916-2c422491d984 service placement] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:01.198812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4c8fb-36f9-4d24-a916-2c422491d984 service placement] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:01.198812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4c8fb-36f9-4d24-a916-2c422491d984 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:01.198812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ced4c8fb-36f9-4d24-a916-2c422491d984 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:01.210539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4c8fb-36f9-4d24-a916-2c422491d984 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:01.212164 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4c8fb-36f9-4d24-a916-2c422491d984 service placement] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:01.224131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1068/2139] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:24:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:24:01.992401 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ddab5-8df9-49a0-b5a9-f6f0651f9c12 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:01.992904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ddab5-8df9-49a0-b5a9-f6f0651f9c12 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:01.993002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ddab5-8df9-49a0-b5a9-f6f0651f9c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:02.013230 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-463ddab5-8df9-49a0-b5a9-f6f0651f9c12 None None] MFA Rules not processed for user `596dd83622cd4fddbccbb70a98a970bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:24:02.014432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-463ddab5-8df9-49a0-b5a9-f6f0651f9c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:02.094603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1072/2140] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:24:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:24:11.218743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=61 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:12.085176 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=68 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:13.308170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16069de9-67b4-4060-9903-1a03eaa7ed91 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:13.308698 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16069de9-67b4-4060-9903-1a03eaa7ed91 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:13.308792 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16069de9-67b4-4060-9903-1a03eaa7ed91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:13.329736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-16069de9-67b4-4060-9903-1a03eaa7ed91 None None] MFA Rules not processed for user `23ed95370bfd46e3a1c6946701e66065`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:24:13.330935 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-16069de9-67b4-4060-9903-1a03eaa7ed91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:13.412881 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1069/2141] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:24:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:24:23.404858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=25 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:33.510089 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ddab5-8df9-49a0-b5a9-f6f0651f9c12 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:33.511602 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-463ddab5-8df9-49a0-b5a9-f6f0651f9c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:33.524525 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ddab5-8df9-49a0-b5a9-f6f0651f9c12 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:33.528191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4dd5c-68b2-4f83-91c3-29e87839f435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:33.528862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4dd5c-68b2-4f83-91c3-29e87839f435 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:33.529142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4dd5c-68b2-4f83-91c3-29e87839f435 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:33.529415 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4dd5c-68b2-4f83-91c3-29e87839f435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:33.531656 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-adf4dd5c-68b2-4f83-91c3-29e87839f435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:33.611087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4dd5c-68b2-4f83-91c3-29e87839f435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:33.612560 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4dd5c-68b2-4f83-91c3-29e87839f435 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:33.622275 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1073/2142] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:24:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:24:43.617855 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=30 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:47.792895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16069de9-67b4-4060-9903-1a03eaa7ed91 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:47.794333 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-16069de9-67b4-4060-9903-1a03eaa7ed91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:47.808361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16069de9-67b4-4060-9903-1a03eaa7ed91 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:47.812891 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b63133-245e-4259-a9e5-df2d86b197a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:47.813755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b63133-245e-4259-a9e5-df2d86b197a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:47.814041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b63133-245e-4259-a9e5-df2d86b197a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:47.814321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b63133-245e-4259-a9e5-df2d86b197a1 admin admin] PATH_INFO: `/v3/users/54508e21100543b6a36d57e6b7aa6a45` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:47.815512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b63133-245e-4259-a9e5-df2d86b197a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54508e21100543b6a36d57e6b7aa6a45)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:47.817500 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b63133-245e-4259-a9e5-df2d86b197a1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:47.950956 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-95b63133-245e-4259-a9e5-df2d86b197a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54508e21100543b6a36d57e6b7aa6a45'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:48.022829 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-95b63133-245e-4259-a9e5-df2d86b197a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54508e21100543b6a36d57e6b7aa6a45'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:48.023482 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-95b63133-245e-4259-a9e5-df2d86b197a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54508e21100543b6a36d57e6b7aa6a45'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:48.037269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-95b63133-245e-4259-a9e5-df2d86b197a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54508e21100543b6a36d57e6b7aa6a45'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:48.037984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-95b63133-245e-4259-a9e5-df2d86b197a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54508e21100543b6a36d57e6b7aa6a45'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:48.052189 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1070/2143] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:24:47 2022] DELETE /identity/v3/users/54508e21100543b6a36d57e6b7aa6a45 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:24:48.057407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06433a9b-fcc3-457e-a46f-cf21e54ffdf6 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:48.058002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06433a9b-fcc3-457e-a46f-cf21e54ffdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:48.058002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06433a9b-fcc3-457e-a46f-cf21e54ffdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:48.078541 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-06433a9b-fcc3-457e-a46f-cf21e54ffdf6 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:24:48.084342 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-06433a9b-fcc3-457e-a46f-cf21e54ffdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:48.144822 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1074/2144] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:24:48.155650 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b63133-245e-4259-a9e5-df2d86b197a1 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:48.157172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-95b63133-245e-4259-a9e5-df2d86b197a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:48.222277 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b63133-245e-4259-a9e5-df2d86b197a1 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:48.226180 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebb493-a1ae-474c-927f-6806c5027d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:48.227412 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebb493-a1ae-474c-927f-6806c5027d84 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:48.227695 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebb493-a1ae-474c-927f-6806c5027d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:48.227995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebb493-a1ae-474c-927f-6806c5027d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:48.237990 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebb493-a1ae-474c-927f-6806c5027d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:48.239436 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebb493-a1ae-474c-927f-6806c5027d84 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:48.249480 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1071/2145] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:24:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:24:48.723989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06433a9b-fcc3-457e-a46f-cf21e54ffdf6 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:48.725720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-06433a9b-fcc3-457e-a46f-cf21e54ffdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:48.739723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06433a9b-fcc3-457e-a46f-cf21e54ffdf6 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:48.744741 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b67cf-251b-4349-98b7-6feab5f0ffb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:48.745700 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b67cf-251b-4349-98b7-6feab5f0ffb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:48.746046 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b67cf-251b-4349-98b7-6feab5f0ffb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:48.746383 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b67cf-251b-4349-98b7-6feab5f0ffb8 admin admin] PATH_INFO: `/v3/projects/e6a7b0d3b0a644879c202ec01e2a0e86` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:48.747666 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b67cf-251b-4349-98b7-6feab5f0ffb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6a7b0d3b0a644879c202ec01e2a0e86)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:48.749693 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b67cf-251b-4349-98b7-6feab5f0ffb8 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:48.841243 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-163b67cf-251b-4349-98b7-6feab5f0ffb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6a7b0d3b0a644879c202ec01e2a0e86', 'request_id': 'req-163b67cf-251b-4349-98b7-6feab5f0ffb8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:48.897833 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-163b67cf-251b-4349-98b7-6feab5f0ffb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6a7b0d3b0a644879c202ec01e2a0e86', 'request_id': 'req-163b67cf-251b-4349-98b7-6feab5f0ffb8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:48.904801 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-163b67cf-251b-4349-98b7-6feab5f0ffb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6a7b0d3b0a644879c202ec01e2a0e86', 'request_id': 'req-163b67cf-251b-4349-98b7-6feab5f0ffb8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:48.915857 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-163b67cf-251b-4349-98b7-6feab5f0ffb8 admin admin] The token cache is being invalidate because project e6a7b0d3b0a644879c202ec01e2a0e86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:24:48.916148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-163b67cf-251b-4349-98b7-6feab5f0ffb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:48.916843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-163b67cf-251b-4349-98b7-6feab5f0ffb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:48.918392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1075/2146] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:24:48 2022] DELETE /identity/v3/projects/e6a7b0d3b0a644879c202ec01e2a0e86 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:24:48.922560 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebb493-a1ae-474c-927f-6806c5027d84 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:48.932869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebb493-a1ae-474c-927f-6806c5027d84 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:48.992770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e9bf1-68dc-4f93-b8c2-b7047a429c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:48.993690 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e9bf1-68dc-4f93-b8c2-b7047a429c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:48.993993 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e9bf1-68dc-4f93-b8c2-b7047a429c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:48.994234 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e9bf1-68dc-4f93-b8c2-b7047a429c71 admin admin] PATH_INFO: `/v3/users/5d73d21058674364ade7ee1498fb58ef` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:48.995440 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e9bf1-68dc-4f93-b8c2-b7047a429c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d73d21058674364ade7ee1498fb58ef)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:48.997415 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e9bf1-68dc-4f93-b8c2-b7047a429c71 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:49.015037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:49.192043 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-7b5e9bf1-68dc-4f93-b8c2-b7047a429c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d73d21058674364ade7ee1498fb58ef'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:49.285348 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-7b5e9bf1-68dc-4f93-b8c2-b7047a429c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d73d21058674364ade7ee1498fb58ef'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:49.286115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-7b5e9bf1-68dc-4f93-b8c2-b7047a429c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d73d21058674364ade7ee1498fb58ef'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:49.299719 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-7b5e9bf1-68dc-4f93-b8c2-b7047a429c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d73d21058674364ade7ee1498fb58ef'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:49.300411 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-7b5e9bf1-68dc-4f93-b8c2-b7047a429c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d73d21058674364ade7ee1498fb58ef'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:49.314441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1072/2147] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:24:48 2022] DELETE /identity/v3/users/5d73d21058674364ade7ee1498fb58ef => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:24:49.820063 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b67cf-251b-4349-98b7-6feab5f0ffb8 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:49.822136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-163b67cf-251b-4349-98b7-6feab5f0ffb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:49.836409 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b67cf-251b-4349-98b7-6feab5f0ffb8 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:49.893220 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac39ca4-ae02-40c2-b61c-912c4253d78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:49.894799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac39ca4-ae02-40c2-b61c-912c4253d78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:49.895219 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac39ca4-ae02-40c2-b61c-912c4253d78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:49.895499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac39ca4-ae02-40c2-b61c-912c4253d78b admin admin] PATH_INFO: `/v3/projects/f02a3bce86964431aa70533b32373af3` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:49.896735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac39ca4-ae02-40c2-b61c-912c4253d78b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f02a3bce86964431aa70533b32373af3)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:49.899190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac39ca4-ae02-40c2-b61c-912c4253d78b admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:49.973136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:49.989283 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dac39ca4-ae02-40c2-b61c-912c4253d78b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f02a3bce86964431aa70533b32373af3', 'request_id': 'req-dac39ca4-ae02-40c2-b61c-912c4253d78b'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:50.069464 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dac39ca4-ae02-40c2-b61c-912c4253d78b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f02a3bce86964431aa70533b32373af3', 'request_id': 'req-dac39ca4-ae02-40c2-b61c-912c4253d78b'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:50.076849 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dac39ca4-ae02-40c2-b61c-912c4253d78b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f02a3bce86964431aa70533b32373af3', 'request_id': 'req-dac39ca4-ae02-40c2-b61c-912c4253d78b'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:50.089010 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dac39ca4-ae02-40c2-b61c-912c4253d78b admin admin] The token cache is being invalidate because project f02a3bce86964431aa70533b32373af3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:24:50.089304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dac39ca4-ae02-40c2-b61c-912c4253d78b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:50.089987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dac39ca4-ae02-40c2-b61c-912c4253d78b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:50.091567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1076/2148] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:24:49 2022] DELETE /identity/v3/projects/f02a3bce86964431aa70533b32373af3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:24:50.097682 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710acddc-8f3b-49e8-8064-6cdfcb391fff None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:50.098209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710acddc-8f3b-49e8-8064-6cdfcb391fff None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:50.098306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710acddc-8f3b-49e8-8064-6cdfcb391fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:50.116979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-710acddc-8f3b-49e8-8064-6cdfcb391fff None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:24:50.118189 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-710acddc-8f3b-49e8-8064-6cdfcb391fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:50.178806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1073/2149] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:24:50.186793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dfc83-7f24-4b6b-9c12-b12fb07ba270 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:50.187077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dfc83-7f24-4b6b-9c12-b12fb07ba270 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:50.187356 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dfc83-7f24-4b6b-9c12-b12fb07ba270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:50.206889 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-280dfc83-7f24-4b6b-9c12-b12fb07ba270 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:24:50.208149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-280dfc83-7f24-4b6b-9c12-b12fb07ba270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:50.217175 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1077/2150] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:24:50.221594 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710acddc-8f3b-49e8-8064-6cdfcb391fff None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:50.231373 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710acddc-8f3b-49e8-8064-6cdfcb391fff None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:50.236086 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c25434-f684-4292-8c1c-c8585e7181ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:50.236791 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c25434-f684-4292-8c1c-c8585e7181ab admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:50.237075 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c25434-f684-4292-8c1c-c8585e7181ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:50.237354 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c25434-f684-4292-8c1c-c8585e7181ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:50.238101 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c25434-f684-4292-8c1c-c8585e7181ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:24:50.238409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c25434-f684-4292-8c1c-c8585e7181ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:50.240016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c25434-f684-4292-8c1c-c8585e7181ab admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:50.252134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1074/2151] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:24:50.257021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dfc83-7f24-4b6b-9c12-b12fb07ba270 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:50.266817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dfc83-7f24-4b6b-9c12-b12fb07ba270 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:50.271761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417ed9c-bd65-44c1-86d9-fa1611fe247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:50.272427 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417ed9c-bd65-44c1-86d9-fa1611fe247f admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:50.272749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417ed9c-bd65-44c1-86d9-fa1611fe247f admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:50.273031 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417ed9c-bd65-44c1-86d9-fa1611fe247f admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:50.274336 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417ed9c-bd65-44c1-86d9-fa1611fe247f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:50.276289 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417ed9c-bd65-44c1-86d9-fa1611fe247f admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:50.362448 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1078/2152] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:24:50 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:24:50.366597 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c25434-f684-4292-8c1c-c8585e7181ab admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:50.377142 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c25434-f684-4292-8c1c-c8585e7181ab admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:50.441736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fab78-f559-44be-a9e7-a7ab952d5695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:50.442420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fab78-f559-44be-a9e7-a7ab952d5695 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:50.442708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fab78-f559-44be-a9e7-a7ab952d5695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:50.442989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fab78-f559-44be-a9e7-a7ab952d5695 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:50.443698 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fab78-f559-44be-a9e7-a7ab952d5695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:50.446341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fab78-f559-44be-a9e7-a7ab952d5695 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:50.556014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1075/2153] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:24:50 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:24:50.560257 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417ed9c-bd65-44c1-86d9-fa1611fe247f admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:50.571684 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417ed9c-bd65-44c1-86d9-fa1611fe247f admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:50.576879 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b0f63-8f1a-492b-a2d4-2c1fbf0e3068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:50.577296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b0f63-8f1a-492b-a2d4-2c1fbf0e3068 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:50.577579 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b0f63-8f1a-492b-a2d4-2c1fbf0e3068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:50.577838 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b0f63-8f1a-492b-a2d4-2c1fbf0e3068 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:50.578574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b0f63-8f1a-492b-a2d4-2c1fbf0e3068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:50.580178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b0f63-8f1a-492b-a2d4-2c1fbf0e3068 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:50.591355 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1079/2154] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:24:50.595410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fab78-f559-44be-a9e7-a7ab952d5695 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:50.605621 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fab78-f559-44be-a9e7-a7ab952d5695 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:50.610327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d5983-22e8-4f99-ae81-68b214c8f8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:50.610999 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d5983-22e8-4f99-ae81-68b214c8f8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:50.611283 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d5983-22e8-4f99-ae81-68b214c8f8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:50.611561 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d5983-22e8-4f99-ae81-68b214c8f8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:50.612327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d5983-22e8-4f99-ae81-68b214c8f8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:50.614038 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d5983-22e8-4f99-ae81-68b214c8f8d1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:50.621992 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:50.629405 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1076/2155] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:24:50.636462 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b0f63-8f1a-492b-a2d4-2c1fbf0e3068 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:50.646797 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b0f63-8f1a-492b-a2d4-2c1fbf0e3068 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:50.653375 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025366ba-42ca-4276-9fad-620bda50f9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:50.654288 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025366ba-42ca-4276-9fad-620bda50f9b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:50.654612 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025366ba-42ca-4276-9fad-620bda50f9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:50.654895 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025366ba-42ca-4276-9fad-620bda50f9b8 admin admin] PATH_INFO: `/v3/projects/cb12569a894547c48798d7cf6ea0c833/users/9d09a26c268d4b45b47183c6209836f6/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:50.677609 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025366ba-42ca-4276-9fad-620bda50f9b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb12569a894547c48798d7cf6ea0c833, user_id=9d09a26c268d4b45b47183c6209836f6, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:50.682595 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025366ba-42ca-4276-9fad-620bda50f9b8 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:50.759018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1080/2156] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:24:50 2022] PUT /identity/v3/projects/cb12569a894547c48798d7cf6ea0c833/users/9d09a26c268d4b45b47183c6209836f6/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:24:50.770349 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f6fbc-d0ea-4edc-b258-251f591457b7 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:50.770666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f6fbc-d0ea-4edc-b258-251f591457b7 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:50.770843 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f6fbc-d0ea-4edc-b258-251f591457b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:50.801955 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-bd4f6fbc-d0ea-4edc-b258-251f591457b7 None None] MFA Rules not processed for user `9d09a26c268d4b45b47183c6209836f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:24:50.803192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-bd4f6fbc-d0ea-4edc-b258-251f591457b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:50.870262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1077/2157] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:24:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:24:50.875190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025366ba-42ca-4276-9fad-620bda50f9b8 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:50.953308 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025366ba-42ca-4276-9fad-620bda50f9b8 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:50.958049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9064b-7714-464d-afbf-3daaed00774d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:50.958716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9064b-7714-464d-afbf-3daaed00774d admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:50.958998 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9064b-7714-464d-afbf-3daaed00774d admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:50.959268 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9064b-7714-464d-afbf-3daaed00774d admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:50.959958 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9064b-7714-464d-afbf-3daaed00774d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:50.962464 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9064b-7714-464d-afbf-3daaed00774d admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:51.088250 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1081/2158] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:24:50 2022] POST /identity/v3/projects => generated 367 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:24:51.092354 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f6fbc-d0ea-4edc-b258-251f591457b7 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:51.103130 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f6fbc-d0ea-4edc-b258-251f591457b7 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:51.159505 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616e101-88ad-4c32-9511-9541dc91ba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:51.160104 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616e101-88ad-4c32-9511-9541dc91ba2b admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:51.160397 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616e101-88ad-4c32-9511-9541dc91ba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:51.160711 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616e101-88ad-4c32-9511-9541dc91ba2b admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:51.161405 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616e101-88ad-4c32-9511-9541dc91ba2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:51.163347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616e101-88ad-4c32-9511-9541dc91ba2b admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:51.252694 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1078/2159] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:24:51 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:24:51.256819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9064b-7714-464d-afbf-3daaed00774d admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:51.267864 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9064b-7714-464d-afbf-3daaed00774d admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:51.272738 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cee5c-1b06-45a9-a0f2-86c68d359e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:51.273513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cee5c-1b06-45a9-a0f2-86c68d359e48 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:51.273692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cee5c-1b06-45a9-a0f2-86c68d359e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:51.273972 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cee5c-1b06-45a9-a0f2-86c68d359e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:51.274706 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cee5c-1b06-45a9-a0f2-86c68d359e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:51.276345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cee5c-1b06-45a9-a0f2-86c68d359e48 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:51.287630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1082/2160] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:24:51.291812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616e101-88ad-4c32-9511-9541dc91ba2b admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:51.302255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616e101-88ad-4c32-9511-9541dc91ba2b admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:51.308031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c4518-0e7c-4c9d-bf9f-c7b3b0dc83a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:51.308966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c4518-0e7c-4c9d-bf9f-c7b3b0dc83a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:51.309251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c4518-0e7c-4c9d-bf9f-c7b3b0dc83a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:51.309530 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c4518-0e7c-4c9d-bf9f-c7b3b0dc83a8 admin admin] PATH_INFO: `/v3/projects/3db74d0a5d2a4f47a82747b6155c451c/users/4ea5f75f8e1941afa86faa49e8d2c489/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:51.325343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c4518-0e7c-4c9d-bf9f-c7b3b0dc83a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db74d0a5d2a4f47a82747b6155c451c, user_id=4ea5f75f8e1941afa86faa49e8d2c489, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:51.327990 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c4518-0e7c-4c9d-bf9f-c7b3b0dc83a8 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:51.393686 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1079/2161] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:24:51 2022] PUT /identity/v3/projects/3db74d0a5d2a4f47a82747b6155c451c/users/4ea5f75f8e1941afa86faa49e8d2c489/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:24:51.397757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cee5c-1b06-45a9-a0f2-86c68d359e48 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:51.407923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cee5c-1b06-45a9-a0f2-86c68d359e48 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:51.427574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:51.465986 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f2523-430a-4028-84f2-6aadcade6d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:51.466634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f2523-430a-4028-84f2-6aadcade6d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:51.466916 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f2523-430a-4028-84f2-6aadcade6d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:51.467191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f2523-430a-4028-84f2-6aadcade6d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:51.467927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f2523-430a-4028-84f2-6aadcade6d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:51.469637 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f2523-430a-4028-84f2-6aadcade6d18 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:51.480216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1083/2162] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:24:51.484427 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c4518-0e7c-4c9d-bf9f-c7b3b0dc83a8 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:51.495386 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c4518-0e7c-4c9d-bf9f-c7b3b0dc83a8 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:51.500125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddf583-c27e-4a6c-b471-e9428aafb95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:51.501072 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddf583-c27e-4a6c-b471-e9428aafb95d admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:51.501376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddf583-c27e-4a6c-b471-e9428aafb95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:51.501662 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddf583-c27e-4a6c-b471-e9428aafb95d admin admin] PATH_INFO: `/v3/projects/3db74d0a5d2a4f47a82747b6155c451c/users/4ea5f75f8e1941afa86faa49e8d2c489/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:51.503618 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddf583-c27e-4a6c-b471-e9428aafb95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db74d0a5d2a4f47a82747b6155c451c, user_id=4ea5f75f8e1941afa86faa49e8d2c489, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:51.506279 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddf583-c27e-4a6c-b471-e9428aafb95d admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:51.516640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1080/2163] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:24:51 2022] PUT /identity/v3/projects/3db74d0a5d2a4f47a82747b6155c451c/users/4ea5f75f8e1941afa86faa49e8d2c489/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:24:51.526568 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72711d71-c3ba-4f0b-904a-5a35fa71ae69 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:51.526860 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72711d71-c3ba-4f0b-904a-5a35fa71ae69 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:51.527142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72711d71-c3ba-4f0b-904a-5a35fa71ae69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:51.553767 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-72711d71-c3ba-4f0b-904a-5a35fa71ae69 None None] MFA Rules not processed for user `4ea5f75f8e1941afa86faa49e8d2c489`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:24:51.555628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-72711d71-c3ba-4f0b-904a-5a35fa71ae69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:51.623118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1084/2164] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:24:51 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:24:51.634471 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddf583-c27e-4a6c-b471-e9428aafb95d admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:51.636136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-05ddf583-c27e-4a6c-b471-e9428aafb95d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:51.682763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:51.694117 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddf583-c27e-4a6c-b471-e9428aafb95d admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:51.697796 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de364bb-9ee9-4f21-a480-dbd3dca20353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:51.698452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de364bb-9ee9-4f21-a480-dbd3dca20353 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:51.698738 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de364bb-9ee9-4f21-a480-dbd3dca20353 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:51.699016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de364bb-9ee9-4f21-a480-dbd3dca20353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:51.708038 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de364bb-9ee9-4f21-a480-dbd3dca20353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:51.710008 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de364bb-9ee9-4f21-a480-dbd3dca20353 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:51.719896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1081/2165] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:24:51 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:24:51.829061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72711d71-c3ba-4f0b-904a-5a35fa71ae69 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:51.830529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-72711d71-c3ba-4f0b-904a-5a35fa71ae69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:51.843181 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72711d71-c3ba-4f0b-904a-5a35fa71ae69 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:51.846922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085544d-d59a-4f40-8130-cdee7561424d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:51.847565 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085544d-d59a-4f40-8130-cdee7561424d service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:51.847843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085544d-d59a-4f40-8130-cdee7561424d service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:51.848114 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085544d-d59a-4f40-8130-cdee7561424d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:51.907159 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085544d-d59a-4f40-8130-cdee7561424d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:51.908635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085544d-d59a-4f40-8130-cdee7561424d service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:51.920160 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1085/2166] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:24:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:24:57.336782 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de364bb-9ee9-4f21-a480-dbd3dca20353 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:57.402117 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de364bb-9ee9-4f21-a480-dbd3dca20353 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:57.406917 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb2c70-cdb1-4d59-94a8-c9b8bf0e1e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:57.407783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb2c70-cdb1-4d59-94a8-c9b8bf0e1e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:57.408064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb2c70-cdb1-4d59-94a8-c9b8bf0e1e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:57.408340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb2c70-cdb1-4d59-94a8-c9b8bf0e1e28 admin admin] PATH_INFO: `/v3/users/9d09a26c268d4b45b47183c6209836f6` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:57.409561 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb2c70-cdb1-4d59-94a8-c9b8bf0e1e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d09a26c268d4b45b47183c6209836f6)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:57.411503 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb2c70-cdb1-4d59-94a8-c9b8bf0e1e28 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:57.581271 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-cadb2c70-cdb1-4d59-94a8-c9b8bf0e1e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d09a26c268d4b45b47183c6209836f6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:57.652117 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-cadb2c70-cdb1-4d59-94a8-c9b8bf0e1e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d09a26c268d4b45b47183c6209836f6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:57.652795 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-cadb2c70-cdb1-4d59-94a8-c9b8bf0e1e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d09a26c268d4b45b47183c6209836f6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:57.666585 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-cadb2c70-cdb1-4d59-94a8-c9b8bf0e1e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d09a26c268d4b45b47183c6209836f6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:57.667304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-cadb2c70-cdb1-4d59-94a8-c9b8bf0e1e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d09a26c268d4b45b47183c6209836f6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:57.681042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1082/2167] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:24:57 2022] DELETE /identity/v3/users/9d09a26c268d4b45b47183c6209836f6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:24:57.685646 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568581e-2433-41e8-9b45-b14975f9f5d4 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:57.686243 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568581e-2433-41e8-9b45-b14975f9f5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:57.686243 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568581e-2433-41e8-9b45-b14975f9f5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:57.703909 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-d568581e-2433-41e8-9b45-b14975f9f5d4 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:24:57.705155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d568581e-2433-41e8-9b45-b14975f9f5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:57.746053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:57.764689 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1086/2168] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:24:57.775324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb2c70-cdb1-4d59-94a8-c9b8bf0e1e28 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:57.776888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-cadb2c70-cdb1-4d59-94a8-c9b8bf0e1e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:57.839944 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb2c70-cdb1-4d59-94a8-c9b8bf0e1e28 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:57.843461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209d265-8d24-4eef-95b8-663d93e323e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:57.844106 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209d265-8d24-4eef-95b8-663d93e323e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:57.844421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209d265-8d24-4eef-95b8-663d93e323e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:57.844690 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209d265-8d24-4eef-95b8-663d93e323e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:57.854502 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209d265-8d24-4eef-95b8-663d93e323e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:57.855927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209d265-8d24-4eef-95b8-663d93e323e0 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:57.865364 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1083/2169] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:24:58.298986 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568581e-2433-41e8-9b45-b14975f9f5d4 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:58.300461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d568581e-2433-41e8-9b45-b14975f9f5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:58.314698 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568581e-2433-41e8-9b45-b14975f9f5d4 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:58.321680 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d2d00-8764-49d1-90ba-38b1b11f9023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:58.322675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d2d00-8764-49d1-90ba-38b1b11f9023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:58.322960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d2d00-8764-49d1-90ba-38b1b11f9023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:58.323246 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d2d00-8764-49d1-90ba-38b1b11f9023 admin admin] PATH_INFO: `/v3/projects/cb12569a894547c48798d7cf6ea0c833` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:58.324451 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d2d00-8764-49d1-90ba-38b1b11f9023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb12569a894547c48798d7cf6ea0c833)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:58.326461 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d2d00-8764-49d1-90ba-38b1b11f9023 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:58.423809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-0d7d2d00-8764-49d1-90ba-38b1b11f9023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb12569a894547c48798d7cf6ea0c833', 'request_id': 'req-0d7d2d00-8764-49d1-90ba-38b1b11f9023'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:58.474934 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-0d7d2d00-8764-49d1-90ba-38b1b11f9023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb12569a894547c48798d7cf6ea0c833', 'request_id': 'req-0d7d2d00-8764-49d1-90ba-38b1b11f9023'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:58.481953 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-0d7d2d00-8764-49d1-90ba-38b1b11f9023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb12569a894547c48798d7cf6ea0c833', 'request_id': 'req-0d7d2d00-8764-49d1-90ba-38b1b11f9023'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:58.492418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-0d7d2d00-8764-49d1-90ba-38b1b11f9023 admin admin] The token cache is being invalidate because project cb12569a894547c48798d7cf6ea0c833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:24:58.492751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-0d7d2d00-8764-49d1-90ba-38b1b11f9023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:58.493376 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-0d7d2d00-8764-49d1-90ba-38b1b11f9023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:58.494990 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1087/2170] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:24:58 2022] DELETE /identity/v3/projects/cb12569a894547c48798d7cf6ea0c833 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:24:58.499151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209d265-8d24-4eef-95b8-663d93e323e0 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:58.509722 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209d265-8d24-4eef-95b8-663d93e323e0 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:58.516000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:58.567946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b33030-24c8-4b33-b6e4-4da8d2ca6a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:58.568873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b33030-24c8-4b33-b6e4-4da8d2ca6a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:58.569247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b33030-24c8-4b33-b6e4-4da8d2ca6a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:58.569485 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b33030-24c8-4b33-b6e4-4da8d2ca6a2a admin admin] PATH_INFO: `/v3/users/4ea5f75f8e1941afa86faa49e8d2c489` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:58.571402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b33030-24c8-4b33-b6e4-4da8d2ca6a2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea5f75f8e1941afa86faa49e8d2c489)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:58.573385 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b33030-24c8-4b33-b6e4-4da8d2ca6a2a admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:58.762620 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-41b33030-24c8-4b33-b6e4-4da8d2ca6a2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea5f75f8e1941afa86faa49e8d2c489'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:58.834861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-41b33030-24c8-4b33-b6e4-4da8d2ca6a2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea5f75f8e1941afa86faa49e8d2c489'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:58.835483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-41b33030-24c8-4b33-b6e4-4da8d2ca6a2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea5f75f8e1941afa86faa49e8d2c489'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:58.848262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-41b33030-24c8-4b33-b6e4-4da8d2ca6a2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea5f75f8e1941afa86faa49e8d2c489'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:58.848983 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-41b33030-24c8-4b33-b6e4-4da8d2ca6a2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea5f75f8e1941afa86faa49e8d2c489'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:58.862073 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1084/2171] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:24:58 2022] DELETE /identity/v3/users/4ea5f75f8e1941afa86faa49e8d2c489 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:24:59.276112 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d2d00-8764-49d1-90ba-38b1b11f9023 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:59.277619 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-0d7d2d00-8764-49d1-90ba-38b1b11f9023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:59.291636 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d2d00-8764-49d1-90ba-38b1b11f9023 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:59.350125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ec477-aee6-4e18-b5cc-7e43ff500938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:59.350980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ec477-aee6-4e18-b5cc-7e43ff500938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:59.351855 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ec477-aee6-4e18-b5cc-7e43ff500938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:59.352135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ec477-aee6-4e18-b5cc-7e43ff500938 admin admin] PATH_INFO: `/v3/projects/3db74d0a5d2a4f47a82747b6155c451c` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:59.353406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ec477-aee6-4e18-b5cc-7e43ff500938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3db74d0a5d2a4f47a82747b6155c451c)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:59.355352 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ec477-aee6-4e18-b5cc-7e43ff500938 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:59.462947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ec9ec477-aee6-4e18-b5cc-7e43ff500938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3db74d0a5d2a4f47a82747b6155c451c', 'request_id': 'req-ec9ec477-aee6-4e18-b5cc-7e43ff500938'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:59.560681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ec9ec477-aee6-4e18-b5cc-7e43ff500938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3db74d0a5d2a4f47a82747b6155c451c', 'request_id': 'req-ec9ec477-aee6-4e18-b5cc-7e43ff500938'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:59.567592 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ec9ec477-aee6-4e18-b5cc-7e43ff500938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3db74d0a5d2a4f47a82747b6155c451c', 'request_id': 'req-ec9ec477-aee6-4e18-b5cc-7e43ff500938'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:59.574026 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:59.578602 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ec9ec477-aee6-4e18-b5cc-7e43ff500938 admin admin] The token cache is being invalidate because project 3db74d0a5d2a4f47a82747b6155c451c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:24:59.578900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ec9ec477-aee6-4e18-b5cc-7e43ff500938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:59.579562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-ec9ec477-aee6-4e18-b5cc-7e43ff500938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:24:59.581181 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1088/2172] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:24:59 2022] DELETE /identity/v3/projects/3db74d0a5d2a4f47a82747b6155c451c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:24:59.587652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ef623-6b79-492b-b9f0-c422bcb85cfc None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:59.598673 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ef623-6b79-492b-b9f0-c422bcb85cfc None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:59.598673 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ef623-6b79-492b-b9f0-c422bcb85cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:59.607688 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-023ef623-6b79-492b-b9f0-c422bcb85cfc None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:24:59.608945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-023ef623-6b79-492b-b9f0-c422bcb85cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:59.668972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1085/2173] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:24:59.677233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181bccc-ad83-48ff-9d23-05b186644eca None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:59.677456 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181bccc-ad83-48ff-9d23-05b186644eca None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:59.677740 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181bccc-ad83-48ff-9d23-05b186644eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:59.697080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-6181bccc-ad83-48ff-9d23-05b186644eca None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:24:59.698297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-6181bccc-ad83-48ff-9d23-05b186644eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:24:59.706286 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1089/2174] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:24:59.711322 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ef623-6b79-492b-b9f0-c422bcb85cfc None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:59.721152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ef623-6b79-492b-b9f0-c422bcb85cfc None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:59.725979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38b720-a87e-4a88-a52a-10e3c3569d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:59.726664 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38b720-a87e-4a88-a52a-10e3c3569d1f admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:59.726950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38b720-a87e-4a88-a52a-10e3c3569d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:59.727226 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38b720-a87e-4a88-a52a-10e3c3569d1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:59.727954 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38b720-a87e-4a88-a52a-10e3c3569d1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:24:59.728261 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38b720-a87e-4a88-a52a-10e3c3569d1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:59.729887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38b720-a87e-4a88-a52a-10e3c3569d1f admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:59.741437 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1086/2175] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:24:59.746314 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181bccc-ad83-48ff-9d23-05b186644eca None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:59.755958 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181bccc-ad83-48ff-9d23-05b186644eca None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:59.761164 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4f496-88c8-497b-94eb-745bd2ec1ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:59.761814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4f496-88c8-497b-94eb-745bd2ec1ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:59.762098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4f496-88c8-497b-94eb-745bd2ec1ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:59.762370 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4f496-88c8-497b-94eb-745bd2ec1ab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:59.763051 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4f496-88c8-497b-94eb-745bd2ec1ab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:59.765087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4f496-88c8-497b-94eb-745bd2ec1ab5 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:24:59.860211 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1090/2176] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:24:59 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:24:59.864360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38b720-a87e-4a88-a52a-10e3c3569d1f admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:24:59.874235 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38b720-a87e-4a88-a52a-10e3c3569d1f admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:24:59.885107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:59.933203 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc9534-35d3-4f6d-9d39-c500c125406e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:24:59.933915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc9534-35d3-4f6d-9d39-c500c125406e admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:24:59.934198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc9534-35d3-4f6d-9d39-c500c125406e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:24:59.934478 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc9534-35d3-4f6d-9d39-c500c125406e admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:24:59.935184 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc9534-35d3-4f6d-9d39-c500c125406e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:24:59.937182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc9534-35d3-4f6d-9d39-c500c125406e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:00.041091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1087/2177] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:24:59 2022] POST /identity/v3/users => generated 282 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:25:00.045265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4f496-88c8-497b-94eb-745bd2ec1ab5 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:00.055992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4f496-88c8-497b-94eb-745bd2ec1ab5 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:00.060601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa5a5f-bb23-4bef-b3d1-f10ce48de71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:00.061261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa5a5f-bb23-4bef-b3d1-f10ce48de71a admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:00.061545 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa5a5f-bb23-4bef-b3d1-f10ce48de71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:00.061822 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa5a5f-bb23-4bef-b3d1-f10ce48de71a admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:00.062554 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa5a5f-bb23-4bef-b3d1-f10ce48de71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:00.064153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa5a5f-bb23-4bef-b3d1-f10ce48de71a admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:00.076212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1091/2178] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:25:00.080228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc9534-35d3-4f6d-9d39-c500c125406e admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:00.090245 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc9534-35d3-4f6d-9d39-c500c125406e admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:00.095257 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124311cc-6f24-4f63-8f5b-160b66c8a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:00.095914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124311cc-6f24-4f63-8f5b-160b66c8a0dc admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:00.096247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124311cc-6f24-4f63-8f5b-160b66c8a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:00.096526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124311cc-6f24-4f63-8f5b-160b66c8a0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:00.097287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124311cc-6f24-4f63-8f5b-160b66c8a0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:00.098874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124311cc-6f24-4f63-8f5b-160b66c8a0dc admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:00.109577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1088/2179] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:25:00.113765 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa5a5f-bb23-4bef-b3d1-f10ce48de71a admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:00.124151 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa5a5f-bb23-4bef-b3d1-f10ce48de71a admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:00.130077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece79cbf-a8d8-41f2-b694-35cdf560b97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:00.130973 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece79cbf-a8d8-41f2-b694-35cdf560b97c admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:00.134143 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece79cbf-a8d8-41f2-b694-35cdf560b97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:00.134143 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece79cbf-a8d8-41f2-b694-35cdf560b97c admin admin] PATH_INFO: `/v3/projects/80acff7a4eca4cf285abde88e6e7f78f/users/fc9dcd3abaff4f35a13267b37af5ffba/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:00.147087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece79cbf-a8d8-41f2-b694-35cdf560b97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=80acff7a4eca4cf285abde88e6e7f78f, user_id=fc9dcd3abaff4f35a13267b37af5ffba, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:00.149738 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece79cbf-a8d8-41f2-b694-35cdf560b97c admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:00.256717 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1092/2180] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:25:00 2022] PUT /identity/v3/projects/80acff7a4eca4cf285abde88e6e7f78f/users/fc9dcd3abaff4f35a13267b37af5ffba/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:25:00.269024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15fcea-7790-46fa-915d-fa2abe1878b0 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:00.269318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15fcea-7790-46fa-915d-fa2abe1878b0 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:00.269602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15fcea-7790-46fa-915d-fa2abe1878b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:00.296652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-4a15fcea-7790-46fa-915d-fa2abe1878b0 None None] MFA Rules not processed for user `fc9dcd3abaff4f35a13267b37af5ffba`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:25:00.297874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4a15fcea-7790-46fa-915d-fa2abe1878b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:25:00.361602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1089/2181] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:25:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:25:00.373025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece79cbf-a8d8-41f2-b694-35cdf560b97c admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:00.374750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ece79cbf-a8d8-41f2-b694-35cdf560b97c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:25:00.430672 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece79cbf-a8d8-41f2-b694-35cdf560b97c admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:00.434310 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419a44c-a8e3-448f-a3be-7b60170f0909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:00.434946 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419a44c-a8e3-448f-a3be-7b60170f0909 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:00.435224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419a44c-a8e3-448f-a3be-7b60170f0909 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:00.435495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419a44c-a8e3-448f-a3be-7b60170f0909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:00.443650 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419a44c-a8e3-448f-a3be-7b60170f0909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:00.445762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419a44c-a8e3-448f-a3be-7b60170f0909 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:00.454452 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1093/2182] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:25:00 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:25:02.763807 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fbee8-1fc3-4ed5-9f2e-edb22098c1c9 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:02.763807 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fbee8-1fc3-4ed5-9f2e-edb22098c1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:02.763807 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fbee8-1fc3-4ed5-9f2e-edb22098c1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:02.823910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-4d5fbee8-1fc3-4ed5-9f2e-edb22098c1c9 None None] MFA Rules not processed for user `5890e1e70ffd4e33a812691e9c43b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:25:02.825166 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4d5fbee8-1fc3-4ed5-9f2e-edb22098c1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:25:02.871080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:25:02.900881 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1090/2183] 10.222.0.66 () {58 vars in 1009 bytes} [Thu May 26 21:25:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:25:02.943049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419a44c-a8e3-448f-a3be-7b60170f0909 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:02.944502 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2419a44c-a8e3-448f-a3be-7b60170f0909 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:25:03.036428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419a44c-a8e3-448f-a3be-7b60170f0909 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:03.041584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12373614-9e9d-4c2e-9a95-8a579ab857e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6304e47844214d2db0acfae11e4714ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:03.044285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12373614-9e9d-4c2e-9a95-8a579ab857e4 service swift] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:03.044285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12373614-9e9d-4c2e-9a95-8a579ab857e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:03.044285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12373614-9e9d-4c2e-9a95-8a579ab857e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:03.051245 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12373614-9e9d-4c2e-9a95-8a579ab857e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:03.052866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12373614-9e9d-4c2e-9a95-8a579ab857e4 service swift] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:03.062202 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1094/2184] 10.222.0.66 () {60 vars in 1384 bytes} [Thu May 26 21:25:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 21:25:13.017615 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=10 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:25:13.058416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=95,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:25:30.095500 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea26626-8357-4fcd-a9da-899406662bd0 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:30.095968 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea26626-8357-4fcd-a9da-899406662bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:30.096056 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea26626-8357-4fcd-a9da-899406662bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:30.113634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-eea26626-8357-4fcd-a9da-899406662bd0 None None] MFA Rules not processed for user `5890e1e70ffd4e33a812691e9c43b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:25:30.114813 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-eea26626-8357-4fcd-a9da-899406662bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:25:30.122612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1091/2185] 10.222.0.66 () {58 vars in 967 bytes} [Thu May 26 21:25:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:25:30.135520 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12373614-9e9d-4c2e-9a95-8a579ab857e4 service swift] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:30.146077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12373614-9e9d-4c2e-9a95-8a579ab857e4 service swift] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:30.151327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2adae-1b3d-487b-80d8-a006b47aeaf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6304e47844214d2db0acfae11e4714ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:30.151952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2adae-1b3d-487b-80d8-a006b47aeaf9 service swift] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:30.153988 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2adae-1b3d-487b-80d8-a006b47aeaf9 service swift] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:30.153988 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2adae-1b3d-487b-80d8-a006b47aeaf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:30.161002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2adae-1b3d-487b-80d8-a006b47aeaf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:30.162587 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2adae-1b3d-487b-80d8-a006b47aeaf9 service swift] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:30.170620 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1095/2186] 10.222.0.66 () {60 vars in 1384 bytes} [Thu May 26 21:25:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:25:38.528015 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da3338-293d-4fd1-b16c-5940974e4e79 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:38.528650 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da3338-293d-4fd1-b16c-5940974e4e79 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:38.528777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da3338-293d-4fd1-b16c-5940974e4e79 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:38.530628 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1092/2187] 10.222.0.66 () {54 vars in 921 bytes} [Thu May 26 21:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:25:38.566430 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249efc2-4b9d-4014-87de-d22635ec9a19 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:38.569795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249efc2-4b9d-4014-87de-d22635ec9a19 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:38.569795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249efc2-4b9d-4014-87de-d22635ec9a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:38.606300 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-4249efc2-4b9d-4014-87de-d22635ec9a19 None None] MFA Rules not processed for user `2d68ccb9b89843078c40b13f79a72dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:25:38.607516 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-4249efc2-4b9d-4014-87de-d22635ec9a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:25:38.669956 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da3338-293d-4fd1-b16c-5940974e4e79 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:38.671841 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-b3da3338-293d-4fd1-b16c-5940974e4e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:25:38.673165 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1096/2188] 10.222.0.66 () {58 vars in 1018 bytes} [Thu May 26 21:25:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:25:38.686190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249efc2-4b9d-4014-87de-d22635ec9a19 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:38.687632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-4249efc2-4b9d-4014-87de-d22635ec9a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:25:38.702264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249efc2-4b9d-4014-87de-d22635ec9a19 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:38.708035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb47af-f1b2-44e2-892c-110ae7b44edb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:38.708737 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb47af-f1b2-44e2-892c-110ae7b44edb service placement] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:38.709159 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb47af-f1b2-44e2-892c-110ae7b44edb service placement] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:38.709457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb47af-f1b2-44e2-892c-110ae7b44edb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:38.719590 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb47af-f1b2-44e2-892c-110ae7b44edb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:38.721327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb47af-f1b2-44e2-892c-110ae7b44edb service placement] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:38.731525 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1097/2189] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:25:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:25:38.752979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da3338-293d-4fd1-b16c-5940974e4e79 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:38.757788 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eac5f4-fa7c-4dfd-a3ac-f614b51597b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:38.758609 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eac5f4-fa7c-4dfd-a3ac-f614b51597b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:38.758895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eac5f4-fa7c-4dfd-a3ac-f614b51597b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:38.759179 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eac5f4-fa7c-4dfd-a3ac-f614b51597b3 admin admin] PATH_INFO: `/v3/users/596dd83622cd4fddbccbb70a98a970bc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:38.760959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eac5f4-fa7c-4dfd-a3ac-f614b51597b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=596dd83622cd4fddbccbb70a98a970bc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:38.768700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eac5f4-fa7c-4dfd-a3ac-f614b51597b3 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:38.939598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-13eac5f4-fa7c-4dfd-a3ac-f614b51597b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596dd83622cd4fddbccbb70a98a970bc'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:25:39.012338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-13eac5f4-fa7c-4dfd-a3ac-f614b51597b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596dd83622cd4fddbccbb70a98a970bc'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:25:39.013054 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-13eac5f4-fa7c-4dfd-a3ac-f614b51597b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596dd83622cd4fddbccbb70a98a970bc'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:25:39.025370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-13eac5f4-fa7c-4dfd-a3ac-f614b51597b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596dd83622cd4fddbccbb70a98a970bc'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:25:39.030679 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-13eac5f4-fa7c-4dfd-a3ac-f614b51597b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596dd83622cd4fddbccbb70a98a970bc'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:25:39.038145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1093/2190] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:25:38 2022] DELETE /identity/v3/users/596dd83622cd4fddbccbb70a98a970bc => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:25:39.277175 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb47af-f1b2-44e2-892c-110ae7b44edb service placement] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:39.289447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb47af-f1b2-44e2-892c-110ae7b44edb service placement] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:39.349622 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf4a5f-db02-4253-9c6b-ddd82678e29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:39.350496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf4a5f-db02-4253-9c6b-ddd82678e29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:39.350780 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf4a5f-db02-4253-9c6b-ddd82678e29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:39.351060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf4a5f-db02-4253-9c6b-ddd82678e29f admin admin] PATH_INFO: `/v3/projects/8c5f36ef25b441e4a4e019765530f370` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:39.352402 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf4a5f-db02-4253-9c6b-ddd82678e29f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c5f36ef25b441e4a4e019765530f370)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:39.355188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf4a5f-db02-4253-9c6b-ddd82678e29f admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:39.459775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2daf4a5f-db02-4253-9c6b-ddd82678e29f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c5f36ef25b441e4a4e019765530f370', 'request_id': 'req-2daf4a5f-db02-4253-9c6b-ddd82678e29f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:25:39.575088 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2daf4a5f-db02-4253-9c6b-ddd82678e29f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c5f36ef25b441e4a4e019765530f370', 'request_id': 'req-2daf4a5f-db02-4253-9c6b-ddd82678e29f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:25:39.575088 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:25:39.579302 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2daf4a5f-db02-4253-9c6b-ddd82678e29f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c5f36ef25b441e4a4e019765530f370', 'request_id': 'req-2daf4a5f-db02-4253-9c6b-ddd82678e29f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:25:39.589763 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2daf4a5f-db02-4253-9c6b-ddd82678e29f admin admin] The token cache is being invalidate because project 8c5f36ef25b441e4a4e019765530f370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:25:39.590046 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2daf4a5f-db02-4253-9c6b-ddd82678e29f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:25:39.590688 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2daf4a5f-db02-4253-9c6b-ddd82678e29f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:25:39.592221 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1098/2191] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:25:39 2022] DELETE /identity/v3/projects/8c5f36ef25b441e4a4e019765530f370 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:25:39.597462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474c6e0-9504-4423-ade6-8abf4a2516fc None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:39.597913 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474c6e0-9504-4423-ade6-8abf4a2516fc None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:39.597913 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474c6e0-9504-4423-ade6-8abf4a2516fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:39.621264 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-5474c6e0-9504-4423-ade6-8abf4a2516fc None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:25:39.621264 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-5474c6e0-9504-4423-ade6-8abf4a2516fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:25:39.688434 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1094/2192] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:25:39.696123 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f01de-11b1-4aba-923c-ad75aaa4025c None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:39.696619 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f01de-11b1-4aba-923c-ad75aaa4025c None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:39.696925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f01de-11b1-4aba-923c-ad75aaa4025c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:39.716701 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-935f01de-11b1-4aba-923c-ad75aaa4025c None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:25:39.717944 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-935f01de-11b1-4aba-923c-ad75aaa4025c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:25:39.726778 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1099/2193] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:25:39.732014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474c6e0-9504-4423-ade6-8abf4a2516fc None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:39.742702 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474c6e0-9504-4423-ade6-8abf4a2516fc None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:39.748538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa079d55-b36c-41c4-b1ef-4e19c52f53d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:39.749293 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa079d55-b36c-41c4-b1ef-4e19c52f53d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:39.749583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa079d55-b36c-41c4-b1ef-4e19c52f53d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:39.749864 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa079d55-b36c-41c4-b1ef-4e19c52f53d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:39.750641 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa079d55-b36c-41c4-b1ef-4e19c52f53d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:25:39.750951 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa079d55-b36c-41c4-b1ef-4e19c52f53d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:39.752835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa079d55-b36c-41c4-b1ef-4e19c52f53d4 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:39.761986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:25:39.766285 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1095/2194] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:25:39.769795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f01de-11b1-4aba-923c-ad75aaa4025c None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:39.780501 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f01de-11b1-4aba-923c-ad75aaa4025c None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:39.785568 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ad206-dbff-440b-b4f4-650967d08718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:39.786236 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ad206-dbff-440b-b4f4-650967d08718 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:39.786519 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ad206-dbff-440b-b4f4-650967d08718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:39.786792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ad206-dbff-440b-b4f4-650967d08718 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:39.787495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ad206-dbff-440b-b4f4-650967d08718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:39.789509 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ad206-dbff-440b-b4f4-650967d08718 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:39.899404 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1100/2195] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:25:39 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:25:39.903967 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa079d55-b36c-41c4-b1ef-4e19c52f53d4 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:39.914390 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa079d55-b36c-41c4-b1ef-4e19c52f53d4 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:39.970545 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912aaa03-7c69-45b4-bd9a-3c0bcffefb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:39.971183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aaa03-7c69-45b4-bd9a-3c0bcffefb0f admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:39.971469 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aaa03-7c69-45b4-bd9a-3c0bcffefb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:39.971751 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aaa03-7c69-45b4-bd9a-3c0bcffefb0f admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:39.972838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912aaa03-7c69-45b4-bd9a-3c0bcffefb0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:39.974416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912aaa03-7c69-45b4-bd9a-3c0bcffefb0f admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:40.057539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1096/2196] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:25:39 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:25:40.061760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ad206-dbff-440b-b4f4-650967d08718 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:40.072519 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ad206-dbff-440b-b4f4-650967d08718 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:40.077236 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac06c6-9614-48d5-bd84-18eb529a0745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:40.077907 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac06c6-9614-48d5-bd84-18eb529a0745 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:40.078173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac06c6-9614-48d5-bd84-18eb529a0745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:40.078443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac06c6-9614-48d5-bd84-18eb529a0745 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:40.079200 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac06c6-9614-48d5-bd84-18eb529a0745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:40.080827 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac06c6-9614-48d5-bd84-18eb529a0745 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:40.091806 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1101/2197] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:25:40.095818 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912aaa03-7c69-45b4-bd9a-3c0bcffefb0f admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:40.106443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912aaa03-7c69-45b4-bd9a-3c0bcffefb0f admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:40.111855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52657c3b-ba3f-4d38-b32b-c63390e734b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:40.114583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52657c3b-ba3f-4d38-b32b-c63390e734b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:40.114583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52657c3b-ba3f-4d38-b32b-c63390e734b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:40.114583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52657c3b-ba3f-4d38-b32b-c63390e734b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:40.114583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52657c3b-ba3f-4d38-b32b-c63390e734b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:40.115382 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52657c3b-ba3f-4d38-b32b-c63390e734b6 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:40.125451 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1097/2198] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:25:40.129813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac06c6-9614-48d5-bd84-18eb529a0745 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:40.140709 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac06c6-9614-48d5-bd84-18eb529a0745 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:40.145459 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10bb4a-585d-4748-922b-0366f6170a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:40.146328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10bb4a-585d-4748-922b-0366f6170a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:40.146603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10bb4a-585d-4748-922b-0366f6170a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:40.146876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10bb4a-585d-4748-922b-0366f6170a38 admin admin] PATH_INFO: `/v3/projects/198b0d7e8b204f858abb8474f90af623/users/d3e7bb3f129f47c7869f3319f35ed15e/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:40.163115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10bb4a-585d-4748-922b-0366f6170a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=198b0d7e8b204f858abb8474f90af623, user_id=d3e7bb3f129f47c7869f3319f35ed15e, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:40.165865 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10bb4a-585d-4748-922b-0366f6170a38 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:40.235152 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1102/2199] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:25:40 2022] PUT /identity/v3/projects/198b0d7e8b204f858abb8474f90af623/users/d3e7bb3f129f47c7869f3319f35ed15e/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:25:40.240305 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6228d-d882-4c61-ba23-f592daed0c9c None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:40.240685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6228d-d882-4c61-ba23-f592daed0c9c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:40.241026 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6228d-d882-4c61-ba23-f592daed0c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:40.259095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-82b6228d-d882-4c61-ba23-f592daed0c9c None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:25:40.267387 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-82b6228d-d882-4c61-ba23-f592daed0c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:25:40.327018 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1098/2200] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:25:40.336906 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10bb4a-585d-4748-922b-0366f6170a38 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:40.339281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3f10bb4a-585d-4748-922b-0366f6170a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:25:40.402891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10bb4a-585d-4748-922b-0366f6170a38 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:40.407479 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc69ad7-2b4b-4b6e-b175-5a75cb4212d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:40.408145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc69ad7-2b4b-4b6e-b175-5a75cb4212d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:40.408573 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc69ad7-2b4b-4b6e-b175-5a75cb4212d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:40.408887 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc69ad7-2b4b-4b6e-b175-5a75cb4212d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:40.418936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc69ad7-2b4b-4b6e-b175-5a75cb4212d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:40.420425 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc69ad7-2b4b-4b6e-b175-5a75cb4212d2 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:40.434272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1103/2201] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:25:46.390229 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ef471-d49f-4fa2-902e-82f9c6c5d7a1 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:46.390700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ef471-d49f-4fa2-902e-82f9c6c5d7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:46.390860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ef471-d49f-4fa2-902e-82f9c6c5d7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:46.433434 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-580ef471-d49f-4fa2-902e-82f9c6c5d7a1 None None] MFA Rules not processed for user `d3e7bb3f129f47c7869f3319f35ed15e`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:25:46.433434 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-580ef471-d49f-4fa2-902e-82f9c6c5d7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:25:46.569837 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1099/2202] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:25:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:25:46.577909 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc69ad7-2b4b-4b6e-b175-5a75cb4212d2 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:46.589893 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc69ad7-2b4b-4b6e-b175-5a75cb4212d2 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:46.598770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bfc6c-c1b2-4736-88e0-0cb75758aa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:46.599827 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bfc6c-c1b2-4736-88e0-0cb75758aa55 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:46.599944 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bfc6c-c1b2-4736-88e0-0cb75758aa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:46.600228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bfc6c-c1b2-4736-88e0-0cb75758aa55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:46.601180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bfc6c-c1b2-4736-88e0-0cb75758aa55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:46.603462 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bfc6c-c1b2-4736-88e0-0cb75758aa55 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:46.720959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1104/2203] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:25:46 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:25:46.722273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ef471-d49f-4fa2-902e-82f9c6c5d7a1 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:46.734566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ef471-d49f-4fa2-902e-82f9c6c5d7a1 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:46.741276 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:25:46.806547 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb65ee-c928-43c6-8b35-d7ed1c33038c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:46.807466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb65ee-c928-43c6-8b35-d7ed1c33038c admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:46.807757 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb65ee-c928-43c6-8b35-d7ed1c33038c admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:46.811743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb65ee-c928-43c6-8b35-d7ed1c33038c admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:46.813091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb65ee-c928-43c6-8b35-d7ed1c33038c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:46.815302 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb65ee-c928-43c6-8b35-d7ed1c33038c admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:46.957437 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1100/2204] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:25:46 2022] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:25:46.961076 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bfc6c-c1b2-4736-88e0-0cb75758aa55 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:46.974308 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bfc6c-c1b2-4736-88e0-0cb75758aa55 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:46.978999 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf5c31-9066-4aeb-8b20-846b15f25c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:46.979735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf5c31-9066-4aeb-8b20-846b15f25c78 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:46.980197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf5c31-9066-4aeb-8b20-846b15f25c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:46.980540 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf5c31-9066-4aeb-8b20-846b15f25c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:46.981556 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf5c31-9066-4aeb-8b20-846b15f25c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:46.983241 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf5c31-9066-4aeb-8b20-846b15f25c78 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:46.994452 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1105/2205] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:25:47.001549 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb65ee-c928-43c6-8b35-d7ed1c33038c admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:47.014321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb65ee-c928-43c6-8b35-d7ed1c33038c admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:47.018953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a345c73-3cd9-4125-961f-4bc65a813462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:47.019838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a345c73-3cd9-4125-961f-4bc65a813462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:47.020115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a345c73-3cd9-4125-961f-4bc65a813462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:47.020389 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a345c73-3cd9-4125-961f-4bc65a813462 admin admin] PATH_INFO: `/v3/projects/1708460593704a478e558977cb1e18df/users/01aaaef6110b4cd9acd65f144c9403f8/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:47.039654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a345c73-3cd9-4125-961f-4bc65a813462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1708460593704a478e558977cb1e18df, user_id=01aaaef6110b4cd9acd65f144c9403f8, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:47.042489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a345c73-3cd9-4125-961f-4bc65a813462 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:47.157870 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1101/2206] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:25:46 2022] PUT /identity/v3/projects/1708460593704a478e558977cb1e18df/users/01aaaef6110b4cd9acd65f144c9403f8/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:25:47.167397 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf5c31-9066-4aeb-8b20-846b15f25c78 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:47.191223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf5c31-9066-4aeb-8b20-846b15f25c78 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:47.256750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:25:47.275734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3315c-e8c1-4839-94c8-15dacf27613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:47.276531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3315c-e8c1-4839-94c8-15dacf27613b admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:47.276849 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3315c-e8c1-4839-94c8-15dacf27613b admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:47.277126 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3315c-e8c1-4839-94c8-15dacf27613b admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:47.277902 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3315c-e8c1-4839-94c8-15dacf27613b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:47.279533 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3315c-e8c1-4839-94c8-15dacf27613b admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:47.292786 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1106/2207] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:25:47.296015 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a345c73-3cd9-4125-961f-4bc65a813462 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:47.313725 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a345c73-3cd9-4125-961f-4bc65a813462 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:47.325618 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca4a19-ca17-44d7-b4cd-8b9a25c3f39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:47.326622 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca4a19-ca17-44d7-b4cd-8b9a25c3f39f admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:47.326982 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca4a19-ca17-44d7-b4cd-8b9a25c3f39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:47.327338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca4a19-ca17-44d7-b4cd-8b9a25c3f39f admin admin] PATH_INFO: `/v3/projects/1708460593704a478e558977cb1e18df/users/01aaaef6110b4cd9acd65f144c9403f8/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:47.329652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca4a19-ca17-44d7-b4cd-8b9a25c3f39f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1708460593704a478e558977cb1e18df, user_id=01aaaef6110b4cd9acd65f144c9403f8, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:47.334610 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca4a19-ca17-44d7-b4cd-8b9a25c3f39f admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:47.347872 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1102/2208] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:25:47 2022] PUT /identity/v3/projects/1708460593704a478e558977cb1e18df/users/01aaaef6110b4cd9acd65f144c9403f8/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:25:53.313232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f2c6e-a1ca-4cc0-8040-f77119a5651d None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:53.313786 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f2c6e-a1ca-4cc0-8040-f77119a5651d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:53.313786 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f2c6e-a1ca-4cc0-8040-f77119a5651d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:53.345726 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-365f2c6e-a1ca-4cc0-8040-f77119a5651d None None] MFA Rules not processed for user `01aaaef6110b4cd9acd65f144c9403f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:25:53.347589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-365f2c6e-a1ca-4cc0-8040-f77119a5651d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:25:53.449737 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1107/2209] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:25:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:25:53.461771 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca4a19-ca17-44d7-b4cd-8b9a25c3f39f admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:53.463577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-12ca4a19-ca17-44d7-b4cd-8b9a25c3f39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:25:53.556345 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca4a19-ca17-44d7-b4cd-8b9a25c3f39f admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:53.561487 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369040ef-33fc-4991-a871-9223b798475a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdb2d75e4025a5d73ea713c690b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:53.562314 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369040ef-33fc-4991-a871-9223b798475a service glance] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:53.562704 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369040ef-33fc-4991-a871-9223b798475a service glance] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:53.563078 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369040ef-33fc-4991-a871-9223b798475a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:53.637102 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:25:53.640021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369040ef-33fc-4991-a871-9223b798475a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:53.641536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369040ef-33fc-4991-a871-9223b798475a service glance] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:53.653799 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1103/2210] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:25:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:25:53.947538 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86064aec-74e2-4e04-b3fb-34f1fc3764d8 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:53.947838 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86064aec-74e2-4e04-b3fb-34f1fc3764d8 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:53.948121 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86064aec-74e2-4e04-b3fb-34f1fc3764d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:53.966137 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-86064aec-74e2-4e04-b3fb-34f1fc3764d8 None None] MFA Rules not processed for user `5890e1e70ffd4e33a812691e9c43b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:25:53.967358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-86064aec-74e2-4e04-b3fb-34f1fc3764d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:25:54.028530 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1108/2211] 10.222.0.66 () {58 vars in 1009 bytes} [Thu May 26 21:25:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:25:54.051042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369040ef-33fc-4991-a871-9223b798475a service glance] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:54.051042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-369040ef-33fc-4991-a871-9223b798475a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:25:54.134641 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369040ef-33fc-4991-a871-9223b798475a service glance] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:54.139786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b018b42-8276-4edc-8449-2794ad03bee1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6304e47844214d2db0acfae11e4714ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:54.140446 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b018b42-8276-4edc-8449-2794ad03bee1 service swift] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:54.140773 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b018b42-8276-4edc-8449-2794ad03bee1 service swift] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:54.141054 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b018b42-8276-4edc-8449-2794ad03bee1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:54.150253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b018b42-8276-4edc-8449-2794ad03bee1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:54.152487 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b018b42-8276-4edc-8449-2794ad03bee1 service swift] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:54.162201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1104/2212] 10.222.0.66 () {60 vars in 1384 bytes} [Thu May 26 21:25:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:25:59.597054 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86064aec-74e2-4e04-b3fb-34f1fc3764d8 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:25:59.668275 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86064aec-74e2-4e04-b3fb-34f1fc3764d8 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:25:59.673008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674534e-cd66-4765-9917-57e4460b4256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:25:59.673693 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674534e-cd66-4765-9917-57e4460b4256 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:25:59.673976 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674534e-cd66-4765-9917-57e4460b4256 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:25:59.674261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674534e-cd66-4765-9917-57e4460b4256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:25:59.676085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-9674534e-cd66-4765-9917-57e4460b4256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:25:59.748539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:25:59.831476 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674534e-cd66-4765-9917-57e4460b4256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:25:59.833544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674534e-cd66-4765-9917-57e4460b4256 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:25:59.863854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1109/2213] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:25:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:26:00.024933 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b018b42-8276-4edc-8449-2794ad03bee1 service swift] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:00.027275 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1b018b42-8276-4edc-8449-2794ad03bee1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:00.106167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b018b42-8276-4edc-8449-2794ad03bee1 service swift] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:00.109812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1be0e-f1e3-42b2-a8b4-b1ef51641522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:00.110447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1be0e-f1e3-42b2-a8b4-b1ef51641522 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:00.110730 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1be0e-f1e3-42b2-a8b4-b1ef51641522 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:00.111173 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1be0e-f1e3-42b2-a8b4-b1ef51641522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:00.113328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6ea1be0e-f1e3-42b2-a8b4-b1ef51641522 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:00.131342 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1be0e-f1e3-42b2-a8b4-b1ef51641522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:00.132823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1be0e-f1e3-42b2-a8b4-b1ef51641522 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:00.145970 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1105/2214] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:26:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:26:05.464850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c19b9-5981-48a2-b133-3fa703ca9631 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:05.465430 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c19b9-5981-48a2-b133-3fa703ca9631 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:05.465430 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c19b9-5981-48a2-b133-3fa703ca9631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:05.483412 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-eb8c19b9-5981-48a2-b133-3fa703ca9631 None None] MFA Rules not processed for user `d3e7bb3f129f47c7869f3319f35ed15e`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:26:05.484650 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-eb8c19b9-5981-48a2-b133-3fa703ca9631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:05.491447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1110/2215] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:26:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:26:05.760641 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1be0e-f1e3-42b2-a8b4-b1ef51641522 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:05.770969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1be0e-f1e3-42b2-a8b4-b1ef51641522 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:05.774710 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830d7d3-ff7b-4471-8ff9-7e9000bcbd31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:05.775407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830d7d3-ff7b-4471-8ff9-7e9000bcbd31 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:05.776346 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830d7d3-ff7b-4471-8ff9-7e9000bcbd31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:05.776649 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830d7d3-ff7b-4471-8ff9-7e9000bcbd31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:05.778475 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e830d7d3-ff7b-4471-8ff9-7e9000bcbd31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:05.788991 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830d7d3-ff7b-4471-8ff9-7e9000bcbd31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:05.790419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830d7d3-ff7b-4471-8ff9-7e9000bcbd31 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:05.799262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1106/2216] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:26:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:26:06.250187 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c19b9-5981-48a2-b133-3fa703ca9631 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:06.252290 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-eb8c19b9-5981-48a2-b133-3fa703ca9631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:06.368345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c19b9-5981-48a2-b133-3fa703ca9631 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:06.374079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85dc91-17aa-4028-8972-0bc5405361c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:06.374735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85dc91-17aa-4028-8972-0bc5405361c2 service placement] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:06.375463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85dc91-17aa-4028-8972-0bc5405361c2 service placement] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:06.375744 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85dc91-17aa-4028-8972-0bc5405361c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:06.377688 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1d85dc91-17aa-4028-8972-0bc5405361c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:06.391831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85dc91-17aa-4028-8972-0bc5405361c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:06.394359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85dc91-17aa-4028-8972-0bc5405361c2 service placement] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:06.404524 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1111/2217] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:26:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:26:09.743972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f96187-2c8d-4a7a-8cd6-fdb259efe36c None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:09.744465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f96187-2c8d-4a7a-8cd6-fdb259efe36c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:09.744617 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f96187-2c8d-4a7a-8cd6-fdb259efe36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:09.764730 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-45f96187-2c8d-4a7a-8cd6-fdb259efe36c None None] MFA Rules not processed for user `f45b8987f3c24cf19de0fa81482c050a`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:26:09.765934 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-45f96187-2c8d-4a7a-8cd6-fdb259efe36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:09.821302 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1107/2218] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:26:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:26:12.767655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be9161-9786-46b9-9ac4-6aeab4dbf30d None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:12.768173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be9161-9786-46b9-9ac4-6aeab4dbf30d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:12.768526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be9161-9786-46b9-9ac4-6aeab4dbf30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:12.787815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-e3be9161-9786-46b9-9ac4-6aeab4dbf30d None None] MFA Rules not processed for user `5890e1e70ffd4e33a812691e9c43b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:26:12.789227 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-e3be9161-9786-46b9-9ac4-6aeab4dbf30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:12.797674 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1112/2219] 10.222.0.66 () {58 vars in 1009 bytes} [Thu May 26 21:26:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:26:12.812744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f96187-2c8d-4a7a-8cd6-fdb259efe36c None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:12.824647 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f96187-2c8d-4a7a-8cd6-fdb259efe36c None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:12.830063 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3ef76-9c75-4418-87c1-a8a7989de5ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6304e47844214d2db0acfae11e4714ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:12.830727 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3ef76-9c75-4418-87c1-a8a7989de5ec service swift] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:12.831196 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3ef76-9c75-4418-87c1-a8a7989de5ec service swift] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:12.831476 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3ef76-9c75-4418-87c1-a8a7989de5ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:12.843445 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3ef76-9c75-4418-87c1-a8a7989de5ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:12.845967 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3ef76-9c75-4418-87c1-a8a7989de5ec service swift] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:12.858138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1108/2220] 10.222.0.66 () {60 vars in 1384 bytes} [Thu May 26 21:26:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:26:14.666392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6755ff-6de4-42fc-92aa-ae2932dc0fea None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:14.666967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6755ff-6de4-42fc-92aa-ae2932dc0fea None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:14.667058 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6755ff-6de4-42fc-92aa-ae2932dc0fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:14.685239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-bc6755ff-6de4-42fc-92aa-ae2932dc0fea None None] MFA Rules not processed for user `46e692bef3e3484ebac5d1563e489e03`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:26:14.686484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-bc6755ff-6de4-42fc-92aa-ae2932dc0fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:14.753161 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1113/2221] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:26:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:26:18.644259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3ef76-9c75-4418-87c1-a8a7989de5ec service swift] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:18.654440 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3ef76-9c75-4418-87c1-a8a7989de5ec service swift] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:18.658736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89e9bf-dd96-4722-953b-d07fdc5dac88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:18.659381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89e9bf-dd96-4722-953b-d07fdc5dac88 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:18.659663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89e9bf-dd96-4722-953b-d07fdc5dac88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:18.659937 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89e9bf-dd96-4722-953b-d07fdc5dac88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:18.662006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-bb89e9bf-dd96-4722-953b-d07fdc5dac88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:18.667371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:18.722120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89e9bf-dd96-4722-953b-d07fdc5dac88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:18.723544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89e9bf-dd96-4722-953b-d07fdc5dac88 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:18.732657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1109/2222] 10.222.0.66 () {60 vars in 1396 bytes} [Thu May 26 21:26:18 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:26:22.598720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6755ff-6de4-42fc-92aa-ae2932dc0fea None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:22.600449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-bc6755ff-6de4-42fc-92aa-ae2932dc0fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:22.627526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6755ff-6de4-42fc-92aa-ae2932dc0fea None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:22.634526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc80e1a-945d-49a8-9230-fbced77ba444 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:22.635291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc80e1a-945d-49a8-9230-fbced77ba444 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:22.635639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc80e1a-945d-49a8-9230-fbced77ba444 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:22.636004 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc80e1a-945d-49a8-9230-fbced77ba444 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:22.637916 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-5bc80e1a-945d-49a8-9230-fbced77ba444 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:22.648839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc80e1a-945d-49a8-9230-fbced77ba444 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:22.650405 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc80e1a-945d-49a8-9230-fbced77ba444 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:22.660372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1114/2223] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:26:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:26:22.677940 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89e9bf-dd96-4722-953b-d07fdc5dac88 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:22.679580 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-bb89e9bf-dd96-4722-953b-d07fdc5dac88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:22.692077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89e9bf-dd96-4722-953b-d07fdc5dac88 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:22.696082 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983aefd5-191c-4fc2-a630-8efd694ec71c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:22.696787 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aefd5-191c-4fc2-a630-8efd694ec71c service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:22.697091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aefd5-191c-4fc2-a630-8efd694ec71c service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:22.697347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aefd5-191c-4fc2-a630-8efd694ec71c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:22.699348 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-983aefd5-191c-4fc2-a630-8efd694ec71c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:22.778440 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983aefd5-191c-4fc2-a630-8efd694ec71c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:22.779904 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983aefd5-191c-4fc2-a630-8efd694ec71c service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:22.794255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1110/2224] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:26:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:26:24.181330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc80e1a-945d-49a8-9230-fbced77ba444 service nova] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:24.182740 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-5bc80e1a-945d-49a8-9230-fbced77ba444 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:24.193206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:24.255404 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc80e1a-945d-49a8-9230-fbced77ba444 service nova] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:24.260822 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63127942-9a8b-4c14-90b5-423d26d14673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:24.261713 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63127942-9a8b-4c14-90b5-423d26d14673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:24.261999 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63127942-9a8b-4c14-90b5-423d26d14673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:24.262298 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63127942-9a8b-4c14-90b5-423d26d14673 admin admin] PATH_INFO: `/v3/users/fc9dcd3abaff4f35a13267b37af5ffba` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:24.263526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63127942-9a8b-4c14-90b5-423d26d14673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc9dcd3abaff4f35a13267b37af5ffba)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:24.265561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63127942-9a8b-4c14-90b5-423d26d14673 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:24.424984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-63127942-9a8b-4c14-90b5-423d26d14673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc9dcd3abaff4f35a13267b37af5ffba'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:24.425592 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-63127942-9a8b-4c14-90b5-423d26d14673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc9dcd3abaff4f35a13267b37af5ffba'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:24.426269 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-63127942-9a8b-4c14-90b5-423d26d14673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc9dcd3abaff4f35a13267b37af5ffba'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:24.456722 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-63127942-9a8b-4c14-90b5-423d26d14673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc9dcd3abaff4f35a13267b37af5ffba'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:24.466006 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-63127942-9a8b-4c14-90b5-423d26d14673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc9dcd3abaff4f35a13267b37af5ffba'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:24.542912 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1115/2225] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:26:24 2022] DELETE /identity/v3/users/fc9dcd3abaff4f35a13267b37af5ffba => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:26:24.547461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a97614-c8b8-4f16-8d84-76b148195c7f None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:24.548010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a97614-c8b8-4f16-8d84-76b148195c7f None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:24.548010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a97614-c8b8-4f16-8d84-76b148195c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:24.570845 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-23a97614-c8b8-4f16-8d84-76b148195c7f None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:26:24.572103 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-23a97614-c8b8-4f16-8d84-76b148195c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:24.635135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1111/2226] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:26:24.646743 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63127942-9a8b-4c14-90b5-423d26d14673 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:24.647331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-63127942-9a8b-4c14-90b5-423d26d14673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:24.707567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63127942-9a8b-4c14-90b5-423d26d14673 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:24.711310 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555bdbb-8127-478d-be29-8006245efd0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:24.711951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555bdbb-8127-478d-be29-8006245efd0b service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:24.712228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555bdbb-8127-478d-be29-8006245efd0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:24.712533 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555bdbb-8127-478d-be29-8006245efd0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:24.722741 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555bdbb-8127-478d-be29-8006245efd0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:24.724244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555bdbb-8127-478d-be29-8006245efd0b service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:24.734583 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1116/2227] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:26:25.413774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a97614-c8b8-4f16-8d84-76b148195c7f None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:25.415488 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-23a97614-c8b8-4f16-8d84-76b148195c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:25.436279 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a97614-c8b8-4f16-8d84-76b148195c7f None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:25.449497 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768dbe1f-90ec-4210-9660-9623222cb2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:25.450393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dbe1f-90ec-4210-9660-9623222cb2ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:25.451213 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dbe1f-90ec-4210-9660-9623222cb2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:25.451525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dbe1f-90ec-4210-9660-9623222cb2ea admin admin] PATH_INFO: `/v3/projects/80acff7a4eca4cf285abde88e6e7f78f` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:25.452794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768dbe1f-90ec-4210-9660-9623222cb2ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=80acff7a4eca4cf285abde88e6e7f78f)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:25.454885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768dbe1f-90ec-4210-9660-9623222cb2ea admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:25.550428 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:25.559168 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-768dbe1f-90ec-4210-9660-9623222cb2ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80acff7a4eca4cf285abde88e6e7f78f', 'request_id': 'req-768dbe1f-90ec-4210-9660-9623222cb2ea'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:25.565229 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-768dbe1f-90ec-4210-9660-9623222cb2ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80acff7a4eca4cf285abde88e6e7f78f', 'request_id': 'req-768dbe1f-90ec-4210-9660-9623222cb2ea'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:25.657306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-768dbe1f-90ec-4210-9660-9623222cb2ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80acff7a4eca4cf285abde88e6e7f78f', 'request_id': 'req-768dbe1f-90ec-4210-9660-9623222cb2ea'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:25.669988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-768dbe1f-90ec-4210-9660-9623222cb2ea admin admin] The token cache is being invalidate because project 80acff7a4eca4cf285abde88e6e7f78f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:26:25.671222 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-768dbe1f-90ec-4210-9660-9623222cb2ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:25.671912 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-768dbe1f-90ec-4210-9660-9623222cb2ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:25.673543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1112/2228] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:26:25 2022] DELETE /identity/v3/projects/80acff7a4eca4cf285abde88e6e7f78f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:26:25.681694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d92b1b-ac75-4c70-ad36-e94cd697f74b None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:25.682246 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d92b1b-ac75-4c70-ad36-e94cd697f74b None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:25.682246 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d92b1b-ac75-4c70-ad36-e94cd697f74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:25.702147 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-16d92b1b-ac75-4c70-ad36-e94cd697f74b None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:26:25.703408 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-16d92b1b-ac75-4c70-ad36-e94cd697f74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:25.730877 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:25.776706 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1117/2229] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:26:25.777587 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f0a47-324b-475b-979c-73b20ac2cdcc None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:25.777888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f0a47-324b-475b-979c-73b20ac2cdcc None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:25.778171 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f0a47-324b-475b-979c-73b20ac2cdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:25.798789 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-c95f0a47-324b-475b-979c-73b20ac2cdcc None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:26:25.800009 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-c95f0a47-324b-475b-979c-73b20ac2cdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:25.810543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1113/2230] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:26:25.815695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d92b1b-ac75-4c70-ad36-e94cd697f74b None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:25.827859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d92b1b-ac75-4c70-ad36-e94cd697f74b None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:25.833119 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd63e16-9857-4216-a386-97ea092b3e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:25.833576 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd63e16-9857-4216-a386-97ea092b3e39 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:25.833831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd63e16-9857-4216-a386-97ea092b3e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:25.834156 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd63e16-9857-4216-a386-97ea092b3e39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:25.834819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd63e16-9857-4216-a386-97ea092b3e39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:26:25.835125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd63e16-9857-4216-a386-97ea092b3e39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:25.837961 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd63e16-9857-4216-a386-97ea092b3e39 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:25.853360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1118/2231] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:26:25.858126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f0a47-324b-475b-979c-73b20ac2cdcc None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:25.868307 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f0a47-324b-475b-979c-73b20ac2cdcc None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:25.874187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd2992-01b2-445c-9a2a-25d3b47a5ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:25.879014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd2992-01b2-445c-9a2a-25d3b47a5ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:25.879014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd2992-01b2-445c-9a2a-25d3b47a5ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:25.879014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd2992-01b2-445c-9a2a-25d3b47a5ef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:25.879014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd2992-01b2-445c-9a2a-25d3b47a5ef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:25.879014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd2992-01b2-445c-9a2a-25d3b47a5ef3 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:25.968660 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1114/2232] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:26:25 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:26:25.972933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd63e16-9857-4216-a386-97ea092b3e39 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:25.986491 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd63e16-9857-4216-a386-97ea092b3e39 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:26.048246 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda054a-85fd-4c73-a57f-0b14f9a5780b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:26.049007 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda054a-85fd-4c73-a57f-0b14f9a5780b admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:26.049366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda054a-85fd-4c73-a57f-0b14f9a5780b admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:26.049558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda054a-85fd-4c73-a57f-0b14f9a5780b admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:26.050658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda054a-85fd-4c73-a57f-0b14f9a5780b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:26.068046 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda054a-85fd-4c73-a57f-0b14f9a5780b admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:26.163783 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1119/2233] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:26:25 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:26:26.166187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd2992-01b2-445c-9a2a-25d3b47a5ef3 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:26.177297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd2992-01b2-445c-9a2a-25d3b47a5ef3 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:26.181990 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25300ae-fa13-4998-a819-376b4d3ba8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:26.185316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25300ae-fa13-4998-a819-376b4d3ba8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:26.185316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25300ae-fa13-4998-a819-376b4d3ba8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:26.185316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25300ae-fa13-4998-a819-376b4d3ba8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:26.185316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25300ae-fa13-4998-a819-376b4d3ba8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:26.186179 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25300ae-fa13-4998-a819-376b4d3ba8d5 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:26.196721 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1115/2234] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:26:26.200846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda054a-85fd-4c73-a57f-0b14f9a5780b admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:26.211621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda054a-85fd-4c73-a57f-0b14f9a5780b admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:26.219419 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93be2ea-45fc-4187-bc85-565725fdfcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:26.220144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93be2ea-45fc-4187-bc85-565725fdfcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:26.220525 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93be2ea-45fc-4187-bc85-565725fdfcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:26.220834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93be2ea-45fc-4187-bc85-565725fdfcb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:26.221645 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93be2ea-45fc-4187-bc85-565725fdfcb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:26.223508 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93be2ea-45fc-4187-bc85-565725fdfcb4 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:26.237033 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1120/2235] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:26:26.247040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25300ae-fa13-4998-a819-376b4d3ba8d5 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:26.257460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25300ae-fa13-4998-a819-376b4d3ba8d5 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:26.271594 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5795d-d8cf-4ed2-a8fa-a517f93a2314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:26.272788 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5795d-d8cf-4ed2-a8fa-a517f93a2314 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:26.273014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5795d-d8cf-4ed2-a8fa-a517f93a2314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:26.273227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5795d-d8cf-4ed2-a8fa-a517f93a2314 admin admin] PATH_INFO: `/v3/projects/a8b7f77339f6409fb2501bc1ead05a52/users/a54b8babd3a046439b56c832e821a3b1/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:26.298773 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5795d-d8cf-4ed2-a8fa-a517f93a2314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8b7f77339f6409fb2501bc1ead05a52, user_id=a54b8babd3a046439b56c832e821a3b1, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:26.303121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5795d-d8cf-4ed2-a8fa-a517f93a2314 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:26.380404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1116/2236] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:26:26 2022] PUT /identity/v3/projects/a8b7f77339f6409fb2501bc1ead05a52/users/a54b8babd3a046439b56c832e821a3b1/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:26:26.391690 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3041767-4b20-4c25-9d1e-6903799e1fc6 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:26.391985 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3041767-4b20-4c25-9d1e-6903799e1fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:26.392277 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3041767-4b20-4c25-9d1e-6903799e1fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:26.426093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-a3041767-4b20-4c25-9d1e-6903799e1fc6 None None] MFA Rules not processed for user `a54b8babd3a046439b56c832e821a3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:26:26.427431 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a3041767-4b20-4c25-9d1e-6903799e1fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:26.513054 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1121/2237] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:26:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:26:26.524325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5795d-d8cf-4ed2-a8fa-a517f93a2314 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:26.526717 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-85d5795d-d8cf-4ed2-a8fa-a517f93a2314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:26.597392 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5795d-d8cf-4ed2-a8fa-a517f93a2314 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:26.602269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab9737-9468-4b4b-a0e7-6083ba1aade8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:26.603410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab9737-9468-4b4b-a0e7-6083ba1aade8 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:26.603832 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab9737-9468-4b4b-a0e7-6083ba1aade8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:26.604151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab9737-9468-4b4b-a0e7-6083ba1aade8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:26.614518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab9737-9468-4b4b-a0e7-6083ba1aade8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:26.615948 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab9737-9468-4b4b-a0e7-6083ba1aade8 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:26.628765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1117/2238] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:26:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:26:30.019454 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3041767-4b20-4c25-9d1e-6903799e1fc6 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:30.020924 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a3041767-4b20-4c25-9d1e-6903799e1fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:30.028304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab9737-9468-4b4b-a0e7-6083ba1aade8 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:30.029833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-85ab9737-9468-4b4b-a0e7-6083ba1aade8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:30.055299 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:30.083325 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3041767-4b20-4c25-9d1e-6903799e1fc6 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:30.086983 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da28c3-a2fd-4c1a-9778-dfc22579c543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:30.087637 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da28c3-a2fd-4c1a-9778-dfc22579c543 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:30.087917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da28c3-a2fd-4c1a-9778-dfc22579c543 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:30.088194 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da28c3-a2fd-4c1a-9778-dfc22579c543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:30.089437 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab9737-9468-4b4b-a0e7-6083ba1aade8 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:30.090184 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-39da28c3-a2fd-4c1a-9778-dfc22579c543 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:30.094227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5abc9-56cf-47a2-ace9-560bdb7d1658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:30.094883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5abc9-56cf-47a2-ace9-560bdb7d1658 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:30.095168 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5abc9-56cf-47a2-ace9-560bdb7d1658 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:30.095452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5abc9-56cf-47a2-ace9-560bdb7d1658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:30.100128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da28c3-a2fd-4c1a-9778-dfc22579c543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:30.101621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da28c3-a2fd-4c1a-9778-dfc22579c543 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:30.103276 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5abc9-56cf-47a2-ace9-560bdb7d1658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:30.104865 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5abc9-56cf-47a2-ace9-560bdb7d1658 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:30.109866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1122/2239] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:26:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:26:30.110785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da28c3-a2fd-4c1a-9778-dfc22579c543 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:30.113671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1118/2240] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:26:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:26:30.119104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da28c3-a2fd-4c1a-9778-dfc22579c543 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:30.127014 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80605d-49b4-4170-a35e-61e81433aa86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:30.127887 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80605d-49b4-4170-a35e-61e81433aa86 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:30.128254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80605d-49b4-4170-a35e-61e81433aa86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:30.128880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80605d-49b4-4170-a35e-61e81433aa86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:30.138732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80605d-49b4-4170-a35e-61e81433aa86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:30.140268 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80605d-49b4-4170-a35e-61e81433aa86 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:30.149489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1123/2241] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:26:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:26:34.153850 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5abc9-56cf-47a2-ace9-560bdb7d1658 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:34.155605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ece5abc9-56cf-47a2-ace9-560bdb7d1658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:34.169775 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:34.236722 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5abc9-56cf-47a2-ace9-560bdb7d1658 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:34.243308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd8475-5e14-4257-8ee7-a876e8cd2b08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:34.244049 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd8475-5e14-4257-8ee7-a876e8cd2b08 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:34.244326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd8475-5e14-4257-8ee7-a876e8cd2b08 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:34.244689 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd8475-5e14-4257-8ee7-a876e8cd2b08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:34.248006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-49cd8475-5e14-4257-8ee7-a876e8cd2b08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:34.260084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd8475-5e14-4257-8ee7-a876e8cd2b08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:34.261891 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd8475-5e14-4257-8ee7-a876e8cd2b08 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:34.272425 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1119/2242] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:26:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:26:40.411200 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=20 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:42.625058 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80605d-49b4-4170-a35e-61e81433aa86 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:42.691672 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80605d-49b4-4170-a35e-61e81433aa86 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:42.696454 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ff8ae-aada-4be8-8418-c38b1b834ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:42.697358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ff8ae-aada-4be8-8418-c38b1b834ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:42.697646 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ff8ae-aada-4be8-8418-c38b1b834ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:42.698420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ff8ae-aada-4be8-8418-c38b1b834ad4 admin admin] PATH_INFO: `/v3/users/a54b8babd3a046439b56c832e821a3b1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:42.699639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ff8ae-aada-4be8-8418-c38b1b834ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a54b8babd3a046439b56c832e821a3b1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:42.701654 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ff8ae-aada-4be8-8418-c38b1b834ad4 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:42.885221 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-9e9ff8ae-aada-4be8-8418-c38b1b834ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a54b8babd3a046439b56c832e821a3b1'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:42.887313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-9e9ff8ae-aada-4be8-8418-c38b1b834ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a54b8babd3a046439b56c832e821a3b1'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:42.887952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-9e9ff8ae-aada-4be8-8418-c38b1b834ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a54b8babd3a046439b56c832e821a3b1'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:42.903995 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-9e9ff8ae-aada-4be8-8418-c38b1b834ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a54b8babd3a046439b56c832e821a3b1'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:42.917499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-9e9ff8ae-aada-4be8-8418-c38b1b834ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a54b8babd3a046439b56c832e821a3b1'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:42.984697 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1124/2243] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:26:42 2022] DELETE /identity/v3/users/a54b8babd3a046439b56c832e821a3b1 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:26:42.990734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f2390-a93b-4ef9-b28a-9bed2a5f1dd8 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:42.990734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f2390-a93b-4ef9-b28a-9bed2a5f1dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:42.990734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f2390-a93b-4ef9-b28a-9bed2a5f1dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:43.010228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-078f2390-a93b-4ef9-b28a-9bed2a5f1dd8 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:26:43.012375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-078f2390-a93b-4ef9-b28a-9bed2a5f1dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:43.088846 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1120/2244] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:26:43.099015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ff8ae-aada-4be8-8418-c38b1b834ad4 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:43.100765 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-9e9ff8ae-aada-4be8-8418-c38b1b834ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:43.169768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ff8ae-aada-4be8-8418-c38b1b834ad4 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:43.174035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4783a1-098f-4d76-9bd7-743d8e29c161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:43.174666 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4783a1-098f-4d76-9bd7-743d8e29c161 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:43.174948 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4783a1-098f-4d76-9bd7-743d8e29c161 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:43.175386 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4783a1-098f-4d76-9bd7-743d8e29c161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:43.201960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4783a1-098f-4d76-9bd7-743d8e29c161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:43.205335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4783a1-098f-4d76-9bd7-743d8e29c161 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:43.219709 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1125/2245] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:26:43.676231 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f2390-a93b-4ef9-b28a-9bed2a5f1dd8 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:43.677794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-078f2390-a93b-4ef9-b28a-9bed2a5f1dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:43.691761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f2390-a93b-4ef9-b28a-9bed2a5f1dd8 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:43.696949 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fcbcf-311c-49e1-9298-d0102db55133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:43.697866 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fcbcf-311c-49e1-9298-d0102db55133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:43.698342 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fcbcf-311c-49e1-9298-d0102db55133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:43.698622 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fcbcf-311c-49e1-9298-d0102db55133 admin admin] PATH_INFO: `/v3/projects/a8b7f77339f6409fb2501bc1ead05a52` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:43.699879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fcbcf-311c-49e1-9298-d0102db55133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8b7f77339f6409fb2501bc1ead05a52)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:43.701830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fcbcf-311c-49e1-9298-d0102db55133 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:43.811712 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ba2fcbcf-311c-49e1-9298-d0102db55133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8b7f77339f6409fb2501bc1ead05a52', 'request_id': 'req-ba2fcbcf-311c-49e1-9298-d0102db55133'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:43.817268 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ba2fcbcf-311c-49e1-9298-d0102db55133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8b7f77339f6409fb2501bc1ead05a52', 'request_id': 'req-ba2fcbcf-311c-49e1-9298-d0102db55133'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:43.903050 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ba2fcbcf-311c-49e1-9298-d0102db55133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8b7f77339f6409fb2501bc1ead05a52', 'request_id': 'req-ba2fcbcf-311c-49e1-9298-d0102db55133'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:43.915338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ba2fcbcf-311c-49e1-9298-d0102db55133 admin admin] The token cache is being invalidate because project a8b7f77339f6409fb2501bc1ead05a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:26:43.915627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ba2fcbcf-311c-49e1-9298-d0102db55133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:43.916267 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ba2fcbcf-311c-49e1-9298-d0102db55133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:26:43.917872 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1121/2246] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:26:43 2022] DELETE /identity/v3/projects/a8b7f77339f6409fb2501bc1ead05a52 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:26:51.746489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0ddd1-e266-4e5c-8bb8-00b3f56830b9 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:51.747031 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0ddd1-e266-4e5c-8bb8-00b3f56830b9 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:51.753204 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0ddd1-e266-4e5c-8bb8-00b3f56830b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:51.770809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-3af0ddd1-e266-4e5c-8bb8-00b3f56830b9 None None] MFA Rules not processed for user `5890e1e70ffd4e33a812691e9c43b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:26:51.771796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3af0ddd1-e266-4e5c-8bb8-00b3f56830b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:51.792987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:51.857868 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1126/2247] 10.222.0.66 () {58 vars in 1009 bytes} [Thu May 26 21:26:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:26:51.874794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fcbcf-311c-49e1-9298-d0102db55133 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:51.886100 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ba2fcbcf-311c-49e1-9298-d0102db55133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:51.902192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:51.955741 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fcbcf-311c-49e1-9298-d0102db55133 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:51.961063 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf08277-b16c-4939-a214-9f538dfce8f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6304e47844214d2db0acfae11e4714ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:51.961725 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf08277-b16c-4939-a214-9f538dfce8f6 service swift] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:51.962011 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf08277-b16c-4939-a214-9f538dfce8f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:51.962291 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf08277-b16c-4939-a214-9f538dfce8f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:51.971639 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf08277-b16c-4939-a214-9f538dfce8f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:51.973320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf08277-b16c-4939-a214-9f538dfce8f6 service swift] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:51.982324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1122/2248] 10.222.0.66 () {60 vars in 1384 bytes} [Thu May 26 21:26:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:26:54.116109 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0ddd1-e266-4e5c-8bb8-00b3f56830b9 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:26:54.118688 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3af0ddd1-e266-4e5c-8bb8-00b3f56830b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:54.299649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0ddd1-e266-4e5c-8bb8-00b3f56830b9 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:26:54.315770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fad0ed-0d97-4de0-a17a-d66b330da3ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:26:54.317400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fad0ed-0d97-4de0-a17a-d66b330da3ed service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:26:54.318079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fad0ed-0d97-4de0-a17a-d66b330da3ed service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:26:54.320604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fad0ed-0d97-4de0-a17a-d66b330da3ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:26:54.322046 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f1fad0ed-0d97-4de0-a17a-d66b330da3ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:26:54.360278 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fad0ed-0d97-4de0-a17a-d66b330da3ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:26:54.363416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fad0ed-0d97-4de0-a17a-d66b330da3ed service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:26:54.396630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1127/2249] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:26:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:27:01.476680 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf08277-b16c-4939-a214-9f538dfce8f6 service swift] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:27:01.485874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8bf08277-b16c-4939-a214-9f538dfce8f6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:27:01.529304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf08277-b16c-4939-a214-9f538dfce8f6 service swift] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:27:01.540684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c520a0-6147-4af2-8c4f-8ae4bc810ce1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:27:01.542276 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c520a0-6147-4af2-8c4f-8ae4bc810ce1 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:27:01.542898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c520a0-6147-4af2-8c4f-8ae4bc810ce1 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:27:01.550538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c520a0-6147-4af2-8c4f-8ae4bc810ce1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:27:01.555834 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-91c520a0-6147-4af2-8c4f-8ae4bc810ce1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:27:01.595437 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c520a0-6147-4af2-8c4f-8ae4bc810ce1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:27:01.602303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c520a0-6147-4af2-8c4f-8ae4bc810ce1 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:27:01.644383 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1123/2250] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:27:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:27:04.379153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=49 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:11.625166 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=30 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:32.469693 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fad0ed-0d97-4de0-a17a-d66b330da3ed service nova] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:27:32.482897 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fad0ed-0d97-4de0-a17a-d66b330da3ed service nova] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:27:32.488875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfccd3-a56e-4adc-8eb3-be6a5dc26680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:27:32.489547 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfccd3-a56e-4adc-8eb3-be6a5dc26680 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:27:32.489819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfccd3-a56e-4adc-8eb3-be6a5dc26680 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:27:32.490091 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfccd3-a56e-4adc-8eb3-be6a5dc26680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:27:32.492013 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-cacfccd3-a56e-4adc-8eb3-be6a5dc26680 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:27:32.559791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfccd3-a56e-4adc-8eb3-be6a5dc26680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:27:32.561441 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfccd3-a56e-4adc-8eb3-be6a5dc26680 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:27:32.571365 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1128/2251] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:27:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:27:42.566836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=28 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:05.094758 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c520a0-6147-4af2-8c4f-8ae4bc810ce1 service nova] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:28:05.096231 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-91c520a0-6147-4af2-8c4f-8ae4bc810ce1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:28:05.153402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c520a0-6147-4af2-8c4f-8ae4bc810ce1 service nova] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:28:05.157311 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5976376-028b-4356-b999-b1701c11fa2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:28:05.157952 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5976376-028b-4356-b999-b1701c11fa2e service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:28:05.158238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5976376-028b-4356-b999-b1701c11fa2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:28:05.158510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5976376-028b-4356-b999-b1701c11fa2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:28:05.160278 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d5976376-028b-4356-b999-b1701c11fa2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:28:05.225109 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5976376-028b-4356-b999-b1701c11fa2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:28:05.226623 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5976376-028b-4356-b999-b1701c11fa2e service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:28:05.237049 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1124/2252] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:28:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:28:08.386265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfccd3-a56e-4adc-8eb3-be6a5dc26680 service nova] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:28:08.387986 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-cacfccd3-a56e-4adc-8eb3-be6a5dc26680 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:28:08.400386 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfccd3-a56e-4adc-8eb3-be6a5dc26680 service nova] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:28:08.412103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe8e6c-695c-490a-b332-fee789c13121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:28:08.414554 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe8e6c-695c-490a-b332-fee789c13121 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:28:08.415145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe8e6c-695c-490a-b332-fee789c13121 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:28:08.418057 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe8e6c-695c-490a-b332-fee789c13121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:28:08.419622 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-41fe8e6c-695c-490a-b332-fee789c13121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:28:08.432945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe8e6c-695c-490a-b332-fee789c13121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:28:08.434705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe8e6c-695c-490a-b332-fee789c13121 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:28:08.447005 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1129/2253] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:28:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:28:08.824268 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429d1a8-33ce-49b4-b591-da09f0092e6e None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:28:08.825392 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429d1a8-33ce-49b4-b591-da09f0092e6e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:28:08.825392 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429d1a8-33ce-49b4-b591-da09f0092e6e None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:28:08.826486 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1125/2254] 10.222.0.66 () {54 vars in 921 bytes} [Thu May 26 21:28:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:28:08.832854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bac2f4-7fd6-4ae1-ae3d-6a32f165f6e1 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:28:08.833447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bac2f4-7fd6-4ae1-ae3d-6a32f165f6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:28:08.833730 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bac2f4-7fd6-4ae1-ae3d-6a32f165f6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:28:08.880172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-d3bac2f4-7fd6-4ae1-ae3d-6a32f165f6e1 None None] MFA Rules not processed for user `df008eed25464be387741ee7a1e5ce80`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:28:08.882205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d3bac2f4-7fd6-4ae1-ae3d-6a32f165f6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:28:08.894957 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1130/2255] 10.222.0.66 () {58 vars in 1018 bytes} [Thu May 26 21:28:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:28:08.910456 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429d1a8-33ce-49b4-b591-da09f0092e6e None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:28:08.917833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f429d1a8-33ce-49b4-b591-da09f0092e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:28:09.005150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429d1a8-33ce-49b4-b591-da09f0092e6e None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:28:09.008682 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2c35d-9904-4804-b34d-a8b86dd7941d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdb2d75e4025a5d73ea713c690b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:28:09.009330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2c35d-9904-4804-b34d-a8b86dd7941d service glance] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:28:09.009613 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2c35d-9904-4804-b34d-a8b86dd7941d service glance] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:28:09.009889 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2c35d-9904-4804-b34d-a8b86dd7941d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:28:09.020467 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2c35d-9904-4804-b34d-a8b86dd7941d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:28:09.021928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2c35d-9904-4804-b34d-a8b86dd7941d service glance] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:28:09.034423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1126/2256] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:28:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:28:09.262472 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbe491-e229-48f7-ab0c-cd1e3c7d664e None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:28:09.262764 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbe491-e229-48f7-ab0c-cd1e3c7d664e None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:28:09.263043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbe491-e229-48f7-ab0c-cd1e3c7d664e None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:28:09.264429 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1131/2257] 10.222.0.66 () {54 vars in 921 bytes} [Thu May 26 21:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:28:09.269611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b395f-06c9-4715-86a1-c44dd1f4464a None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:28:09.269985 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b395f-06c9-4715-86a1-c44dd1f4464a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:28:09.270272 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b395f-06c9-4715-86a1-c44dd1f4464a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:28:09.290400 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-ec4b395f-06c9-4715-86a1-c44dd1f4464a None None] MFA Rules not processed for user `98ec4e37c2714729afec6ad805ed775a`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:28:09.293491 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ec4b395f-06c9-4715-86a1-c44dd1f4464a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:28:09.299136 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1127/2258] 10.222.0.66 () {58 vars in 1018 bytes} [Thu May 26 21:28:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:28:09.310933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbe491-e229-48f7-ab0c-cd1e3c7d664e None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:28:09.321778 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbe491-e229-48f7-ab0c-cd1e3c7d664e None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:28:09.325953 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67975c-08bd-41f6-9b26-e8cb563fb70e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:28:09.326585 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67975c-08bd-41f6-9b26-e8cb563fb70e service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:28:09.326872 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67975c-08bd-41f6-9b26-e8cb563fb70e service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:28:09.327152 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67975c-08bd-41f6-9b26-e8cb563fb70e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:28:09.334366 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67975c-08bd-41f6-9b26-e8cb563fb70e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:28:09.335744 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67975c-08bd-41f6-9b26-e8cb563fb70e service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:28:09.344931 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1132/2259] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:28:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:28:09.443449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf53c54-51f7-440f-aa2a-4d8f0cd9af1a None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:28:09.443729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf53c54-51f7-440f-aa2a-4d8f0cd9af1a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:28:09.444006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf53c54-51f7-440f-aa2a-4d8f0cd9af1a None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:28:09.445446 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1128/2260] 10.222.0.66 () {54 vars in 921 bytes} [Thu May 26 21:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:28:09.451499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94cdcb-c20c-4bef-bee1-5d5449dde307 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:28:09.452027 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94cdcb-c20c-4bef-bee1-5d5449dde307 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:28:09.453050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94cdcb-c20c-4bef-bee1-5d5449dde307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:28:09.477090 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-1e94cdcb-c20c-4bef-bee1-5d5449dde307 None None] MFA Rules not processed for user `df008eed25464be387741ee7a1e5ce80`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:28:09.480403 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1e94cdcb-c20c-4bef-bee1-5d5449dde307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:28:09.490732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1133/2261] 10.222.0.66 () {58 vars in 1018 bytes} [Thu May 26 21:28:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:28:09.505910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf53c54-51f7-440f-aa2a-4d8f0cd9af1a None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:28:09.517958 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf53c54-51f7-440f-aa2a-4d8f0cd9af1a None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:28:09.521839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622f15b-ac89-46c0-877b-fa99ec2710d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:28:09.522510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622f15b-ac89-46c0-877b-fa99ec2710d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:28:09.523516 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622f15b-ac89-46c0-877b-fa99ec2710d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:28:09.523812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622f15b-ac89-46c0-877b-fa99ec2710d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:28:09.537505 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622f15b-ac89-46c0-877b-fa99ec2710d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:28:09.539000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622f15b-ac89-46c0-877b-fa99ec2710d6 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:28:09.550988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1129/2262] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:28:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:28:17.600271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94cdcb-c20c-4bef-bee1-5d5449dde307 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:28:17.614298 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94cdcb-c20c-4bef-bee1-5d5449dde307 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:28:17.623052 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f867c-1fe2-402a-a6fd-0dc742168380 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:28:17.624093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f867c-1fe2-402a-a6fd-0dc742168380 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:28:17.624606 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f867c-1fe2-402a-a6fd-0dc742168380 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:28:17.625099 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f867c-1fe2-402a-a6fd-0dc742168380 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:28:17.628144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-726f867c-1fe2-402a-a6fd-0dc742168380 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:28:17.703598 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f867c-1fe2-402a-a6fd-0dc742168380 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:28:17.705245 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f867c-1fe2-402a-a6fd-0dc742168380 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:28:17.715145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1134/2263] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:28:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:28:19.546000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=85 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:27.710111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=52 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:29:05.772997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622f15b-ac89-46c0-877b-fa99ec2710d6 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:29:05.774625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-5622f15b-ac89-46c0-877b-fa99ec2710d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:29:05.849406 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622f15b-ac89-46c0-877b-fa99ec2710d6 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:29:05.854488 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c6e01-41f0-4fc0-9a01-b9ca3ad49686 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:29:05.855150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c6e01-41f0-4fc0-9a01-b9ca3ad49686 service placement] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:29:05.855432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c6e01-41f0-4fc0-9a01-b9ca3ad49686 service placement] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:29:05.855705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c6e01-41f0-4fc0-9a01-b9ca3ad49686 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:29:05.857576 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-250c6e01-41f0-4fc0-9a01-b9ca3ad49686 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:29:05.869855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c6e01-41f0-4fc0-9a01-b9ca3ad49686 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:29:05.873763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c6e01-41f0-4fc0-9a01-b9ca3ad49686 service placement] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:29:05.882563 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1130/2264] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:29:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:29:15.878278 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=32 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:04.342410 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f867c-1fe2-402a-a6fd-0dc742168380 service nova] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:30:04.346271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-726f867c-1fe2-402a-a6fd-0dc742168380 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:30:04.408868 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f867c-1fe2-402a-a6fd-0dc742168380 service nova] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:30:04.412750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e77c1-dde5-4e8e-9a94-38af9667b525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:30:04.413425 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e77c1-dde5-4e8e-9a94-38af9667b525 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:30:04.413704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e77c1-dde5-4e8e-9a94-38af9667b525 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:30:04.413977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e77c1-dde5-4e8e-9a94-38af9667b525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:30:04.415965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-551e77c1-dde5-4e8e-9a94-38af9667b525 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:30:04.487704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e77c1-dde5-4e8e-9a94-38af9667b525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:30:04.489221 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e77c1-dde5-4e8e-9a94-38af9667b525 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:30:04.500177 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1135/2265] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:30:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:30:14.494532 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=48 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:04.772023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c6e01-41f0-4fc0-9a01-b9ca3ad49686 service placement] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:32:04.781972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c6e01-41f0-4fc0-9a01-b9ca3ad49686 service placement] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:32:04.786178 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb385ed-7b6c-4e7c-8b23-d060b7aec052 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:32:04.787428 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb385ed-7b6c-4e7c-8b23-d060b7aec052 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:32:04.794099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb385ed-7b6c-4e7c-8b23-d060b7aec052 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:32:04.794099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb385ed-7b6c-4e7c-8b23-d060b7aec052 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:32:04.794099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0fb385ed-7b6c-4e7c-8b23-d060b7aec052 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:32:04.805151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb385ed-7b6c-4e7c-8b23-d060b7aec052 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:32:04.805891 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb385ed-7b6c-4e7c-8b23-d060b7aec052 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:32:04.817636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1131/2266] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:32:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:32:04.825622 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e77c1-dde5-4e8e-9a94-38af9667b525 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:32:04.835012 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e77c1-dde5-4e8e-9a94-38af9667b525 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:32:04.838839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ef5ed-8731-456a-a8c9-00f7905decbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:32:04.839493 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ef5ed-8731-456a-a8c9-00f7905decbe service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:32:04.839775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ef5ed-8731-456a-a8c9-00f7905decbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:32:04.840055 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ef5ed-8731-456a-a8c9-00f7905decbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:32:04.842044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f17ef5ed-8731-456a-a8c9-00f7905decbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:32:04.926733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ef5ed-8731-456a-a8c9-00f7905decbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:32:04.928243 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ef5ed-8731-456a-a8c9-00f7905decbe service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:32:04.947955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1136/2267] 10.222.0.66 () {60 vars in 1396 bytes} [Thu May 26 21:32:04 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3240 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:32:05.000857 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb385ed-7b6c-4e7c-8b23-d060b7aec052 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:32:05.013074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb385ed-7b6c-4e7c-8b23-d060b7aec052 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:32:05.019066 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f7031-6f80-42cb-885a-c94eca299d13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:32:05.020325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f7031-6f80-42cb-885a-c94eca299d13 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:32:05.020325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f7031-6f80-42cb-885a-c94eca299d13 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:32:05.020325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f7031-6f80-42cb-885a-c94eca299d13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:32:05.022615 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-935f7031-6f80-42cb-885a-c94eca299d13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:32:05.056345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ef5ed-8731-456a-a8c9-00f7905decbe service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:32:05.065180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ef5ed-8731-456a-a8c9-00f7905decbe service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:32:05.072057 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02df8db-9b61-4d01-b0dd-8673ba70e7ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:32:05.072057 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02df8db-9b61-4d01-b0dd-8673ba70e7ac service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:32:05.072478 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02df8db-9b61-4d01-b0dd-8673ba70e7ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:32:05.072478 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02df8db-9b61-4d01-b0dd-8673ba70e7ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:32:05.074233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a02df8db-9b61-4d01-b0dd-8673ba70e7ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:32:05.091881 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02df8db-9b61-4d01-b0dd-8673ba70e7ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:32:05.093695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02df8db-9b61-4d01-b0dd-8673ba70e7ac service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:32:05.111068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1137/2268] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:32:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:32:05.113772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f7031-6f80-42cb-885a-c94eca299d13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:32:05.115565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f7031-6f80-42cb-885a-c94eca299d13 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:32:05.119465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02df8db-9b61-4d01-b0dd-8673ba70e7ac service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:32:05.133262 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02df8db-9b61-4d01-b0dd-8673ba70e7ac service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:32:05.137071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb29739-d58b-42c7-b349-9fe0b6295c00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:32:05.137728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb29739-d58b-42c7-b349-9fe0b6295c00 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:32:05.138003 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb29739-d58b-42c7-b349-9fe0b6295c00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:32:05.138214 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1132/2269] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:32:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:32:05.138354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb29739-d58b-42c7-b349-9fe0b6295c00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:32:05.140710 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3eb29739-d58b-42c7-b349-9fe0b6295c00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:32:05.181214 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f7031-6f80-42cb-885a-c94eca299d13 service nova] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:32:05.196309 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f7031-6f80-42cb-885a-c94eca299d13 service nova] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:32:05.202789 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cf2d5-f4ce-4a6f-9f11-85ace0bf6920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:32:05.203462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cf2d5-f4ce-4a6f-9f11-85ace0bf6920 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:32:05.220018 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cf2d5-f4ce-4a6f-9f11-85ace0bf6920 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:32:05.220018 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cf2d5-f4ce-4a6f-9f11-85ace0bf6920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:32:05.220018 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-018cf2d5-f4ce-4a6f-9f11-85ace0bf6920 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:32:05.220018 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cf2d5-f4ce-4a6f-9f11-85ace0bf6920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:32:05.221920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cf2d5-f4ce-4a6f-9f11-85ace0bf6920 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:32:05.230115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb29739-d58b-42c7-b349-9fe0b6295c00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:32:05.231586 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb29739-d58b-42c7-b349-9fe0b6295c00 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:32:05.234207 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1133/2270] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:32:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:32:05.246549 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1138/2271] 10.222.0.66 () {60 vars in 1396 bytes} [Thu May 26 21:32:05 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:32:05.283818 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cf2d5-f4ce-4a6f-9f11-85ace0bf6920 service nova] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:32:05.295961 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cf2d5-f4ce-4a6f-9f11-85ace0bf6920 service nova] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:32:05.303610 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40007221-551e-4eb1-8741-e907dee4165f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:32:05.313812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40007221-551e-4eb1-8741-e907dee4165f service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:32:05.313812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40007221-551e-4eb1-8741-e907dee4165f service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:32:05.313812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40007221-551e-4eb1-8741-e907dee4165f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:32:05.313812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-40007221-551e-4eb1-8741-e907dee4165f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:32:05.314772 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb29739-d58b-42c7-b349-9fe0b6295c00 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:32:05.325613 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb29739-d58b-42c7-b349-9fe0b6295c00 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:32:05.329977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c375869-17da-4ad2-bcf7-a5047584bcfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:32:05.330968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c375869-17da-4ad2-bcf7-a5047584bcfe service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:32:05.331254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c375869-17da-4ad2-bcf7-a5047584bcfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:32:05.331652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c375869-17da-4ad2-bcf7-a5047584bcfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:32:05.333931 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-8c375869-17da-4ad2-bcf7-a5047584bcfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:32:05.344301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c375869-17da-4ad2-bcf7-a5047584bcfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:32:05.345864 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c375869-17da-4ad2-bcf7-a5047584bcfe service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:32:05.359708 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1139/2272] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:32:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:32:05.418590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40007221-551e-4eb1-8741-e907dee4165f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:32:05.420240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40007221-551e-4eb1-8741-e907dee4165f service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:32:05.445284 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1134/2273] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:32:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:32:15.350731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=81 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:15.440838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=94 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:06.206882 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c375869-17da-4ad2-bcf7-a5047584bcfe service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:34:06.244784 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40007221-551e-4eb1-8741-e907dee4165f service nova] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:34:06.262744 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c375869-17da-4ad2-bcf7-a5047584bcfe service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:34:06.271281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24e359-27de-48e8-9762-cdbce57f9f73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:34:06.271281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24e359-27de-48e8-9762-cdbce57f9f73 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:34:06.271281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24e359-27de-48e8-9762-cdbce57f9f73 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:34:06.271281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24e359-27de-48e8-9762-cdbce57f9f73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:34:06.281253 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24e359-27de-48e8-9762-cdbce57f9f73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:34:06.283108 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24e359-27de-48e8-9762-cdbce57f9f73 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:34:06.289016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40007221-551e-4eb1-8741-e907dee4165f service nova] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:34:06.294302 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34ebf2-a83c-4b6f-af2e-3471b60b6885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:34:06.295219 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34ebf2-a83c-4b6f-af2e-3471b60b6885 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:34:06.295686 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34ebf2-a83c-4b6f-af2e-3471b60b6885 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:34:06.296130 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34ebf2-a83c-4b6f-af2e-3471b60b6885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:34:06.314469 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34ebf2-a83c-4b6f-af2e-3471b60b6885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:34:06.316421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34ebf2-a83c-4b6f-af2e-3471b60b6885 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:34:06.317113 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1140/2274] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:34:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:34:06.358700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1135/2275] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:34:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:34:11.758891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24e359-27de-48e8-9762-cdbce57f9f73 service nova] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:34:11.781904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24e359-27de-48e8-9762-cdbce57f9f73 service nova] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:34:11.787311 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92145d26-8bb2-4d92-aec8-8df0c927a4a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:34:11.788073 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92145d26-8bb2-4d92-aec8-8df0c927a4a4 service placement] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:34:11.788208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92145d26-8bb2-4d92-aec8-8df0c927a4a4 service placement] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:34:11.788477 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92145d26-8bb2-4d92-aec8-8df0c927a4a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:34:11.798008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92145d26-8bb2-4d92-aec8-8df0c927a4a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:34:11.799654 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92145d26-8bb2-4d92-aec8-8df0c927a4a4 service placement] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:34:11.810237 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1141/2276] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:34:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:34:16.352971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=25 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:21.805796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=37 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:37:21.414128 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34ebf2-a83c-4b6f-af2e-3471b60b6885 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:37:21.446091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34ebf2-a83c-4b6f-af2e-3471b60b6885 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:37:21.451518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c094d-bc65-46f7-9059-f6f9aa06e2cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:37:21.452209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c094d-bc65-46f7-9059-f6f9aa06e2cf service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:37:21.452504 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c094d-bc65-46f7-9059-f6f9aa06e2cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:37:21.452829 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c094d-bc65-46f7-9059-f6f9aa06e2cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:37:21.461676 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c094d-bc65-46f7-9059-f6f9aa06e2cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:37:21.463158 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c094d-bc65-46f7-9059-f6f9aa06e2cf service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:37:21.473301 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1136/2277] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:37:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:37:31.468496 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=10 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:06.697986 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92145d26-8bb2-4d92-aec8-8df0c927a4a4 service placement] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:38:06.708539 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92145d26-8bb2-4d92-aec8-8df0c927a4a4 service placement] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:38:06.712315 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95886a-64ca-43a3-b61c-b13ad634fb88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:38:06.713007 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95886a-64ca-43a3-b61c-b13ad634fb88 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:06.713283 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95886a-64ca-43a3-b61c-b13ad634fb88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:06.713561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95886a-64ca-43a3-b61c-b13ad634fb88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:06.723156 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95886a-64ca-43a3-b61c-b13ad634fb88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:38:06.724632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95886a-64ca-43a3-b61c-b13ad634fb88 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:38:06.734488 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1142/2278] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:38:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:38:06.785272 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c094d-bc65-46f7-9059-f6f9aa06e2cf service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:38:06.795044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c094d-bc65-46f7-9059-f6f9aa06e2cf service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:38:06.799009 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027de5f-3fc9-4825-bc6b-19edaf60e259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:38:06.799651 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027de5f-3fc9-4825-bc6b-19edaf60e259 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:06.799933 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027de5f-3fc9-4825-bc6b-19edaf60e259 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:06.800209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027de5f-3fc9-4825-bc6b-19edaf60e259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:06.873761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027de5f-3fc9-4825-bc6b-19edaf60e259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:38:06.875658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027de5f-3fc9-4825-bc6b-19edaf60e259 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:38:06.896544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1137/2279] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:38:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:38:06.903904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95886a-64ca-43a3-b61c-b13ad634fb88 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:38:06.912649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95886a-64ca-43a3-b61c-b13ad634fb88 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:38:06.916219 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dfce2-3afd-438f-8bce-29e951ccffd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:38:06.916875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dfce2-3afd-438f-8bce-29e951ccffd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:06.917157 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dfce2-3afd-438f-8bce-29e951ccffd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:06.917429 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dfce2-3afd-438f-8bce-29e951ccffd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:06.925878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5dfce2-3afd-438f-8bce-29e951ccffd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:38:06.927326 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5dfce2-3afd-438f-8bce-29e951ccffd6 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:38:06.955528 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1143/2280] 10.222.0.66 () {60 vars in 1396 bytes} [Thu May 26 21:38:06 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:38:07.001654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027de5f-3fc9-4825-bc6b-19edaf60e259 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:38:07.008767 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dfce2-3afd-438f-8bce-29e951ccffd6 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:38:07.010167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027de5f-3fc9-4825-bc6b-19edaf60e259 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:38:07.010525 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-0c5dfce2-3afd-438f-8bce-29e951ccffd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:38:07.013919 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4858c9-126b-44d7-a44f-54709681101a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:38:07.014568 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4858c9-126b-44d7-a44f-54709681101a service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:07.014852 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4858c9-126b-44d7-a44f-54709681101a service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:07.015126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4858c9-126b-44d7-a44f-54709681101a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:07.026198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4858c9-126b-44d7-a44f-54709681101a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:38:07.027697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4858c9-126b-44d7-a44f-54709681101a service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:38:07.038957 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1138/2281] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:38:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:38:07.050244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dfce2-3afd-438f-8bce-29e951ccffd6 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:38:07.055952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0d9ea-a2f7-4056-a693-d38caa65d010 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:38:07.056625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0d9ea-a2f7-4056-a693-d38caa65d010 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:07.056916 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0d9ea-a2f7-4056-a693-d38caa65d010 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:07.057198 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0d9ea-a2f7-4056-a693-d38caa65d010 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:07.066066 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0d9ea-a2f7-4056-a693-d38caa65d010 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:38:07.067655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0d9ea-a2f7-4056-a693-d38caa65d010 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:38:07.077538 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1144/2282] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:38:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:38:07.084289 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4858c9-126b-44d7-a44f-54709681101a service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:38:07.092829 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4858c9-126b-44d7-a44f-54709681101a service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:38:07.097435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ffc85-6acb-4bd2-a164-326b0b6b5489 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:38:07.098476 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ffc85-6acb-4bd2-a164-326b0b6b5489 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:07.098738 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ffc85-6acb-4bd2-a164-326b0b6b5489 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:07.099028 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ffc85-6acb-4bd2-a164-326b0b6b5489 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:07.108669 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ffc85-6acb-4bd2-a164-326b0b6b5489 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:38:07.117406 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ffc85-6acb-4bd2-a164-326b0b6b5489 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:38:07.121447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1139/2283] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:38:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:38:17.072743 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=34 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:17.117115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=53 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:23.145981 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0d9ea-a2f7-4056-a693-d38caa65d010 service nova] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:38:23.157709 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0d9ea-a2f7-4056-a693-d38caa65d010 service nova] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:38:23.165209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd7ea5-408c-4250-97f6-61a7e5f693b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:38:23.171411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd7ea5-408c-4250-97f6-61a7e5f693b9 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:23.171411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd7ea5-408c-4250-97f6-61a7e5f693b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:23.171411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd7ea5-408c-4250-97f6-61a7e5f693b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:23.176447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd7ea5-408c-4250-97f6-61a7e5f693b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:38:23.178069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd7ea5-408c-4250-97f6-61a7e5f693b9 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:38:23.217301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1145/2284] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:38:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:38:23.291878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ffc85-6acb-4bd2-a164-326b0b6b5489 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:38:23.293520 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8d7ffc85-6acb-4bd2-a164-326b0b6b5489 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:38:23.309386 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ffc85-6acb-4bd2-a164-326b0b6b5489 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:38:23.315599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09d8a6-de28-43c8-a25e-2953264f6a2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:38:23.316255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09d8a6-de28-43c8-a25e-2953264f6a2a service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:23.316540 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09d8a6-de28-43c8-a25e-2953264f6a2a service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:23.316849 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09d8a6-de28-43c8-a25e-2953264f6a2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:23.326983 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09d8a6-de28-43c8-a25e-2953264f6a2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:38:23.330677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09d8a6-de28-43c8-a25e-2953264f6a2a service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:38:23.346701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1140/2285] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:38:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:38:25.705959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9b50-92b2-4ba5-9fcb-64a08006f955 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:25.705959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9b50-92b2-4ba5-9fcb-64a08006f955 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:25.705959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9b50-92b2-4ba5-9fcb-64a08006f955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:25.797968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-bbba9b50-92b2-4ba5-9fcb-64a08006f955 None None] MFA Rules not processed for user `b3efa221fe5843cbb3671f4a3512f83b`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:38:25.797968 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-bbba9b50-92b2-4ba5-9fcb-64a08006f955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:38:25.843052 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1146/2286] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:38:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:38:26.578667 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09d8a6-de28-43c8-a25e-2953264f6a2a service nova] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:38:26.580430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-7b09d8a6-de28-43c8-a25e-2953264f6a2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:38:26.656034 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09d8a6-de28-43c8-a25e-2953264f6a2a service nova] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:38:26.660264 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91d4ca-47ed-45b9-994a-412e88cce773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:38:26.660950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91d4ca-47ed-45b9-994a-412e88cce773 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:26.661240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91d4ca-47ed-45b9-994a-412e88cce773 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:26.661646 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91d4ca-47ed-45b9-994a-412e88cce773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:26.663453 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4b91d4ca-47ed-45b9-994a-412e88cce773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:38:26.677265 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91d4ca-47ed-45b9-994a-412e88cce773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:38:26.678907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91d4ca-47ed-45b9-994a-412e88cce773 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:38:26.688325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1141/2287] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:38:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:38:26.901946 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba9b50-92b2-4ba5-9fcb-64a08006f955 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:38:26.912097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba9b50-92b2-4ba5-9fcb-64a08006f955 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:38:26.923924 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61254f57-3364-4dc6-9eb5-7595da3d404e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:38:26.924951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61254f57-3364-4dc6-9eb5-7595da3d404e service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:26.925335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61254f57-3364-4dc6-9eb5-7595da3d404e service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:26.925681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61254f57-3364-4dc6-9eb5-7595da3d404e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:26.935815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61254f57-3364-4dc6-9eb5-7595da3d404e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:38:26.939340 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61254f57-3364-4dc6-9eb5-7595da3d404e service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:38:26.950694 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1147/2288] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:38:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:38:27.395421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf9dc6-ac88-4c62-9628-1651dd201429 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:27.395800 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf9dc6-ac88-4c62-9628-1651dd201429 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:27.396141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf9dc6-ac88-4c62-9628-1651dd201429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:27.459431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-d5cf9dc6-ac88-4c62-9628-1651dd201429 None None] MFA Rules not processed for user `5890e1e70ffd4e33a812691e9c43b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:38:27.460756 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d5cf9dc6-ac88-4c62-9628-1651dd201429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:38:27.528173 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1142/2289] 10.222.0.66 () {58 vars in 967 bytes} [Thu May 26 21:38:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:38:27.680088 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61254f57-3364-4dc6-9eb5-7595da3d404e service nova] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:38:27.681804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-61254f57-3364-4dc6-9eb5-7595da3d404e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:38:27.785851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61254f57-3364-4dc6-9eb5-7595da3d404e service nova] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:38:27.794487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571d92b-d881-420c-b0e4-d294e818f3ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6304e47844214d2db0acfae11e4714ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:38:27.795149 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571d92b-d881-420c-b0e4-d294e818f3ff service swift] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:27.795432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571d92b-d881-420c-b0e4-d294e818f3ff service swift] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:27.795743 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571d92b-d881-420c-b0e4-d294e818f3ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:27.806306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571d92b-d881-420c-b0e4-d294e818f3ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:38:27.807139 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571d92b-d881-420c-b0e4-d294e818f3ff service swift] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:38:27.815499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1148/2290] 10.222.0.66 () {60 vars in 1384 bytes} [Thu May 26 21:38:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:38:30.002951 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5f406-5f83-454f-82bd-a8c8d39cbba9 None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:30.003535 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5f406-5f83-454f-82bd-a8c8d39cbba9 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:30.003535 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5f406-5f83-454f-82bd-a8c8d39cbba9 None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:30.005068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1143/2291] 10.222.0.66 () {54 vars in 912 bytes} [Thu May 26 21:38:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:38:30.010971 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d76668-d04c-4096-a6f4-30ee1ab203e1 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:30.011552 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d76668-d04c-4096-a6f4-30ee1ab203e1 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:30.011552 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d76668-d04c-4096-a6f4-30ee1ab203e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:30.045225 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:30.092390 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-38d76668-d04c-4096-a6f4-30ee1ab203e1 None None] MFA Rules not processed for user `2d68ccb9b89843078c40b13f79a72dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:38:30.093580 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-38d76668-d04c-4096-a6f4-30ee1ab203e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:38:30.104570 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1149/2292] 10.222.0.66 () {58 vars in 1009 bytes} [Thu May 26 21:38:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:38:30.130249 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5f406-5f83-454f-82bd-a8c8d39cbba9 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:38:30.147239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5f406-5f83-454f-82bd-a8c8d39cbba9 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:38:30.152682 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8b02c-c4d5-48ce-8bca-deda18a88b3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:38:30.153348 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8b02c-c4d5-48ce-8bca-deda18a88b3a service placement] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:30.153635 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8b02c-c4d5-48ce-8bca-deda18a88b3a service placement] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:30.153912 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8b02c-c4d5-48ce-8bca-deda18a88b3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:30.163117 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8b02c-c4d5-48ce-8bca-deda18a88b3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:38:30.164747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8b02c-c4d5-48ce-8bca-deda18a88b3a service placement] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:38:30.175404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1144/2293] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:38:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:38:34.224014 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6380b63-cf56-490c-8850-eafd37e6b14a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:34.224512 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6380b63-cf56-490c-8850-eafd37e6b14a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:34.224635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6380b63-cf56-490c-8850-eafd37e6b14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:34.252044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-c6380b63-cf56-490c-8850-eafd37e6b14a None None] MFA Rules not processed for user `7d524a8208354c2099eb3b41b0f53de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:38:34.253294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-c6380b63-cf56-490c-8850-eafd37e6b14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:38:34.262465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1150/2294] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:38:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:38:34.578855 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8b02c-c4d5-48ce-8bca-deda18a88b3a service placement] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:38:34.585764 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8b02c-c4d5-48ce-8bca-deda18a88b3a service placement] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:38:34.589741 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a7d7c-50c3-48ed-a36b-73e9910c7508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:38:34.590397 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a7d7c-50c3-48ed-a36b-73e9910c7508 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:34.590681 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a7d7c-50c3-48ed-a36b-73e9910c7508 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:34.590960 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a7d7c-50c3-48ed-a36b-73e9910c7508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:34.593102 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-999a7d7c-50c3-48ed-a36b-73e9910c7508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:38:34.605994 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a7d7c-50c3-48ed-a36b-73e9910c7508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:38:34.607583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a7d7c-50c3-48ed-a36b-73e9910c7508 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:38:34.617146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1145/2295] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:38:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:38:35.348895 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6380b63-cf56-490c-8850-eafd37e6b14a None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:38:35.350465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-c6380b63-cf56-490c-8850-eafd37e6b14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:38:35.366474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6380b63-cf56-490c-8850-eafd37e6b14a None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:38:35.371908 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484b599-a12d-4592-9707-2b9f1a73e4a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:38:35.372596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484b599-a12d-4592-9707-2b9f1a73e4a8 service placement] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:35.372910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484b599-a12d-4592-9707-2b9f1a73e4a8 service placement] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:35.373192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484b599-a12d-4592-9707-2b9f1a73e4a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:35.375253 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-e484b599-a12d-4592-9707-2b9f1a73e4a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:38:35.390896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484b599-a12d-4592-9707-2b9f1a73e4a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:38:35.393870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484b599-a12d-4592-9707-2b9f1a73e4a8 service placement] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:38:35.416737 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1151/2296] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:38:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:38:44.613231 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=93 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:45.323584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a7d7c-50c3-48ed-a36b-73e9910c7508 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:38:45.338044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a7d7c-50c3-48ed-a36b-73e9910c7508 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:38:45.345643 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dfbdf-4c50-4caf-a9e8-b919f4e9e291 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:38:45.346480 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dfbdf-4c50-4caf-a9e8-b919f4e9e291 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:38:45.346967 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dfbdf-4c50-4caf-a9e8-b919f4e9e291 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:38:45.347413 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dfbdf-4c50-4caf-a9e8-b919f4e9e291 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:38:45.350029 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-050dfbdf-4c50-4caf-a9e8-b919f4e9e291 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:38:45.364624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050dfbdf-4c50-4caf-a9e8-b919f4e9e291 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:38:45.366266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050dfbdf-4c50-4caf-a9e8-b919f4e9e291 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:38:45.379684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1146/2297] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:38:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:38:45.400494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=23 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:55.373406 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=6 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:05.969563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484b599-a12d-4592-9707-2b9f1a73e4a8 service placement] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:39:05.970991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-e484b599-a12d-4592-9707-2b9f1a73e4a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:39:05.994854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484b599-a12d-4592-9707-2b9f1a73e4a8 service placement] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:39:05.998632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26003d39-6d03-4142-bba8-6abb105accc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:39:05.999268 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26003d39-6d03-4142-bba8-6abb105accc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:39:05.999547 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26003d39-6d03-4142-bba8-6abb105accc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:39:05.999819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26003d39-6d03-4142-bba8-6abb105accc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:39:06.002189 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-26003d39-6d03-4142-bba8-6abb105accc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:39:06.013202 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26003d39-6d03-4142-bba8-6abb105accc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:39:06.014614 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26003d39-6d03-4142-bba8-6abb105accc9 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:39:06.024739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1152/2298] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:39:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:39:06.301848 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dfbdf-4c50-4caf-a9e8-b919f4e9e291 service nova] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:39:06.311142 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dfbdf-4c50-4caf-a9e8-b919f4e9e291 service nova] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:39:06.315499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee12ad2-aa09-41ef-aee7-da5e4d8f4466 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:39:06.316138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee12ad2-aa09-41ef-aee7-da5e4d8f4466 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:39:06.316424 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee12ad2-aa09-41ef-aee7-da5e4d8f4466 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:39:06.316752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee12ad2-aa09-41ef-aee7-da5e4d8f4466 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:39:06.318632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-dee12ad2-aa09-41ef-aee7-da5e4d8f4466 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:39:06.392519 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee12ad2-aa09-41ef-aee7-da5e4d8f4466 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:39:06.393997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee12ad2-aa09-41ef-aee7-da5e4d8f4466 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:39:06.404155 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1147/2299] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:39:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:39:16.020183 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=11 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:16.400147 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=33 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:16.715592 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26003d39-6d03-4142-bba8-6abb105accc9 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:39:16.779823 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26003d39-6d03-4142-bba8-6abb105accc9 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:39:16.785709 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb2809-3ef0-40db-8ff8-c2aa5c248b9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:39:16.786721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb2809-3ef0-40db-8ff8-c2aa5c248b9f service placement] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:39:16.787115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb2809-3ef0-40db-8ff8-c2aa5c248b9f service placement] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:39:16.787308 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb2809-3ef0-40db-8ff8-c2aa5c248b9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:39:16.789344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-86eb2809-3ef0-40db-8ff8-c2aa5c248b9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:39:16.801206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb2809-3ef0-40db-8ff8-c2aa5c248b9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:39:16.802819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb2809-3ef0-40db-8ff8-c2aa5c248b9f service placement] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:39:16.813992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1153/2300] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:39:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:39:26.809643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=32 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:42:28.405627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee12ad2-aa09-41ef-aee7-da5e4d8f4466 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:42:28.415913 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee12ad2-aa09-41ef-aee7-da5e4d8f4466 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:42:28.419684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478011d-d404-4cd6-b419-21967b149d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:42:28.420331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478011d-d404-4cd6-b419-21967b149d4f service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:42:28.420643 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478011d-d404-4cd6-b419-21967b149d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:42:28.420924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478011d-d404-4cd6-b419-21967b149d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:42:28.423821 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-9478011d-d404-4cd6-b419-21967b149d4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:42:28.432833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478011d-d404-4cd6-b419-21967b149d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:42:28.434262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478011d-d404-4cd6-b419-21967b149d4f service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:42:28.442497 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1148/2301] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:42:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:42:38.439446 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=6 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:43:06.962521 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb2809-3ef0-40db-8ff8-c2aa5c248b9f service placement] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:43:06.974287 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb2809-3ef0-40db-8ff8-c2aa5c248b9f service placement] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:43:06.980122 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48474241-1d57-414d-978b-4e5301ded999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:43:06.980783 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48474241-1d57-414d-978b-4e5301ded999 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:43:06.981062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48474241-1d57-414d-978b-4e5301ded999 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:43:06.981335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48474241-1d57-414d-978b-4e5301ded999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:43:06.983177 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-48474241-1d57-414d-978b-4e5301ded999 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:43:07.060725 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48474241-1d57-414d-978b-4e5301ded999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:43:07.062359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48474241-1d57-414d-978b-4e5301ded999 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:43:07.080679 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1154/2302] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:43:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:43:07.389699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478011d-d404-4cd6-b419-21967b149d4f service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:43:07.391325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-9478011d-d404-4cd6-b419-21967b149d4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:43:07.447342 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478011d-d404-4cd6-b419-21967b149d4f service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:43:07.450966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc943f-ac0e-4c76-b520-75b2381aa536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:43:07.451614 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc943f-ac0e-4c76-b520-75b2381aa536 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:43:07.451901 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc943f-ac0e-4c76-b520-75b2381aa536 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:43:07.452182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc943f-ac0e-4c76-b520-75b2381aa536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:43:07.454118 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-41bc943f-ac0e-4c76-b520-75b2381aa536 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:43:07.527595 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc943f-ac0e-4c76-b520-75b2381aa536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:43:07.529028 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc943f-ac0e-4c76-b520-75b2381aa536 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:43:07.537889 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1149/2303] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:43:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:43:07.676494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48474241-1d57-414d-978b-4e5301ded999 service nova] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:43:07.687764 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48474241-1d57-414d-978b-4e5301ded999 service nova] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:43:07.693625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d1d24-a803-4ea0-a102-afc27c02909e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:43:07.694271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d1d24-a803-4ea0-a102-afc27c02909e service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:43:07.694555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d1d24-a803-4ea0-a102-afc27c02909e service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:43:07.694832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d1d24-a803-4ea0-a102-afc27c02909e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:43:07.697256 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-317d1d24-a803-4ea0-a102-afc27c02909e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:43:07.779052 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d1d24-a803-4ea0-a102-afc27c02909e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:43:07.780611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d1d24-a803-4ea0-a102-afc27c02909e service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:43:07.798761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1155/2304] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:43:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:43:17.533799 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=53 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:43:17.796244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=82 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:43:23.386341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc943f-ac0e-4c76-b520-75b2381aa536 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:43:23.395092 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc943f-ac0e-4c76-b520-75b2381aa536 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:43:23.398887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87959e-a811-4bfd-a2b8-52d0cfcc7095 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:43:23.399531 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87959e-a811-4bfd-a2b8-52d0cfcc7095 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:43:23.400452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87959e-a811-4bfd-a2b8-52d0cfcc7095 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:43:23.400778 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87959e-a811-4bfd-a2b8-52d0cfcc7095 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:43:23.402667 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-aa87959e-a811-4bfd-a2b8-52d0cfcc7095 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:43:23.475084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87959e-a811-4bfd-a2b8-52d0cfcc7095 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:43:23.476508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87959e-a811-4bfd-a2b8-52d0cfcc7095 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:43:23.485722 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1150/2305] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:43:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:43:23.575930 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d1d24-a803-4ea0-a102-afc27c02909e service nova] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:43:23.586448 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d1d24-a803-4ea0-a102-afc27c02909e service nova] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:43:23.590036 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390761a0-d99b-45f1-b445-9bfab9f16001 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:43:23.590713 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390761a0-d99b-45f1-b445-9bfab9f16001 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:43:23.590992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390761a0-d99b-45f1-b445-9bfab9f16001 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:43:23.591333 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390761a0-d99b-45f1-b445-9bfab9f16001 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:43:23.593222 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-390761a0-d99b-45f1-b445-9bfab9f16001 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:43:23.677033 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390761a0-d99b-45f1-b445-9bfab9f16001 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:43:23.678495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390761a0-d99b-45f1-b445-9bfab9f16001 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:43:23.696764 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1156/2306] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:43:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:43:33.481362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=33 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:43:33.694117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=41 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:05.389728 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87959e-a811-4bfd-a2b8-52d0cfcc7095 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:44:05.398375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87959e-a811-4bfd-a2b8-52d0cfcc7095 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:44:05.401934 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a84702-a0b1-48ff-bc2d-278d6a4f01f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:44:05.402581 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a84702-a0b1-48ff-bc2d-278d6a4f01f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:44:05.402866 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a84702-a0b1-48ff-bc2d-278d6a4f01f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:44:05.403143 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a84702-a0b1-48ff-bc2d-278d6a4f01f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:44:05.411484 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a84702-a0b1-48ff-bc2d-278d6a4f01f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:44:05.412957 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a84702-a0b1-48ff-bc2d-278d6a4f01f4 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:44:05.422215 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1151/2307] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:44:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:44:05.716251 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390761a0-d99b-45f1-b445-9bfab9f16001 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:44:05.724754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390761a0-d99b-45f1-b445-9bfab9f16001 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:44:05.729084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a28594-e4c3-44bc-a245-50d83e37bbd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:44:05.729718 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a28594-e4c3-44bc-a245-50d83e37bbd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:44:05.729998 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a28594-e4c3-44bc-a245-50d83e37bbd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:44:05.730272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a28594-e4c3-44bc-a245-50d83e37bbd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:44:05.738532 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a28594-e4c3-44bc-a245-50d83e37bbd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:44:05.739953 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a28594-e4c3-44bc-a245-50d83e37bbd4 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:44:05.748976 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1157/2308] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:44:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:44:15.418201 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=6 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:15.745377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=6 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:20.689528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a84702-a0b1-48ff-bc2d-278d6a4f01f4 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:44:20.695636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-06a84702-a0b1-48ff-bc2d-278d6a4f01f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:44:20.761002 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a84702-a0b1-48ff-bc2d-278d6a4f01f4 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:44:20.766245 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63724c78-7a62-4cfd-bad6-57c877c3f87a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:44:20.766898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63724c78-7a62-4cfd-bad6-57c877c3f87a service placement] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:44:20.767183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63724c78-7a62-4cfd-bad6-57c877c3f87a service placement] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:44:20.767465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63724c78-7a62-4cfd-bad6-57c877c3f87a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:44:20.776569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63724c78-7a62-4cfd-bad6-57c877c3f87a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:44:20.778311 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63724c78-7a62-4cfd-bad6-57c877c3f87a service placement] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:44:20.788883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1152/2309] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:44:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:44:27.083375 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a28594-e4c3-44bc-a245-50d83e37bbd4 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:44:27.105053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a28594-e4c3-44bc-a245-50d83e37bbd4 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:44:27.108952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f75c3-396a-401e-a905-a0430531cfac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:44:27.109593 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f75c3-396a-401e-a905-a0430531cfac service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:44:27.109875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f75c3-396a-401e-a905-a0430531cfac service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:44:27.110150 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f75c3-396a-401e-a905-a0430531cfac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:44:27.112014 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-118f75c3-396a-401e-a905-a0430531cfac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:44:27.126535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f75c3-396a-401e-a905-a0430531cfac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:44:27.128031 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f75c3-396a-401e-a905-a0430531cfac service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:44:27.139679 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1158/2310] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:44:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:44:27.306388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63724c78-7a62-4cfd-bad6-57c877c3f87a service placement] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:44:27.316047 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63724c78-7a62-4cfd-bad6-57c877c3f87a service placement] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:44:27.320357 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03211b7-ada2-42f0-be96-9747b3a6d9c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:44:27.321051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03211b7-ada2-42f0-be96-9747b3a6d9c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:44:27.321341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03211b7-ada2-42f0-be96-9747b3a6d9c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:44:27.321617 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03211b7-ada2-42f0-be96-9747b3a6d9c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:44:27.323592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d03211b7-ada2-42f0-be96-9747b3a6d9c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:44:27.337671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03211b7-ada2-42f0-be96-9747b3a6d9c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:44:27.339111 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03211b7-ada2-42f0-be96-9747b3a6d9c7 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:44:27.350465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1153/2311] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:44:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:44:29.113617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f75c3-396a-401e-a905-a0430531cfac service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:44:29.122581 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f75c3-396a-401e-a905-a0430531cfac service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:44:29.126320 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481f6b1-86bc-46d5-8b1b-7042dada2168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:44:29.126965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481f6b1-86bc-46d5-8b1b-7042dada2168 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:44:29.127251 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481f6b1-86bc-46d5-8b1b-7042dada2168 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:44:29.127529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481f6b1-86bc-46d5-8b1b-7042dada2168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:44:29.129388 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-0481f6b1-86bc-46d5-8b1b-7042dada2168 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:44:29.213743 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481f6b1-86bc-46d5-8b1b-7042dada2168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:44:29.215295 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481f6b1-86bc-46d5-8b1b-7042dada2168 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:44:29.234465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1159/2312] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:44:33.968922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03211b7-ada2-42f0-be96-9747b3a6d9c7 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:44:33.980880 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03211b7-ada2-42f0-be96-9747b3a6d9c7 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:44:33.991785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd28c8-149b-4377-91d3-a4060a4eaba1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:44:33.992653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd28c8-149b-4377-91d3-a4060a4eaba1 service placement] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:44:33.992932 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd28c8-149b-4377-91d3-a4060a4eaba1 service placement] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:44:33.993293 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd28c8-149b-4377-91d3-a4060a4eaba1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:44:33.995290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0bdd28c8-149b-4377-91d3-a4060a4eaba1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:44:34.007187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd28c8-149b-4377-91d3-a4060a4eaba1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:44:34.009070 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd28c8-149b-4377-91d3-a4060a4eaba1 service placement] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:44:34.019259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1154/2313] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:44:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:44:38.287687 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481f6b1-86bc-46d5-8b1b-7042dada2168 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:44:38.298989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481f6b1-86bc-46d5-8b1b-7042dada2168 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:44:38.305153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9428b-27ac-4aee-82d0-d4e0c99afcec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:44:38.306066 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9428b-27ac-4aee-82d0-d4e0c99afcec service placement] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:44:38.309992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9428b-27ac-4aee-82d0-d4e0c99afcec service placement] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:44:38.309992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9428b-27ac-4aee-82d0-d4e0c99afcec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:44:38.309992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-adb9428b-27ac-4aee-82d0-d4e0c99afcec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:44:38.322699 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9428b-27ac-4aee-82d0-d4e0c99afcec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:44:38.324307 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9428b-27ac-4aee-82d0-d4e0c99afcec service placement] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:44:38.336386 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1160/2314] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:44:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:44:38.426883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd28c8-149b-4377-91d3-a4060a4eaba1 service placement] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:44:38.428363 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0bdd28c8-149b-4377-91d3-a4060a4eaba1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:44:38.442441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd28c8-149b-4377-91d3-a4060a4eaba1 service placement] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:44:38.447636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43924a60-098b-496a-85ea-5485e58366b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:44:38.448511 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43924a60-098b-496a-85ea-5485e58366b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:44:38.448825 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43924a60-098b-496a-85ea-5485e58366b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:44:38.449104 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43924a60-098b-496a-85ea-5485e58366b7 admin admin] PATH_INFO: `/v3/users/b3efa221fe5843cbb3671f4a3512f83b` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:44:38.450296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43924a60-098b-496a-85ea-5485e58366b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3efa221fe5843cbb3671f4a3512f83b)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:44:38.453488 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43924a60-098b-496a-85ea-5485e58366b7 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:44:38.646151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-43924a60-098b-496a-85ea-5485e58366b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3efa221fe5843cbb3671f4a3512f83b'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:38.718917 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-43924a60-098b-496a-85ea-5485e58366b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3efa221fe5843cbb3671f4a3512f83b'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:38.719552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-43924a60-098b-496a-85ea-5485e58366b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3efa221fe5843cbb3671f4a3512f83b'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:38.732118 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-43924a60-098b-496a-85ea-5485e58366b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3efa221fe5843cbb3671f4a3512f83b'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:38.732794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-43924a60-098b-496a-85ea-5485e58366b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3efa221fe5843cbb3671f4a3512f83b'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:38.745482 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1155/2315] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:44:38 2022] DELETE /identity/v3/users/b3efa221fe5843cbb3671f4a3512f83b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:44:38.989392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9428b-27ac-4aee-82d0-d4e0c99afcec service placement] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:44:39.000619 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9428b-27ac-4aee-82d0-d4e0c99afcec service placement] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:44:39.071532 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53afde-306d-4a17-8b48-6f53358bab10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:44:39.072752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53afde-306d-4a17-8b48-6f53358bab10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:44:39.073006 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53afde-306d-4a17-8b48-6f53358bab10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:44:39.073351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53afde-306d-4a17-8b48-6f53358bab10 admin admin] PATH_INFO: `/v3/projects/9e10dcba12ef48aa8be65c4628572c22` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:44:39.084904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53afde-306d-4a17-8b48-6f53358bab10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e10dcba12ef48aa8be65c4628572c22)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:44:39.087019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53afde-306d-4a17-8b48-6f53358bab10 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:44:39.110966 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:39.188758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1d53afde-306d-4a17-8b48-6f53358bab10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e10dcba12ef48aa8be65c4628572c22', 'request_id': 'req-1d53afde-306d-4a17-8b48-6f53358bab10'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:39.273260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1d53afde-306d-4a17-8b48-6f53358bab10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e10dcba12ef48aa8be65c4628572c22', 'request_id': 'req-1d53afde-306d-4a17-8b48-6f53358bab10'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:39.280379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1d53afde-306d-4a17-8b48-6f53358bab10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e10dcba12ef48aa8be65c4628572c22', 'request_id': 'req-1d53afde-306d-4a17-8b48-6f53358bab10'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:39.291370 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1d53afde-306d-4a17-8b48-6f53358bab10 admin admin] The token cache is being invalidate because project 9e10dcba12ef48aa8be65c4628572c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:44:39.291949 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1d53afde-306d-4a17-8b48-6f53358bab10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:39.292282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1d53afde-306d-4a17-8b48-6f53358bab10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:39.293855 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1161/2316] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:44:38 2022] DELETE /identity/v3/projects/9e10dcba12ef48aa8be65c4628572c22 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:44:39.304536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43924a60-098b-496a-85ea-5485e58366b7 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:44:39.305842 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-43924a60-098b-496a-85ea-5485e58366b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:44:39.319344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43924a60-098b-496a-85ea-5485e58366b7 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:44:39.367229 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:39.398185 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773adc26-0f8c-41a5-a82d-3507b00d9cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:44:39.398185 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773adc26-0f8c-41a5-a82d-3507b00d9cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:44:39.398185 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773adc26-0f8c-41a5-a82d-3507b00d9cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:44:39.398185 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773adc26-0f8c-41a5-a82d-3507b00d9cec admin admin] PATH_INFO: `/v3/users/ca36e7e448704171ab6253d15fe80dd4` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:44:39.399255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773adc26-0f8c-41a5-a82d-3507b00d9cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca36e7e448704171ab6253d15fe80dd4)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:44:39.401353 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773adc26-0f8c-41a5-a82d-3507b00d9cec admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:44:39.619296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-773adc26-0f8c-41a5-a82d-3507b00d9cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca36e7e448704171ab6253d15fe80dd4'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:39.707431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-773adc26-0f8c-41a5-a82d-3507b00d9cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca36e7e448704171ab6253d15fe80dd4'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:39.708048 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-773adc26-0f8c-41a5-a82d-3507b00d9cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca36e7e448704171ab6253d15fe80dd4'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:39.721410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-773adc26-0f8c-41a5-a82d-3507b00d9cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca36e7e448704171ab6253d15fe80dd4'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:39.722050 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-773adc26-0f8c-41a5-a82d-3507b00d9cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca36e7e448704171ab6253d15fe80dd4'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:39.733919 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1156/2317] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:44:39 2022] DELETE /identity/v3/users/ca36e7e448704171ab6253d15fe80dd4 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:44:39.983370 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53afde-306d-4a17-8b48-6f53358bab10 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:44:39.985112 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1d53afde-306d-4a17-8b48-6f53358bab10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:44:39.999632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53afde-306d-4a17-8b48-6f53358bab10 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:44:40.057354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34863b1-5edf-496f-b9e2-646ad593b2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:44:40.058740 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34863b1-5edf-496f-b9e2-646ad593b2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:44:40.059031 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34863b1-5edf-496f-b9e2-646ad593b2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:44:40.059309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34863b1-5edf-496f-b9e2-646ad593b2f9 admin admin] PATH_INFO: `/v3/projects/6077a9ad8129406fa21a539127ffaabc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:44:40.070265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34863b1-5edf-496f-b9e2-646ad593b2f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6077a9ad8129406fa21a539127ffaabc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:44:40.072190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34863b1-5edf-496f-b9e2-646ad593b2f9 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:44:40.175730 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-d34863b1-5edf-496f-b9e2-646ad593b2f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6077a9ad8129406fa21a539127ffaabc', 'request_id': 'req-d34863b1-5edf-496f-b9e2-646ad593b2f9'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:40.261746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-d34863b1-5edf-496f-b9e2-646ad593b2f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6077a9ad8129406fa21a539127ffaabc', 'request_id': 'req-d34863b1-5edf-496f-b9e2-646ad593b2f9'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:40.269743 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-d34863b1-5edf-496f-b9e2-646ad593b2f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6077a9ad8129406fa21a539127ffaabc', 'request_id': 'req-d34863b1-5edf-496f-b9e2-646ad593b2f9'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:40.281234 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-d34863b1-5edf-496f-b9e2-646ad593b2f9 admin admin] The token cache is being invalidate because project 6077a9ad8129406fa21a539127ffaabc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:44:40.281234 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-d34863b1-5edf-496f-b9e2-646ad593b2f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:40.282023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-d34863b1-5edf-496f-b9e2-646ad593b2f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:44:40.296658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1162/2318] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:44:39 2022] DELETE /identity/v3/projects/6077a9ad8129406fa21a539127ffaabc => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:44:49.730536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:50.277407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:DELETE=14,keystone:SELECT=70,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:46:06.429944 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773adc26-0f8c-41a5-a82d-3507b00d9cec admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:46:06.431498 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-773adc26-0f8c-41a5-a82d-3507b00d9cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:46:06.545592 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773adc26-0f8c-41a5-a82d-3507b00d9cec admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:46:06.658218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a2068-0f8a-4f34-ac69-f5dcc5d5f1f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:46:06.658218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a2068-0f8a-4f34-ac69-f5dcc5d5f1f7 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:46:06.658627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a2068-0f8a-4f34-ac69-f5dcc5d5f1f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:46:06.658816 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a2068-0f8a-4f34-ac69-f5dcc5d5f1f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:46:06.663629 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-5a0a2068-0f8a-4f34-ac69-f5dcc5d5f1f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:46:06.686512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a2068-0f8a-4f34-ac69-f5dcc5d5f1f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:46:06.693089 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a2068-0f8a-4f34-ac69-f5dcc5d5f1f7 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:46:06.718832 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1157/2319] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:46:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:46:16.698143 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=62 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:47:33.393321 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34863b1-5edf-496f-b9e2-646ad593b2f9 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:47:33.395396 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d34863b1-5edf-496f-b9e2-646ad593b2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:47:33.463171 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34863b1-5edf-496f-b9e2-646ad593b2f9 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:47:33.466810 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f96352-f840-4fea-8765-cd9ad5d9e6f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:47:33.467456 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f96352-f840-4fea-8765-cd9ad5d9e6f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:47:33.467741 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f96352-f840-4fea-8765-cd9ad5d9e6f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:47:33.468002 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f96352-f840-4fea-8765-cd9ad5d9e6f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:47:33.469871 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-80f96352-f840-4fea-8765-cd9ad5d9e6f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:47:33.479821 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f96352-f840-4fea-8765-cd9ad5d9e6f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:47:33.481353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f96352-f840-4fea-8765-cd9ad5d9e6f1 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:47:33.489379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1163/2320] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:47:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:47:43.485634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=30 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:48:06.455519 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a2068-0f8a-4f34-ac69-f5dcc5d5f1f7 service nova] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:48:06.457168 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-5a0a2068-0f8a-4f34-ac69-f5dcc5d5f1f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:48:06.471904 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a2068-0f8a-4f34-ac69-f5dcc5d5f1f7 service nova] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:48:06.477566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71a275-8169-43c0-ad12-58e28cc4671d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:48:06.478254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71a275-8169-43c0-ad12-58e28cc4671d service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:48:06.478539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71a275-8169-43c0-ad12-58e28cc4671d service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:48:06.478814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71a275-8169-43c0-ad12-58e28cc4671d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:48:06.480632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6a71a275-8169-43c0-ad12-58e28cc4671d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:48:06.541556 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71a275-8169-43c0-ad12-58e28cc4671d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:48:06.543148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71a275-8169-43c0-ad12-58e28cc4671d service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:48:06.553506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1158/2321] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:48:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:48:06.703299 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f96352-f840-4fea-8765-cd9ad5d9e6f1 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:48:06.704777 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-80f96352-f840-4fea-8765-cd9ad5d9e6f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:48:06.771272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f96352-f840-4fea-8765-cd9ad5d9e6f1 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:48:06.775072 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3cb6e-77b8-45bb-a4db-0a19cf775598 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:48:06.775758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3cb6e-77b8-45bb-a4db-0a19cf775598 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:48:06.776039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3cb6e-77b8-45bb-a4db-0a19cf775598 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:48:06.776312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3cb6e-77b8-45bb-a4db-0a19cf775598 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:48:06.778159 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-39a3cb6e-77b8-45bb-a4db-0a19cf775598 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:48:06.836160 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3cb6e-77b8-45bb-a4db-0a19cf775598 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:48:06.837615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3cb6e-77b8-45bb-a4db-0a19cf775598 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:48:06.846896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1164/2322] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:48:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:48:07.476035 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71a275-8169-43c0-ad12-58e28cc4671d service nova] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:48:07.485439 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71a275-8169-43c0-ad12-58e28cc4671d service nova] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:48:07.489088 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e393cf-be36-4fa4-b0bb-4ddd24f8116c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:48:07.489721 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e393cf-be36-4fa4-b0bb-4ddd24f8116c service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:48:07.490000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e393cf-be36-4fa4-b0bb-4ddd24f8116c service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:48:07.490274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e393cf-be36-4fa4-b0bb-4ddd24f8116c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:48:07.492048 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-42e393cf-be36-4fa4-b0bb-4ddd24f8116c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:48:07.561082 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e393cf-be36-4fa4-b0bb-4ddd24f8116c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:48:07.562595 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e393cf-be36-4fa4-b0bb-4ddd24f8116c service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:48:07.572187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1159/2323] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:48:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:48:16.842300 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=52 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:48:17.567973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=60 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:48:22.317595 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3cb6e-77b8-45bb-a4db-0a19cf775598 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:48:22.319081 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-39a3cb6e-77b8-45bb-a4db-0a19cf775598 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:48:22.385414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3cb6e-77b8-45bb-a4db-0a19cf775598 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:48:22.391785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd040c6-cf38-4cd9-b0a9-2ff768e6b5f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:48:22.392571 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd040c6-cf38-4cd9-b0a9-2ff768e6b5f0 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:48:22.393568 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd040c6-cf38-4cd9-b0a9-2ff768e6b5f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:48:22.393857 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd040c6-cf38-4cd9-b0a9-2ff768e6b5f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:48:22.395720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ddd040c6-cf38-4cd9-b0a9-2ff768e6b5f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:48:22.456715 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd040c6-cf38-4cd9-b0a9-2ff768e6b5f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:48:22.458306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd040c6-cf38-4cd9-b0a9-2ff768e6b5f0 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:48:22.468133 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1165/2324] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:48:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:48:22.744702 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e393cf-be36-4fa4-b0bb-4ddd24f8116c service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:48:22.754167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e393cf-be36-4fa4-b0bb-4ddd24f8116c service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:48:22.757822 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78891155-d3ba-404c-9ef2-ece9365fbd24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:48:22.758496 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78891155-d3ba-404c-9ef2-ece9365fbd24 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:48:22.758782 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78891155-d3ba-404c-9ef2-ece9365fbd24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:48:22.759060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78891155-d3ba-404c-9ef2-ece9365fbd24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:48:22.760851 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-78891155-d3ba-404c-9ef2-ece9365fbd24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:48:22.819585 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78891155-d3ba-404c-9ef2-ece9365fbd24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:48:22.821157 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78891155-d3ba-404c-9ef2-ece9365fbd24 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:48:22.830104 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1160/2325] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:48:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:48:32.463386 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=44 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:48:32.825898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=28 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:49:05.940078 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd040c6-cf38-4cd9-b0a9-2ff768e6b5f0 service nova] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:49:05.949735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd040c6-cf38-4cd9-b0a9-2ff768e6b5f0 service nova] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:49:05.953283 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3b209-9e0a-4672-8993-0fda07983f45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:49:05.953917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3b209-9e0a-4672-8993-0fda07983f45 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:49:05.954199 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3b209-9e0a-4672-8993-0fda07983f45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:49:05.954471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3b209-9e0a-4672-8993-0fda07983f45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:49:05.956248 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-8df3b209-9e0a-4672-8993-0fda07983f45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:49:06.023742 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3b209-9e0a-4672-8993-0fda07983f45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:49:06.025244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3b209-9e0a-4672-8993-0fda07983f45 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:49:06.042903 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1166/2326] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:49:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:49:16.040216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=36 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:49:26.656876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78891155-d3ba-404c-9ef2-ece9365fbd24 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:49:26.658302 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-78891155-d3ba-404c-9ef2-ece9365fbd24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:49:26.740741 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78891155-d3ba-404c-9ef2-ece9365fbd24 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:49:26.745695 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3866733-ff74-4b2e-95c1-eed21a0fd82a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:49:26.746481 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3866733-ff74-4b2e-95c1-eed21a0fd82a service placement] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:49:26.746768 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3866733-ff74-4b2e-95c1-eed21a0fd82a service placement] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:49:26.747044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3866733-ff74-4b2e-95c1-eed21a0fd82a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:49:26.749067 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e3866733-ff74-4b2e-95c1-eed21a0fd82a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:49:26.760340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3866733-ff74-4b2e-95c1-eed21a0fd82a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:49:26.761937 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3866733-ff74-4b2e-95c1-eed21a0fd82a service placement] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:49:26.771598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1161/2327] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:49:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:49:27.295502 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3b209-9e0a-4672-8993-0fda07983f45 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:49:27.299777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3866733-ff74-4b2e-95c1-eed21a0fd82a service placement] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:49:27.305012 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3b209-9e0a-4672-8993-0fda07983f45 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:49:27.308547 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9d83e-a540-440f-97f7-6cb339f3c399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:49:27.309141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3866733-ff74-4b2e-95c1-eed21a0fd82a service placement] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:49:27.309267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9d83e-a540-440f-97f7-6cb339f3c399 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:49:27.309473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9d83e-a540-440f-97f7-6cb339f3c399 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:49:27.309749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9d83e-a540-440f-97f7-6cb339f3c399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:49:27.311589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-e6b9d83e-a540-440f-97f7-6cb339f3c399 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:49:27.312752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f812932-8408-43e4-a2ad-540354c85ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:49:27.313394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f812932-8408-43e4-a2ad-540354c85ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:49:27.313686 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f812932-8408-43e4-a2ad-540354c85ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:49:27.314219 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f812932-8408-43e4-a2ad-540354c85ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:49:27.315964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-9f812932-8408-43e4-a2ad-540354c85ee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:49:27.324895 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9d83e-a540-440f-97f7-6cb339f3c399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:49:27.326309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9d83e-a540-440f-97f7-6cb339f3c399 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:49:27.329516 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f812932-8408-43e4-a2ad-540354c85ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:49:27.330967 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f812932-8408-43e4-a2ad-540354c85ee7 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:49:27.337842 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1167/2328] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:49:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:49:27.343330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1162/2329] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:49:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:49:37.332240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=6 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:49:37.337859 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=43 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:28.407293 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd153ce-8d3b-43ba-9d6f-76e2e73f71b3 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:28.407952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd153ce-8d3b-43ba-9d6f-76e2e73f71b3 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:28.407952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd153ce-8d3b-43ba-9d6f-76e2e73f71b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:28.475058 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-7bd153ce-8d3b-43ba-9d6f-76e2e73f71b3 None None] MFA Rules not processed for user `5890e1e70ffd4e33a812691e9c43b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:50:28.476407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-7bd153ce-8d3b-43ba-9d6f-76e2e73f71b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:50:28.547773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1168/2330] 10.222.0.66 () {58 vars in 967 bytes} [Thu May 26 21:50:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:50:28.784874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f812932-8408-43e4-a2ad-540354c85ee7 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:28.786291 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-9f812932-8408-43e4-a2ad-540354c85ee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:50:28.884041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f812932-8408-43e4-a2ad-540354c85ee7 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:28.890295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a8410-4632-4eda-b56f-42e43bdc8c33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6304e47844214d2db0acfae11e4714ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:28.893783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a8410-4632-4eda-b56f-42e43bdc8c33 service swift] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:28.893783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a8410-4632-4eda-b56f-42e43bdc8c33 service swift] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:28.893783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a8410-4632-4eda-b56f-42e43bdc8c33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:28.901038 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a8410-4632-4eda-b56f-42e43bdc8c33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:28.902773 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a8410-4632-4eda-b56f-42e43bdc8c33 service swift] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:28.914946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1163/2331] 10.222.0.66 () {60 vars in 1384 bytes} [Thu May 26 21:50:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:50:30.382350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd153ce-8d3b-43ba-9d6f-76e2e73f71b3 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:30.384425 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-7bd153ce-8d3b-43ba-9d6f-76e2e73f71b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:50:30.412704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd153ce-8d3b-43ba-9d6f-76e2e73f71b3 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:30.420086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159555a2-9b51-469d-affb-de6c643e6742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:30.420086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159555a2-9b51-469d-affb-de6c643e6742 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:30.420086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159555a2-9b51-469d-affb-de6c643e6742 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:30.420086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159555a2-9b51-469d-affb-de6c643e6742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:30.420932 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-159555a2-9b51-469d-affb-de6c643e6742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:50:30.489241 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159555a2-9b51-469d-affb-de6c643e6742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:30.490795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159555a2-9b51-469d-affb-de6c643e6742 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:30.501577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1169/2332] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:50:36.326551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a8410-4632-4eda-b56f-42e43bdc8c33 service swift] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:36.335806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a8410-4632-4eda-b56f-42e43bdc8c33 service swift] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:36.339312 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb3c29-972e-45f7-a9a7-c10826daad98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:36.339948 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb3c29-972e-45f7-a9a7-c10826daad98 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:36.340226 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb3c29-972e-45f7-a9a7-c10826daad98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:36.340501 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb3c29-972e-45f7-a9a7-c10826daad98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:36.342315 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f3fb3c29-972e-45f7-a9a7-c10826daad98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:50:36.354009 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb3c29-972e-45f7-a9a7-c10826daad98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:36.355429 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb3c29-972e-45f7-a9a7-c10826daad98 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:36.364995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1164/2333] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:50:40.072436 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159555a2-9b51-469d-affb-de6c643e6742 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:40.084322 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159555a2-9b51-469d-affb-de6c643e6742 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:40.090180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29350f-2f40-4546-b4ce-03ec6113d6c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:40.090838 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29350f-2f40-4546-b4ce-03ec6113d6c8 service placement] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:40.091160 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29350f-2f40-4546-b4ce-03ec6113d6c8 service placement] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:40.091407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29350f-2f40-4546-b4ce-03ec6113d6c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:40.093245 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-7e29350f-2f40-4546-b4ce-03ec6113d6c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:50:40.106024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29350f-2f40-4546-b4ce-03ec6113d6c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:40.107619 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29350f-2f40-4546-b4ce-03ec6113d6c8 service placement] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:40.117876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1170/2334] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:50:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:50:40.192401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb3c29-972e-45f7-a9a7-c10826daad98 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:40.193756 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f3fb3c29-972e-45f7-a9a7-c10826daad98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:50:40.207463 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb3c29-972e-45f7-a9a7-c10826daad98 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:40.212112 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca8bd1-1e5f-47ce-a28a-2e2fc442deb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:40.213701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca8bd1-1e5f-47ce-a28a-2e2fc442deb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:40.213988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca8bd1-1e5f-47ce-a28a-2e2fc442deb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:40.214267 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca8bd1-1e5f-47ce-a28a-2e2fc442deb5 admin admin] PATH_INFO: `/v3/users/23ed95370bfd46e3a1c6946701e66065` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:40.228790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca8bd1-1e5f-47ce-a28a-2e2fc442deb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ed95370bfd46e3a1c6946701e66065)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:40.230731 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca8bd1-1e5f-47ce-a28a-2e2fc442deb5 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:40.469163 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-47ca8bd1-1e5f-47ce-a28a-2e2fc442deb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ed95370bfd46e3a1c6946701e66065'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:50:40.558035 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-47ca8bd1-1e5f-47ce-a28a-2e2fc442deb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ed95370bfd46e3a1c6946701e66065'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:50:40.558945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-47ca8bd1-1e5f-47ce-a28a-2e2fc442deb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ed95370bfd46e3a1c6946701e66065'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:50:40.571710 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-47ca8bd1-1e5f-47ce-a28a-2e2fc442deb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ed95370bfd46e3a1c6946701e66065'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:50:40.572403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-47ca8bd1-1e5f-47ce-a28a-2e2fc442deb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ed95370bfd46e3a1c6946701e66065'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:50:40.585006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1165/2335] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:50:40 2022] DELETE /identity/v3/users/23ed95370bfd46e3a1c6946701e66065 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:50:40.928346 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29350f-2f40-4546-b4ce-03ec6113d6c8 service placement] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:40.945220 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29350f-2f40-4546-b4ce-03ec6113d6c8 service placement] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:40.987483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:41.013674 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fb99e-fe62-4c10-9aa7-a3c14a56684d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:41.014473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fb99e-fe62-4c10-9aa7-a3c14a56684d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:41.014756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fb99e-fe62-4c10-9aa7-a3c14a56684d admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:41.015034 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fb99e-fe62-4c10-9aa7-a3c14a56684d admin admin] PATH_INFO: `/v3/projects/9be77e3090ea4348b5686ebf62749f38` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:41.016245 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fb99e-fe62-4c10-9aa7-a3c14a56684d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be77e3090ea4348b5686ebf62749f38)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:41.018217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fb99e-fe62-4c10-9aa7-a3c14a56684d admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:41.178318 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-528fb99e-fe62-4c10-9aa7-a3c14a56684d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be77e3090ea4348b5686ebf62749f38', 'request_id': 'req-528fb99e-fe62-4c10-9aa7-a3c14a56684d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:50:41.383665 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-528fb99e-fe62-4c10-9aa7-a3c14a56684d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be77e3090ea4348b5686ebf62749f38', 'request_id': 'req-528fb99e-fe62-4c10-9aa7-a3c14a56684d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:50:41.390379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-528fb99e-fe62-4c10-9aa7-a3c14a56684d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be77e3090ea4348b5686ebf62749f38', 'request_id': 'req-528fb99e-fe62-4c10-9aa7-a3c14a56684d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:50:41.402204 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-528fb99e-fe62-4c10-9aa7-a3c14a56684d admin admin] The token cache is being invalidate because project 9be77e3090ea4348b5686ebf62749f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:50:41.402496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-528fb99e-fe62-4c10-9aa7-a3c14a56684d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:50:41.403157 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-528fb99e-fe62-4c10-9aa7-a3c14a56684d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:50:41.405138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1171/2336] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:50:40 2022] DELETE /identity/v3/projects/9be77e3090ea4348b5686ebf62749f38 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:50:41.410926 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1cbe5-8dce-47a7-9a0b-c064bd10e9c5 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:41.411476 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1cbe5-8dce-47a7-9a0b-c064bd10e9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:41.411724 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1cbe5-8dce-47a7-9a0b-c064bd10e9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:41.434364 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:41.470147 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-78a1cbe5-8dce-47a7-9a0b-c064bd10e9c5 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:50:41.471377 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-78a1cbe5-8dce-47a7-9a0b-c064bd10e9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:50:41.533397 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1166/2337] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:50:41.541755 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a40bfc-31e7-464a-8e83-fe7436ee2f6a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:41.542037 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a40bfc-31e7-464a-8e83-fe7436ee2f6a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:41.542313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a40bfc-31e7-464a-8e83-fe7436ee2f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:41.561246 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-e3a40bfc-31e7-464a-8e83-fe7436ee2f6a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:50:41.562490 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-e3a40bfc-31e7-464a-8e83-fe7436ee2f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:50:41.570415 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1172/2338] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:50:41.574728 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1cbe5-8dce-47a7-9a0b-c064bd10e9c5 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:41.585192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1cbe5-8dce-47a7-9a0b-c064bd10e9c5 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:41.591337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a82306-9e0c-46df-8643-6cc4d904ca9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:41.592002 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a82306-9e0c-46df-8643-6cc4d904ca9e admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:41.592287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a82306-9e0c-46df-8643-6cc4d904ca9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:41.592562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a82306-9e0c-46df-8643-6cc4d904ca9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:41.593334 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a82306-9e0c-46df-8643-6cc4d904ca9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:50:41.600094 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a82306-9e0c-46df-8643-6cc4d904ca9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:41.600094 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a82306-9e0c-46df-8643-6cc4d904ca9e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:41.611502 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1167/2339] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:50:41.612670 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a40bfc-31e7-464a-8e83-fe7436ee2f6a None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:41.622923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a40bfc-31e7-464a-8e83-fe7436ee2f6a None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:41.628011 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72752fe-f4d5-4351-9c11-bed8f1db298e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:41.628704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72752fe-f4d5-4351-9c11-bed8f1db298e admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:41.628985 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72752fe-f4d5-4351-9c11-bed8f1db298e admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:41.629265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72752fe-f4d5-4351-9c11-bed8f1db298e admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:41.629994 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72752fe-f4d5-4351-9c11-bed8f1db298e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:41.631969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72752fe-f4d5-4351-9c11-bed8f1db298e admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:41.793273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1173/2340] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:50:41 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:50:41.797199 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a82306-9e0c-46df-8643-6cc4d904ca9e admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:41.807380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a82306-9e0c-46df-8643-6cc4d904ca9e admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:41.863528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed54ee-414a-4360-af6f-c600e728f821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:41.864364 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed54ee-414a-4360-af6f-c600e728f821 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:41.864609 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed54ee-414a-4360-af6f-c600e728f821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:41.864927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed54ee-414a-4360-af6f-c600e728f821 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:41.865631 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed54ee-414a-4360-af6f-c600e728f821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:41.867539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed54ee-414a-4360-af6f-c600e728f821 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:41.969552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1168/2341] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:50:41 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:50:41.974864 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72752fe-f4d5-4351-9c11-bed8f1db298e admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:41.985801 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72752fe-f4d5-4351-9c11-bed8f1db298e admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:41.991143 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731dfad-3c7f-4a0c-ac06-24bce0cc8f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:41.991671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731dfad-3c7f-4a0c-ac06-24bce0cc8f17 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:41.993268 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731dfad-3c7f-4a0c-ac06-24bce0cc8f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:41.993268 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731dfad-3c7f-4a0c-ac06-24bce0cc8f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:41.993268 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731dfad-3c7f-4a0c-ac06-24bce0cc8f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:41.994527 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731dfad-3c7f-4a0c-ac06-24bce0cc8f17 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:42.005466 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1174/2342] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:50:42.009397 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed54ee-414a-4360-af6f-c600e728f821 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:42.020121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed54ee-414a-4360-af6f-c600e728f821 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:42.024834 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fa122-25fc-4f1b-8a3c-5755023ba6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:42.025503 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fa122-25fc-4f1b-8a3c-5755023ba6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:42.026365 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fa122-25fc-4f1b-8a3c-5755023ba6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:42.026648 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fa122-25fc-4f1b-8a3c-5755023ba6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:42.027385 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fa122-25fc-4f1b-8a3c-5755023ba6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:42.029018 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fa122-25fc-4f1b-8a3c-5755023ba6b1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:42.039255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1169/2343] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:50:42.043517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731dfad-3c7f-4a0c-ac06-24bce0cc8f17 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:42.053640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731dfad-3c7f-4a0c-ac06-24bce0cc8f17 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:42.058765 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d9592-43cb-4b8c-81ec-b7132ac6a71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:42.059652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d9592-43cb-4b8c-81ec-b7132ac6a71d admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:42.059932 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d9592-43cb-4b8c-81ec-b7132ac6a71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:42.060207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d9592-43cb-4b8c-81ec-b7132ac6a71d admin admin] PATH_INFO: `/v3/projects/75c30fdf12c04987a7099a21b1ef4a8c/users/88409716fa9b42bb9f054a391e4caabc/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:42.076037 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d9592-43cb-4b8c-81ec-b7132ac6a71d admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c30fdf12c04987a7099a21b1ef4a8c, user_id=88409716fa9b42bb9f054a391e4caabc, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:42.078714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d9592-43cb-4b8c-81ec-b7132ac6a71d admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:42.146354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1175/2344] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:50:42 2022] PUT /identity/v3/projects/75c30fdf12c04987a7099a21b1ef4a8c/users/88409716fa9b42bb9f054a391e4caabc/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:50:42.164837 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457aa5df-64aa-49a3-8e90-030332dc01b0 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:42.165129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457aa5df-64aa-49a3-8e90-030332dc01b0 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:42.165411 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457aa5df-64aa-49a3-8e90-030332dc01b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:42.192341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-457aa5df-64aa-49a3-8e90-030332dc01b0 None None] MFA Rules not processed for user `88409716fa9b42bb9f054a391e4caabc`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:50:42.193952 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-457aa5df-64aa-49a3-8e90-030332dc01b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:50:42.235749 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:42.258611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1170/2345] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:50:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:50:42.263617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d9592-43cb-4b8c-81ec-b7132ac6a71d admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:42.314487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:42.326075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d9592-43cb-4b8c-81ec-b7132ac6a71d admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:42.330715 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06595a-0fee-4b18-9d9d-d450386b7d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:42.331370 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06595a-0fee-4b18-9d9d-d450386b7d2b admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:42.331646 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06595a-0fee-4b18-9d9d-d450386b7d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:42.331921 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06595a-0fee-4b18-9d9d-d450386b7d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:42.332630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06595a-0fee-4b18-9d9d-d450386b7d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:42.334510 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06595a-0fee-4b18-9d9d-d450386b7d2b admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:42.419567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1176/2346] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:50:42 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:50:42.423594 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457aa5df-64aa-49a3-8e90-030332dc01b0 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:42.434799 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457aa5df-64aa-49a3-8e90-030332dc01b0 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:42.495048 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9f9a2-0e8c-4520-892b-8f80822118af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:42.495641 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9f9a2-0e8c-4520-892b-8f80822118af admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:42.495923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9f9a2-0e8c-4520-892b-8f80822118af admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:42.496451 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9f9a2-0e8c-4520-892b-8f80822118af admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:42.497184 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9f9a2-0e8c-4520-892b-8f80822118af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:42.499120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9f9a2-0e8c-4520-892b-8f80822118af admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:42.664119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1171/2347] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:50:42 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:50:42.668827 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06595a-0fee-4b18-9d9d-d450386b7d2b admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:42.679207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06595a-0fee-4b18-9d9d-d450386b7d2b admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:42.684276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f3ba5-208c-4e95-93b5-6576f9bcd0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:42.685023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f3ba5-208c-4e95-93b5-6576f9bcd0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:42.685309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f3ba5-208c-4e95-93b5-6576f9bcd0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:42.685586 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f3ba5-208c-4e95-93b5-6576f9bcd0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:42.686312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f3ba5-208c-4e95-93b5-6576f9bcd0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:42.687949 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f3ba5-208c-4e95-93b5-6576f9bcd0e1 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:42.698392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1177/2348] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:50:42.702663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9f9a2-0e8c-4520-892b-8f80822118af admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:42.712764 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9f9a2-0e8c-4520-892b-8f80822118af admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:42.717475 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a61a5-8a8e-465d-8e61-a95511d509cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:42.718139 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a61a5-8a8e-465d-8e61-a95511d509cb admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:42.718428 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a61a5-8a8e-465d-8e61-a95511d509cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:42.718711 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a61a5-8a8e-465d-8e61-a95511d509cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:42.719446 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a61a5-8a8e-465d-8e61-a95511d509cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:42.721103 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a61a5-8a8e-465d-8e61-a95511d509cb admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:42.731671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1172/2349] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:50:42.736045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f3ba5-208c-4e95-93b5-6576f9bcd0e1 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:42.746917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f3ba5-208c-4e95-93b5-6576f9bcd0e1 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:42.751468 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d7fe7-5610-4e2e-86f3-9e014d962a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:42.752341 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d7fe7-5610-4e2e-86f3-9e014d962a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:42.752655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d7fe7-5610-4e2e-86f3-9e014d962a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:42.752937 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d7fe7-5610-4e2e-86f3-9e014d962a5d admin admin] PATH_INFO: `/v3/projects/32157cc5ee134c52a2943e791362156d/users/941088ce03bd4694b3c473ce022b73ac/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:42.767085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d7fe7-5610-4e2e-86f3-9e014d962a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32157cc5ee134c52a2943e791362156d, user_id=941088ce03bd4694b3c473ce022b73ac, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:42.769792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d7fe7-5610-4e2e-86f3-9e014d962a5d admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:42.846237 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1178/2350] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:50:42 2022] PUT /identity/v3/projects/32157cc5ee134c52a2943e791362156d/users/941088ce03bd4694b3c473ce022b73ac/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:50:42.857099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3efb12-e383-4118-9ff5-774df38da20c None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:42.861376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3efb12-e383-4118-9ff5-774df38da20c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:42.861376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3efb12-e383-4118-9ff5-774df38da20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:42.883926 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-6b3efb12-e383-4118-9ff5-774df38da20c None None] MFA Rules not processed for user `941088ce03bd4694b3c473ce022b73ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:50:42.890047 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6b3efb12-e383-4118-9ff5-774df38da20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:50:42.949172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1173/2351] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:50:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:50:42.953665 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d7fe7-5610-4e2e-86f3-9e014d962a5d admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:43.013268 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d7fe7-5610-4e2e-86f3-9e014d962a5d admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:43.017916 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283c6ed-0c76-4ddf-ba0b-a14be917f6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:43.018563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283c6ed-0c76-4ddf-ba0b-a14be917f6dd admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:43.018843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283c6ed-0c76-4ddf-ba0b-a14be917f6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:43.019118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283c6ed-0c76-4ddf-ba0b-a14be917f6dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:43.019805 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283c6ed-0c76-4ddf-ba0b-a14be917f6dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:43.021731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283c6ed-0c76-4ddf-ba0b-a14be917f6dd admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:43.104676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1179/2352] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:50:42 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:50:43.108994 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3efb12-e383-4118-9ff5-774df38da20c None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:43.120234 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3efb12-e383-4118-9ff5-774df38da20c None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:43.167973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:43.177443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7115066-60c3-4354-81f6-aca5a7c0f6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:43.178124 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7115066-60c3-4354-81f6-aca5a7c0f6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:43.178412 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7115066-60c3-4354-81f6-aca5a7c0f6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:43.178694 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7115066-60c3-4354-81f6-aca5a7c0f6b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:43.179388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7115066-60c3-4354-81f6-aca5a7c0f6b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:43.181341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7115066-60c3-4354-81f6-aca5a7c0f6b9 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:43.237277 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1174/2353] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:50:43 2022] POST /identity/v3/users => generated 300 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:50:43.241355 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283c6ed-0c76-4ddf-ba0b-a14be917f6dd admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:43.252646 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283c6ed-0c76-4ddf-ba0b-a14be917f6dd admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:43.257474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b7075-b3cd-4fc7-a042-0d16065cb94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:43.258329 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b7075-b3cd-4fc7-a042-0d16065cb94c admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:43.258616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b7075-b3cd-4fc7-a042-0d16065cb94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:43.258900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b7075-b3cd-4fc7-a042-0d16065cb94c admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:43.259759 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b7075-b3cd-4fc7-a042-0d16065cb94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:43.261470 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b7075-b3cd-4fc7-a042-0d16065cb94c admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:43.273267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1180/2354] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:50:43.277769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7115066-60c3-4354-81f6-aca5a7c0f6b9 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:43.287845 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7115066-60c3-4354-81f6-aca5a7c0f6b9 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:43.293052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1838bbe-5444-4621-91c4-bd06f1b0ba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:43.294085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1838bbe-5444-4621-91c4-bd06f1b0ba53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:43.294373 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1838bbe-5444-4621-91c4-bd06f1b0ba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:43.294651 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1838bbe-5444-4621-91c4-bd06f1b0ba53 admin admin] PATH_INFO: `/v3/projects/8615d6d8c9334b95aab71d4bdeb2bcbb/users/e6df6b17303446e09cdd3bb1cbf42716/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:43.310061 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1838bbe-5444-4621-91c4-bd06f1b0ba53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8615d6d8c9334b95aab71d4bdeb2bcbb, user_id=e6df6b17303446e09cdd3bb1cbf42716, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:43.312710 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1838bbe-5444-4621-91c4-bd06f1b0ba53 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:43.409024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1175/2355] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:50:43 2022] PUT /identity/v3/projects/8615d6d8c9334b95aab71d4bdeb2bcbb/users/e6df6b17303446e09cdd3bb1cbf42716/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:50:43.413107 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b7075-b3cd-4fc7-a042-0d16065cb94c admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:43.423549 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b7075-b3cd-4fc7-a042-0d16065cb94c admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:43.479644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e399d7-0dd6-459b-a08f-bb7e79c3a2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:43.480375 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e399d7-0dd6-459b-a08f-bb7e79c3a2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:43.480621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e399d7-0dd6-459b-a08f-bb7e79c3a2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:43.480906 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e399d7-0dd6-459b-a08f-bb7e79c3a2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:43.481636 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e399d7-0dd6-459b-a08f-bb7e79c3a2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:43.483238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e399d7-0dd6-459b-a08f-bb7e79c3a2bf admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:43.493426 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1181/2356] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:50:43.498553 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1838bbe-5444-4621-91c4-bd06f1b0ba53 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:50:43.509274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1838bbe-5444-4621-91c4-bd06f1b0ba53 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:50:43.514308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f00c2-ec04-4a90-805e-add0fc5211e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:50:43.515195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f00c2-ec04-4a90-805e-add0fc5211e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:43.515483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f00c2-ec04-4a90-805e-add0fc5211e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:43.515761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f00c2-ec04-4a90-805e-add0fc5211e7 admin admin] PATH_INFO: `/v3/projects/8615d6d8c9334b95aab71d4bdeb2bcbb/users/e6df6b17303446e09cdd3bb1cbf42716/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:43.517783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f00c2-ec04-4a90-805e-add0fc5211e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8615d6d8c9334b95aab71d4bdeb2bcbb, user_id=e6df6b17303446e09cdd3bb1cbf42716, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:50:43.524734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f00c2-ec04-4a90-805e-add0fc5211e7 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:50:43.530800 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1176/2357] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:50:43 2022] PUT /identity/v3/projects/8615d6d8c9334b95aab71d4bdeb2bcbb/users/e6df6b17303446e09cdd3bb1cbf42716/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:50:43.542707 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bf57c-01fc-44ca-b9c5-078e5000f90f None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:50:43.543000 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bf57c-01fc-44ca-b9c5-078e5000f90f None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:50:43.543310 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bf57c-01fc-44ca-b9c5-078e5000f90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:50:43.563526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:43.571864 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-dc3bf57c-01fc-44ca-b9c5-078e5000f90f None None] MFA Rules not processed for user `e6df6b17303446e09cdd3bb1cbf42716`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:50:43.574016 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-dc3bf57c-01fc-44ca-b9c5-078e5000f90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:50:43.649865 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1182/2358] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:50:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:50:53.527045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=21,keystone:INSERT=5 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:53.697651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=29 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:52:08.146429 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f00c2-ec04-4a90-805e-add0fc5211e7 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:52:08.150407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-db4f00c2-ec04-4a90-805e-add0fc5211e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:52:08.222023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f00c2-ec04-4a90-805e-add0fc5211e7 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:52:08.225998 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cac108-2b95-4efa-a4c6-5cd4eb591998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:52:08.226662 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cac108-2b95-4efa-a4c6-5cd4eb591998 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:52:08.226955 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cac108-2b95-4efa-a4c6-5cd4eb591998 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:52:08.228341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cac108-2b95-4efa-a4c6-5cd4eb591998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:52:08.239176 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cac108-2b95-4efa-a4c6-5cd4eb591998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:52:08.240759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cac108-2b95-4efa-a4c6-5cd4eb591998 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:52:08.251214 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1177/2359] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:52:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:52:10.214349 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bf57c-01fc-44ca-b9c5-078e5000f90f None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:52:10.215832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-dc3bf57c-01fc-44ca-b9c5-078e5000f90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:52:10.299679 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bf57c-01fc-44ca-b9c5-078e5000f90f None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:52:10.305502 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bb765-eb73-4bfd-aa11-63be5490628b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:52:10.306560 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bb765-eb73-4bfd-aa11-63be5490628b service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:52:10.306965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bb765-eb73-4bfd-aa11-63be5490628b service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:52:10.307904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bb765-eb73-4bfd-aa11-63be5490628b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:52:10.309974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-489bb765-eb73-4bfd-aa11-63be5490628b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:52:10.323325 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bb765-eb73-4bfd-aa11-63be5490628b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:52:10.325138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bb765-eb73-4bfd-aa11-63be5490628b service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:52:10.337517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1183/2360] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:52:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:52:18.246674 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=31 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:52:20.332698 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=34 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:53:07.481376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cac108-2b95-4efa-a4c6-5cd4eb591998 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:53:07.494391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cac108-2b95-4efa-a4c6-5cd4eb591998 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:53:07.499851 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac265ca-6819-4055-9cac-8cc08d958796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:53:07.500499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac265ca-6819-4055-9cac-8cc08d958796 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:53:07.500822 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac265ca-6819-4055-9cac-8cc08d958796 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:53:07.501104 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac265ca-6819-4055-9cac-8cc08d958796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:53:07.503035 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3ac265ca-6819-4055-9cac-8cc08d958796 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:53:07.535877 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bb765-eb73-4bfd-aa11-63be5490628b service nova] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:53:07.537701 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-489bb765-eb73-4bfd-aa11-63be5490628b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:53:07.551070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bb765-eb73-4bfd-aa11-63be5490628b service nova] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:53:07.557948 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4bdc0-08b2-4132-9ed3-71ea3aed7b64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:53:07.558611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4bdc0-08b2-4132-9ed3-71ea3aed7b64 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:53:07.558894 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4bdc0-08b2-4132-9ed3-71ea3aed7b64 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:53:07.559242 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4bdc0-08b2-4132-9ed3-71ea3aed7b64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:53:07.561102 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-72b4bdc0-08b2-4132-9ed3-71ea3aed7b64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:53:07.565780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac265ca-6819-4055-9cac-8cc08d958796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:53:07.567390 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac265ca-6819-4055-9cac-8cc08d958796 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:53:07.581606 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1178/2361] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:53:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:53:07.650054 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4bdc0-08b2-4132-9ed3-71ea3aed7b64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:53:07.651660 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4bdc0-08b2-4132-9ed3-71ea3aed7b64 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:53:07.672713 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1184/2362] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:53:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:53:17.578193 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=28 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:53:17.668705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=41 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:54:27.366194 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac265ca-6819-4055-9cac-8cc08d958796 service nova] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:54:27.367660 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3ac265ca-6819-4055-9cac-8cc08d958796 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:54:27.441514 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac265ca-6819-4055-9cac-8cc08d958796 service nova] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:54:27.445072 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856f3bd-c3f9-4078-a962-f8bf650b8336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:54:27.445708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856f3bd-c3f9-4078-a962-f8bf650b8336 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:54:27.445989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856f3bd-c3f9-4078-a962-f8bf650b8336 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:54:27.446263 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856f3bd-c3f9-4078-a962-f8bf650b8336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:54:27.448006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8856f3bd-c3f9-4078-a962-f8bf650b8336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:54:27.480659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856f3bd-c3f9-4078-a962-f8bf650b8336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:54:27.482029 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856f3bd-c3f9-4078-a962-f8bf650b8336 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:54:27.494015 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1179/2363] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:54:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:54:28.358284 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4bdc0-08b2-4132-9ed3-71ea3aed7b64 service nova] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:54:28.377028 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4bdc0-08b2-4132-9ed3-71ea3aed7b64 service nova] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:54:28.380603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d3dac-4612-4be9-ab21-a921ad80f641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:54:28.381255 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d3dac-4612-4be9-ab21-a921ad80f641 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:54:28.381533 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d3dac-4612-4be9-ab21-a921ad80f641 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:54:28.381828 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d3dac-4612-4be9-ab21-a921ad80f641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:54:28.383555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-556d3dac-4612-4be9-ab21-a921ad80f641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:54:28.397390 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d3dac-4612-4be9-ab21-a921ad80f641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:54:28.398811 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d3dac-4612-4be9-ab21-a921ad80f641 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:54:28.410291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1185/2364] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:54:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:54:30.216989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856f3bd-c3f9-4078-a962-f8bf650b8336 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:54:30.218689 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8856f3bd-c3f9-4078-a962-f8bf650b8336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:54:30.230528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856f3bd-c3f9-4078-a962-f8bf650b8336 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:54:30.234177 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcaede4-051d-4701-99bb-33620c06a963 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:54:30.234825 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcaede4-051d-4701-99bb-33620c06a963 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:54:30.235118 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcaede4-051d-4701-99bb-33620c06a963 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:54:30.235417 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcaede4-051d-4701-99bb-33620c06a963 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:54:30.237790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1dcaede4-051d-4701-99bb-33620c06a963 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:54:30.317341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcaede4-051d-4701-99bb-33620c06a963 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:54:30.318779 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcaede4-051d-4701-99bb-33620c06a963 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:54:30.337057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1180/2365] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:54:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:54:30.382815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d3dac-4612-4be9-ab21-a921ad80f641 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:54:30.392070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d3dac-4612-4be9-ab21-a921ad80f641 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:54:30.396685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed935a8c-4514-41a0-8d9c-08b919c0972b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:54:30.397334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed935a8c-4514-41a0-8d9c-08b919c0972b service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:54:30.401782 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed935a8c-4514-41a0-8d9c-08b919c0972b service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:54:30.401782 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed935a8c-4514-41a0-8d9c-08b919c0972b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:54:30.401782 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ed935a8c-4514-41a0-8d9c-08b919c0972b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:54:30.480789 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed935a8c-4514-41a0-8d9c-08b919c0972b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:54:30.482148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed935a8c-4514-41a0-8d9c-08b919c0972b service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:54:30.501372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1186/2366] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:54:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:54:31.887224 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcaede4-051d-4701-99bb-33620c06a963 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:54:31.888710 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1dcaede4-051d-4701-99bb-33620c06a963 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:54:31.923829 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:54:31.966092 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcaede4-051d-4701-99bb-33620c06a963 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:54:31.971312 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db13a5-b48c-4b65-a86e-5f974a1125b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:54:31.972003 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db13a5-b48c-4b65-a86e-5f974a1125b6 service placement] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:54:31.972438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db13a5-b48c-4b65-a86e-5f974a1125b6 service placement] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:54:31.973083 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db13a5-b48c-4b65-a86e-5f974a1125b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:54:31.974861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-86db13a5-b48c-4b65-a86e-5f974a1125b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:54:31.986062 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db13a5-b48c-4b65-a86e-5f974a1125b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:54:31.988128 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db13a5-b48c-4b65-a86e-5f974a1125b6 service placement] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:54:31.998051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1181/2367] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:54:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:54:40.498471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=52 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:54:41.993931 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=21 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:56:08.948447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed935a8c-4514-41a0-8d9c-08b919c0972b service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:56:08.957550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed935a8c-4514-41a0-8d9c-08b919c0972b service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:56:08.961109 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576e87d-1706-4b0a-8371-5b02451a1d7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:56:08.961749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576e87d-1706-4b0a-8371-5b02451a1d7d service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:56:08.962032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576e87d-1706-4b0a-8371-5b02451a1d7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:56:08.962309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576e87d-1706-4b0a-8371-5b02451a1d7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:56:08.964042 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f576e87d-1706-4b0a-8371-5b02451a1d7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:56:09.042523 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576e87d-1706-4b0a-8371-5b02451a1d7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:56:09.043957 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576e87d-1706-4b0a-8371-5b02451a1d7d service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:56:09.061603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1187/2368] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:56:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:56:19.058925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=41 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:56:29.175680 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db13a5-b48c-4b65-a86e-5f974a1125b6 service placement] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:56:29.190527 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db13a5-b48c-4b65-a86e-5f974a1125b6 service placement] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:56:29.196623 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7b2aa-ab89-44bd-ae4d-d52e5484f0c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:56:29.197525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7b2aa-ab89-44bd-ae4d-d52e5484f0c0 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:56:29.197880 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7b2aa-ab89-44bd-ae4d-d52e5484f0c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:56:29.198247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7b2aa-ab89-44bd-ae4d-d52e5484f0c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:56:29.200226 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-fee7b2aa-ab89-44bd-ae4d-d52e5484f0c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:56:29.217644 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7b2aa-ab89-44bd-ae4d-d52e5484f0c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:56:29.219829 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7b2aa-ab89-44bd-ae4d-d52e5484f0c0 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:56:29.231262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1182/2369] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:56:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:56:29.315692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576e87d-1706-4b0a-8371-5b02451a1d7d service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:56:29.326282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576e87d-1706-4b0a-8371-5b02451a1d7d service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:56:29.330947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ffa0d-994c-43ec-b418-637d6abba5a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:56:29.331585 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ffa0d-994c-43ec-b418-637d6abba5a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:56:29.331884 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ffa0d-994c-43ec-b418-637d6abba5a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:56:29.332194 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ffa0d-994c-43ec-b418-637d6abba5a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:56:29.335000 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ac0ffa0d-994c-43ec-b418-637d6abba5a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:56:29.348699 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ffa0d-994c-43ec-b418-637d6abba5a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:56:29.350127 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ffa0d-994c-43ec-b418-637d6abba5a0 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:56:29.359988 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1188/2370] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:56:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:56:30.968190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46877a53-25ef-4845-b2b9-81c5aa519096 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:56:30.969203 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46877a53-25ef-4845-b2b9-81c5aa519096 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:56:30.969288 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46877a53-25ef-4845-b2b9-81c5aa519096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:56:31.001617 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-46877a53-25ef-4845-b2b9-81c5aa519096 None None] MFA Rules not processed for user `388330e61ade4f188c40c11c4ac46fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:56:31.003172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-46877a53-25ef-4845-b2b9-81c5aa519096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:56:31.015800 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1183/2371] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:56:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:56:31.333434 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ffa0d-994c-43ec-b418-637d6abba5a0 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:56:31.341805 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ffa0d-994c-43ec-b418-637d6abba5a0 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:56:31.345546 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f209d0-d700-435b-bfa8-5041af45ba87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:56:31.346394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f209d0-d700-435b-bfa8-5041af45ba87 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:56:31.346923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f209d0-d700-435b-bfa8-5041af45ba87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:56:31.347196 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f209d0-d700-435b-bfa8-5041af45ba87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:56:31.349027 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-54f209d0-d700-435b-bfa8-5041af45ba87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:56:31.359521 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f209d0-d700-435b-bfa8-5041af45ba87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:56:31.361419 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f209d0-d700-435b-bfa8-5041af45ba87 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:56:31.370163 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1189/2372] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:56:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:56:31.780431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46877a53-25ef-4845-b2b9-81c5aa519096 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:56:31.793230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46877a53-25ef-4845-b2b9-81c5aa519096 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:56:31.799930 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70d5d0-1fd3-49f5-abc0-31bad3e0cbea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:56:31.800526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70d5d0-1fd3-49f5-abc0-31bad3e0cbea service placement] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:56:31.800857 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70d5d0-1fd3-49f5-abc0-31bad3e0cbea service placement] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:56:31.801118 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70d5d0-1fd3-49f5-abc0-31bad3e0cbea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:56:31.802902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0a70d5d0-1fd3-49f5-abc0-31bad3e0cbea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:56:31.817597 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70d5d0-1fd3-49f5-abc0-31bad3e0cbea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:56:31.819349 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70d5d0-1fd3-49f5-abc0-31bad3e0cbea service placement] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:56:31.830214 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1184/2373] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:56:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:56:32.383528 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef3a18-f1fc-44f2-8e87-23e639bf89c6 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:56:32.384028 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef3a18-f1fc-44f2-8e87-23e639bf89c6 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:56:32.384130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef3a18-f1fc-44f2-8e87-23e639bf89c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:56:32.430474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-adef3a18-f1fc-44f2-8e87-23e639bf89c6 None None] MFA Rules not processed for user `46e692bef3e3484ebac5d1563e489e03`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:56:32.431608 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-adef3a18-f1fc-44f2-8e87-23e639bf89c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:56:32.448247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1190/2374] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:56:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:56:41.825292 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=18 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:56:42.445154 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=31 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:56:42.590431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70d5d0-1fd3-49f5-abc0-31bad3e0cbea service placement] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:56:42.607495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70d5d0-1fd3-49f5-abc0-31bad3e0cbea service placement] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:56:42.613867 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45954d-a14b-4f77-8138-89db930975ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:56:42.614519 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45954d-a14b-4f77-8138-89db930975ae service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:56:42.614808 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45954d-a14b-4f77-8138-89db930975ae service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:56:42.615092 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45954d-a14b-4f77-8138-89db930975ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:56:42.616992 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-5e45954d-a14b-4f77-8138-89db930975ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:56:42.629634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45954d-a14b-4f77-8138-89db930975ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:56:42.631903 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45954d-a14b-4f77-8138-89db930975ae service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:56:42.645698 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1185/2375] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:56:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:56:52.638455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=6 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:04.078837 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef3a18-f1fc-44f2-8e87-23e639bf89c6 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:04.090024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef3a18-f1fc-44f2-8e87-23e639bf89c6 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:04.096541 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc10f7-1007-456a-8cb2-19f59e41aa22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:04.097220 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc10f7-1007-456a-8cb2-19f59e41aa22 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:04.097494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc10f7-1007-456a-8cb2-19f59e41aa22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:04.097767 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc10f7-1007-456a-8cb2-19f59e41aa22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:04.111439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc10f7-1007-456a-8cb2-19f59e41aa22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:04.113094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc10f7-1007-456a-8cb2-19f59e41aa22 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:04.123733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1191/2376] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:05.650397 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45954d-a14b-4f77-8138-89db930975ae service nova] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:05.669329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45954d-a14b-4f77-8138-89db930975ae service nova] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:05.673664 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acf5e8-fddb-45b6-9015-1dd8b55fb715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:05.674311 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acf5e8-fddb-45b6-9015-1dd8b55fb715 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:05.674594 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acf5e8-fddb-45b6-9015-1dd8b55fb715 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:05.674871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acf5e8-fddb-45b6-9015-1dd8b55fb715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:05.676795 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-a5acf5e8-fddb-45b6-9015-1dd8b55fb715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:05.717450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc10f7-1007-456a-8cb2-19f59e41aa22 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:05.727236 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc10f7-1007-456a-8cb2-19f59e41aa22 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:05.731065 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07347e2b-88a2-40f1-90f2-6d208d0f1e61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:05.731920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07347e2b-88a2-40f1-90f2-6d208d0f1e61 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:05.732202 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07347e2b-88a2-40f1-90f2-6d208d0f1e61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:05.732479 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07347e2b-88a2-40f1-90f2-6d208d0f1e61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:05.774898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5acf5e8-fddb-45b6-9015-1dd8b55fb715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:05.776336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5acf5e8-fddb-45b6-9015-1dd8b55fb715 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:05.794898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07347e2b-88a2-40f1-90f2-6d208d0f1e61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:05.796494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07347e2b-88a2-40f1-90f2-6d208d0f1e61 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:05.796997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1186/2377] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:05.811962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1192/2378] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:07.135191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acf5e8-fddb-45b6-9015-1dd8b55fb715 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:07.155684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acf5e8-fddb-45b6-9015-1dd8b55fb715 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:07.159550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286dfad-9e49-484d-b103-7911bab94cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:07.160203 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286dfad-9e49-484d-b103-7911bab94cec service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:07.160484 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286dfad-9e49-484d-b103-7911bab94cec service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:07.160789 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286dfad-9e49-484d-b103-7911bab94cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:07.170070 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286dfad-9e49-484d-b103-7911bab94cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:07.172145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286dfad-9e49-484d-b103-7911bab94cec service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:07.182329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1187/2379] 10.222.0.66 () {60 vars in 1396 bytes} [Thu May 26 21:58:07 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3240 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:07.609518 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07347e2b-88a2-40f1-90f2-6d208d0f1e61 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:07.631254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07347e2b-88a2-40f1-90f2-6d208d0f1e61 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:07.638482 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567e5a0-7305-4c9d-94fd-f8a5a849f4fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:07.641507 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567e5a0-7305-4c9d-94fd-f8a5a849f4fb service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:07.641507 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567e5a0-7305-4c9d-94fd-f8a5a849f4fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:07.641507 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567e5a0-7305-4c9d-94fd-f8a5a849f4fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:07.652996 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567e5a0-7305-4c9d-94fd-f8a5a849f4fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:07.654566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567e5a0-7305-4c9d-94fd-f8a5a849f4fb service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:07.666297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1193/2380] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:09.615761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286dfad-9e49-484d-b103-7911bab94cec service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:09.627851 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286dfad-9e49-484d-b103-7911bab94cec service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:09.633160 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41932a84-6411-4a68-a972-8873403e4eaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:09.633886 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41932a84-6411-4a68-a972-8873403e4eaa service placement] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:09.634260 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41932a84-6411-4a68-a972-8873403e4eaa service placement] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:09.634612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41932a84-6411-4a68-a972-8873403e4eaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:09.636536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-41932a84-6411-4a68-a972-8873403e4eaa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:09.648299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41932a84-6411-4a68-a972-8873403e4eaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:09.650021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41932a84-6411-4a68-a972-8873403e4eaa service placement] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:09.660402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1188/2381] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:09.757564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567e5a0-7305-4c9d-94fd-f8a5a849f4fb service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:09.759087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3567e5a0-7305-4c9d-94fd-f8a5a849f4fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:09.773923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567e5a0-7305-4c9d-94fd-f8a5a849f4fb service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:09.778561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5860c08-6a11-482c-bd15-bca0b4222fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:09.779431 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5860c08-6a11-482c-bd15-bca0b4222fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:09.779713 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5860c08-6a11-482c-bd15-bca0b4222fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:09.779990 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5860c08-6a11-482c-bd15-bca0b4222fb1 admin admin] PATH_INFO: `/v3/users/7d524a8208354c2099eb3b41b0f53de2` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:09.781716 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5860c08-6a11-482c-bd15-bca0b4222fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d524a8208354c2099eb3b41b0f53de2)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:09.783638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5860c08-6a11-482c-bd15-bca0b4222fb1 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:10.000287 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c5860c08-6a11-482c-bd15-bca0b4222fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d524a8208354c2099eb3b41b0f53de2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:10.001049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c5860c08-6a11-482c-bd15-bca0b4222fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d524a8208354c2099eb3b41b0f53de2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:10.001724 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c5860c08-6a11-482c-bd15-bca0b4222fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d524a8208354c2099eb3b41b0f53de2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:10.016669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c5860c08-6a11-482c-bd15-bca0b4222fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d524a8208354c2099eb3b41b0f53de2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:10.023553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c5860c08-6a11-482c-bd15-bca0b4222fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d524a8208354c2099eb3b41b0f53de2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:10.098100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1194/2382] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:09 2022] DELETE /identity/v3/users/7d524a8208354c2099eb3b41b0f53de2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:10.370349 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41932a84-6411-4a68-a972-8873403e4eaa service placement] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:10.381371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41932a84-6411-4a68-a972-8873403e4eaa service placement] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:10.438191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735ea39-8930-4591-a141-2456891bdda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:10.444570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735ea39-8930-4591-a141-2456891bdda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:10.444570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735ea39-8930-4591-a141-2456891bdda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:10.444570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735ea39-8930-4591-a141-2456891bdda5 admin admin] PATH_INFO: `/v3/projects/28874954ef9f45c78ad761ed4a1719cb` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:10.444570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735ea39-8930-4591-a141-2456891bdda5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28874954ef9f45c78ad761ed4a1719cb)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:10.444570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735ea39-8930-4591-a141-2456891bdda5 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:10.467307 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:10.575155 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f735ea39-8930-4591-a141-2456891bdda5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28874954ef9f45c78ad761ed4a1719cb', 'request_id': 'req-f735ea39-8930-4591-a141-2456891bdda5'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:10.580733 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f735ea39-8930-4591-a141-2456891bdda5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28874954ef9f45c78ad761ed4a1719cb', 'request_id': 'req-f735ea39-8930-4591-a141-2456891bdda5'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:10.665723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f735ea39-8930-4591-a141-2456891bdda5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28874954ef9f45c78ad761ed4a1719cb', 'request_id': 'req-f735ea39-8930-4591-a141-2456891bdda5'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:10.677234 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f735ea39-8930-4591-a141-2456891bdda5 admin admin] The token cache is being invalidate because project 28874954ef9f45c78ad761ed4a1719cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:58:10.677518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f735ea39-8930-4591-a141-2456891bdda5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:10.678133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f735ea39-8930-4591-a141-2456891bdda5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:10.679652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1189/2383] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:10 2022] DELETE /identity/v3/projects/28874954ef9f45c78ad761ed4a1719cb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:10.685551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d106f22-fb41-426d-8050-e7b36778285f None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:10.685876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d106f22-fb41-426d-8050-e7b36778285f None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:10.686157 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d106f22-fb41-426d-8050-e7b36778285f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:10.703940 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-2d106f22-fb41-426d-8050-e7b36778285f None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:10.705134 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2d106f22-fb41-426d-8050-e7b36778285f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:10.735997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:10.763289 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1195/2384] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:10.770914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f266b-ec41-4c4b-9bb2-7ad9769f62ef None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:10.771208 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f266b-ec41-4c4b-9bb2-7ad9769f62ef None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:10.771535 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f266b-ec41-4c4b-9bb2-7ad9769f62ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:10.790110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-334f266b-ec41-4c4b-9bb2-7ad9769f62ef None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:10.791317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-334f266b-ec41-4c4b-9bb2-7ad9769f62ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:10.799925 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1190/2385] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:10.804107 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d106f22-fb41-426d-8050-e7b36778285f None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:10.814536 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d106f22-fb41-426d-8050-e7b36778285f None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:10.819143 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1995d-d7fc-4769-a261-8e8d8d674ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:10.819916 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1995d-d7fc-4769-a261-8e8d8d674ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:10.820198 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1995d-d7fc-4769-a261-8e8d8d674ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:10.820474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1995d-d7fc-4769-a261-8e8d8d674ea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:10.821332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1995d-d7fc-4769-a261-8e8d8d674ea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:58:10.821644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1995d-d7fc-4769-a261-8e8d8d674ea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:10.823270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1995d-d7fc-4769-a261-8e8d8d674ea8 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:10.834861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1196/2386] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:58:10.839055 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f266b-ec41-4c4b-9bb2-7ad9769f62ef None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:10.849005 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f266b-ec41-4c4b-9bb2-7ad9769f62ef None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:10.853732 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3881a-a285-497b-bb9f-1543fbf1024c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:10.854382 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3881a-a285-497b-bb9f-1543fbf1024c admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:10.854668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3881a-a285-497b-bb9f-1543fbf1024c admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:10.854946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3881a-a285-497b-bb9f-1543fbf1024c admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:10.855639 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3881a-a285-497b-bb9f-1543fbf1024c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:10.857583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3881a-a285-497b-bb9f-1543fbf1024c admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:10.976188 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1191/2387] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:58:10 2022] POST /identity/v3/projects => generated 403 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:58:10.980244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1995d-d7fc-4769-a261-8e8d8d674ea8 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:10.990005 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1995d-d7fc-4769-a261-8e8d8d674ea8 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:11.048612 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f0abc-7567-4d72-9af1-943cbebb7dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:11.049333 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f0abc-7567-4d72-9af1-943cbebb7dac admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:11.049618 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f0abc-7567-4d72-9af1-943cbebb7dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:11.050018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f0abc-7567-4d72-9af1-943cbebb7dac admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:11.050717 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f0abc-7567-4d72-9af1-943cbebb7dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:11.052777 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f0abc-7567-4d72-9af1-943cbebb7dac admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:11.146978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1197/2388] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:58:10 2022] POST /identity/v3/users => generated 302 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:58:11.151070 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3881a-a285-497b-bb9f-1543fbf1024c admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:11.161927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3881a-a285-497b-bb9f-1543fbf1024c admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:11.166495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180724a3-d0bd-472d-92dc-2d2aacfdfb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:11.167410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180724a3-d0bd-472d-92dc-2d2aacfdfb91 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:11.167410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180724a3-d0bd-472d-92dc-2d2aacfdfb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:11.167807 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180724a3-d0bd-472d-92dc-2d2aacfdfb91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:11.168525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180724a3-d0bd-472d-92dc-2d2aacfdfb91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:11.170129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180724a3-d0bd-472d-92dc-2d2aacfdfb91 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:11.180545 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1192/2389] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:58:11.184537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f0abc-7567-4d72-9af1-943cbebb7dac admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:11.194877 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f0abc-7567-4d72-9af1-943cbebb7dac admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:11.199487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972f909-a7f6-4959-b2da-92d1a49bdcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:11.200142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972f909-a7f6-4959-b2da-92d1a49bdcd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:11.200424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972f909-a7f6-4959-b2da-92d1a49bdcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:11.200753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972f909-a7f6-4959-b2da-92d1a49bdcd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:11.201469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972f909-a7f6-4959-b2da-92d1a49bdcd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:11.203577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972f909-a7f6-4959-b2da-92d1a49bdcd2 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:11.213301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1198/2390] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:58:11.217402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180724a3-d0bd-472d-92dc-2d2aacfdfb91 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:11.227868 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180724a3-d0bd-472d-92dc-2d2aacfdfb91 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:11.232920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d8631-e7a6-4357-a2cc-ca466605df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:11.233840 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d8631-e7a6-4357-a2cc-ca466605df04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:11.234121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d8631-e7a6-4357-a2cc-ca466605df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:11.234395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d8631-e7a6-4357-a2cc-ca466605df04 admin admin] PATH_INFO: `/v3/projects/39ba0e910ad440c989b6419c03f5378b/users/dfba2d2ca4f44686844c0dc550688750/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:11.249290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d8631-e7a6-4357-a2cc-ca466605df04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ba0e910ad440c989b6419c03f5378b, user_id=dfba2d2ca4f44686844c0dc550688750, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:11.251927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d8631-e7a6-4357-a2cc-ca466605df04 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:11.318002 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1193/2391] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:11 2022] PUT /identity/v3/projects/39ba0e910ad440c989b6419c03f5378b/users/dfba2d2ca4f44686844c0dc550688750/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:11.329639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80f9ea-7190-4068-b42b-69b12a184182 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:11.329926 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80f9ea-7190-4068-b42b-69b12a184182 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:11.330205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80f9ea-7190-4068-b42b-69b12a184182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:11.357253 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-0d80f9ea-7190-4068-b42b-69b12a184182 None None] MFA Rules not processed for user `dfba2d2ca4f44686844c0dc550688750`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:11.358474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-0d80f9ea-7190-4068-b42b-69b12a184182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:11.420150 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1199/2392] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:58:11.424796 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d8631-e7a6-4357-a2cc-ca466605df04 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:11.486150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d8631-e7a6-4357-a2cc-ca466605df04 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:11.491031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c249226-faed-43ab-ade3-345daf3ce1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:11.491689 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c249226-faed-43ab-ade3-345daf3ce1fd admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:11.491978 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c249226-faed-43ab-ade3-345daf3ce1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:11.492260 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c249226-faed-43ab-ade3-345daf3ce1fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:11.492993 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c249226-faed-43ab-ade3-345daf3ce1fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:11.494936 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c249226-faed-43ab-ade3-345daf3ce1fd admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:11.587913 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1194/2393] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:58:11 2022] POST /identity/v3/projects => generated 405 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:58:11.591761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80f9ea-7190-4068-b42b-69b12a184182 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:11.602345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80f9ea-7190-4068-b42b-69b12a184182 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:11.631167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:11.657637 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b703c7-c563-4cf4-b379-982c84d877b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:11.658303 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b703c7-c563-4cf4-b379-982c84d877b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:11.660847 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b703c7-c563-4cf4-b379-982c84d877b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:11.660847 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b703c7-c563-4cf4-b379-982c84d877b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:11.660847 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b703c7-c563-4cf4-b379-982c84d877b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:11.661469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b703c7-c563-4cf4-b379-982c84d877b2 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:11.742418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1200/2394] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:58:11 2022] POST /identity/v3/users => generated 309 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:58:11.746988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c249226-faed-43ab-ade3-345daf3ce1fd admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:11.757376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c249226-faed-43ab-ade3-345daf3ce1fd admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:11.762431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246f13c-38d3-4585-a1af-fbcfcc62a703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:11.763095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246f13c-38d3-4585-a1af-fbcfcc62a703 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:11.763380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246f13c-38d3-4585-a1af-fbcfcc62a703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:11.763659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246f13c-38d3-4585-a1af-fbcfcc62a703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:11.764385 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246f13c-38d3-4585-a1af-fbcfcc62a703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:11.766054 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246f13c-38d3-4585-a1af-fbcfcc62a703 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:11.776829 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1195/2395] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:58:11.780905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b703c7-c563-4cf4-b379-982c84d877b2 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:11.790986 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b703c7-c563-4cf4-b379-982c84d877b2 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:11.795624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c403c1-4551-4f46-b19d-1f1fce85c660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:11.797085 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c403c1-4551-4f46-b19d-1f1fce85c660 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:11.797369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c403c1-4551-4f46-b19d-1f1fce85c660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:11.797651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c403c1-4551-4f46-b19d-1f1fce85c660 admin admin] PATH_INFO: `/v3/projects/02c829c927534b2b9e54df9c98833d86/users/bd4942f71a644f9eb40a5b1de230d7f0/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:11.811913 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c403c1-4551-4f46-b19d-1f1fce85c660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c829c927534b2b9e54df9c98833d86, user_id=bd4942f71a644f9eb40a5b1de230d7f0, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:11.815214 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c403c1-4551-4f46-b19d-1f1fce85c660 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:11.882565 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1201/2396] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:11 2022] PUT /identity/v3/projects/02c829c927534b2b9e54df9c98833d86/users/bd4942f71a644f9eb40a5b1de230d7f0/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:11.886496 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246f13c-38d3-4585-a1af-fbcfcc62a703 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:11.896461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246f13c-38d3-4585-a1af-fbcfcc62a703 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:11.914600 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:11.952542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a58a8-ae41-49e6-bca2-f3b6dc672b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:11.953231 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a58a8-ae41-49e6-bca2-f3b6dc672b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:11.953519 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a58a8-ae41-49e6-bca2-f3b6dc672b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:11.953795 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a58a8-ae41-49e6-bca2-f3b6dc672b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:11.954505 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a58a8-ae41-49e6-bca2-f3b6dc672b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:11.956085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a58a8-ae41-49e6-bca2-f3b6dc672b54 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:11.965969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1196/2397] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:58:11.969874 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c403c1-4551-4f46-b19d-1f1fce85c660 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:11.980927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c403c1-4551-4f46-b19d-1f1fce85c660 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:11.986135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d8096-6a07-456e-a8c8-2042b5dad368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:11.987087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d8096-6a07-456e-a8c8-2042b5dad368 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:11.987373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d8096-6a07-456e-a8c8-2042b5dad368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:11.987651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d8096-6a07-456e-a8c8-2042b5dad368 admin admin] PATH_INFO: `/v3/projects/02c829c927534b2b9e54df9c98833d86/users/bd4942f71a644f9eb40a5b1de230d7f0/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:11.989649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d8096-6a07-456e-a8c8-2042b5dad368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c829c927534b2b9e54df9c98833d86, user_id=bd4942f71a644f9eb40a5b1de230d7f0, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:11.992671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d8096-6a07-456e-a8c8-2042b5dad368 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:12.003233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1202/2398] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:11 2022] PUT /identity/v3/projects/02c829c927534b2b9e54df9c98833d86/users/bd4942f71a644f9eb40a5b1de230d7f0/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:12.013236 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cc5bc-441d-43f0-9c8c-7ea40c4a68f3 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:12.015023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cc5bc-441d-43f0-9c8c-7ea40c4a68f3 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:12.015023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cc5bc-441d-43f0-9c8c-7ea40c4a68f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:12.039773 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-487cc5bc-441d-43f0-9c8c-7ea40c4a68f3 None None] MFA Rules not processed for user `bd4942f71a644f9eb40a5b1de230d7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:12.041002 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-487cc5bc-441d-43f0-9c8c-7ea40c4a68f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:12.110043 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1197/2399] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:12 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:12.125674 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d8096-6a07-456e-a8c8-2042b5dad368 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:12.127379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-954d8096-6a07-456e-a8c8-2042b5dad368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:12.185601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d8096-6a07-456e-a8c8-2042b5dad368 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:12.189337 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bd136-6c00-48ce-88f6-faaa54e2eca8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:12.189976 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bd136-6c00-48ce-88f6-faaa54e2eca8 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:12.190259 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bd136-6c00-48ce-88f6-faaa54e2eca8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:12.190534 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bd136-6c00-48ce-88f6-faaa54e2eca8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:12.199393 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bd136-6c00-48ce-88f6-faaa54e2eca8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:12.200827 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bd136-6c00-48ce-88f6-faaa54e2eca8 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:12.210005 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1203/2400] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:12 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:12.537729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cc5bc-441d-43f0-9c8c-7ea40c4a68f3 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:12.603138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cc5bc-441d-43f0-9c8c-7ea40c4a68f3 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:12.607858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63dc078-2729-4a97-aed8-c50981028b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:12.608797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63dc078-2729-4a97-aed8-c50981028b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:12.609085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63dc078-2729-4a97-aed8-c50981028b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:12.609363 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63dc078-2729-4a97-aed8-c50981028b6e admin admin] PATH_INFO: `/v3/users/dfba2d2ca4f44686844c0dc550688750` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:12.610543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63dc078-2729-4a97-aed8-c50981028b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfba2d2ca4f44686844c0dc550688750)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:12.612488 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63dc078-2729-4a97-aed8-c50981028b6e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:12.832120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:12.833747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-a63dc078-2729-4a97-aed8-c50981028b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfba2d2ca4f44686844c0dc550688750'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:12.926641 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-a63dc078-2729-4a97-aed8-c50981028b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfba2d2ca4f44686844c0dc550688750'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:12.927287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-a63dc078-2729-4a97-aed8-c50981028b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfba2d2ca4f44686844c0dc550688750'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:12.939904 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-a63dc078-2729-4a97-aed8-c50981028b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfba2d2ca4f44686844c0dc550688750'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:12.940535 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-a63dc078-2729-4a97-aed8-c50981028b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfba2d2ca4f44686844c0dc550688750'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:12.953442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1198/2401] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:12 2022] DELETE /identity/v3/users/dfba2d2ca4f44686844c0dc550688750 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:12.958216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f5571-132d-4213-9b74-f425825eb4f9 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:12.958708 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f5571-132d-4213-9b74-f425825eb4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:12.958804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f5571-132d-4213-9b74-f425825eb4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:12.976276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-d46f5571-132d-4213-9b74-f425825eb4f9 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:12.980978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d46f5571-132d-4213-9b74-f425825eb4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:13.034841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1204/2402] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:13.047133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63dc078-2729-4a97-aed8-c50981028b6e admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:13.049732 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-a63dc078-2729-4a97-aed8-c50981028b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:13.107799 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63dc078-2729-4a97-aed8-c50981028b6e admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:13.111472 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b90eb-d821-475c-9f21-fd75cd5422dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:13.112270 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b90eb-d821-475c-9f21-fd75cd5422dc service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:13.112554 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b90eb-d821-475c-9f21-fd75cd5422dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:13.112860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b90eb-d821-475c-9f21-fd75cd5422dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:13.122251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b90eb-d821-475c-9f21-fd75cd5422dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:13.123657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b90eb-d821-475c-9f21-fd75cd5422dc service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:13.134466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1199/2403] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:13.562240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f5571-132d-4213-9b74-f425825eb4f9 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:13.563781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d46f5571-132d-4213-9b74-f425825eb4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:13.576030 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f5571-132d-4213-9b74-f425825eb4f9 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:13.584248 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06291a-1ff5-4abf-98ae-3e8ca16565ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:13.585458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06291a-1ff5-4abf-98ae-3e8ca16565ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:13.588222 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06291a-1ff5-4abf-98ae-3e8ca16565ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:13.588222 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06291a-1ff5-4abf-98ae-3e8ca16565ab admin admin] PATH_INFO: `/v3/projects/39ba0e910ad440c989b6419c03f5378b` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:13.588222 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06291a-1ff5-4abf-98ae-3e8ca16565ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ba0e910ad440c989b6419c03f5378b)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:13.589963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06291a-1ff5-4abf-98ae-3e8ca16565ab admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:13.614619 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:13.713988 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-9b06291a-1ff5-4abf-98ae-3e8ca16565ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ba0e910ad440c989b6419c03f5378b', 'request_id': 'req-9b06291a-1ff5-4abf-98ae-3e8ca16565ab'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:13.816824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-9b06291a-1ff5-4abf-98ae-3e8ca16565ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ba0e910ad440c989b6419c03f5378b', 'request_id': 'req-9b06291a-1ff5-4abf-98ae-3e8ca16565ab'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:13.823345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-9b06291a-1ff5-4abf-98ae-3e8ca16565ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ba0e910ad440c989b6419c03f5378b', 'request_id': 'req-9b06291a-1ff5-4abf-98ae-3e8ca16565ab'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:13.833636 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-9b06291a-1ff5-4abf-98ae-3e8ca16565ab admin admin] The token cache is being invalidate because project 39ba0e910ad440c989b6419c03f5378b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:58:13.833927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-9b06291a-1ff5-4abf-98ae-3e8ca16565ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:13.834562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-9b06291a-1ff5-4abf-98ae-3e8ca16565ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:13.836102 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1205/2404] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:13 2022] DELETE /identity/v3/projects/39ba0e910ad440c989b6419c03f5378b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:13.840355 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b90eb-d821-475c-9f21-fd75cd5422dc service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:13.851244 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b90eb-d821-475c-9f21-fd75cd5422dc service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:13.908684 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d902b9d-de8c-47c0-b094-1360122ede18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:13.909584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d902b9d-de8c-47c0-b094-1360122ede18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:13.909867 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d902b9d-de8c-47c0-b094-1360122ede18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:13.910147 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d902b9d-de8c-47c0-b094-1360122ede18 admin admin] PATH_INFO: `/v3/users/bd4942f71a644f9eb40a5b1de230d7f0` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:13.911349 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d902b9d-de8c-47c0-b094-1360122ede18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd4942f71a644f9eb40a5b1de230d7f0)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:13.913328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d902b9d-de8c-47c0-b094-1360122ede18 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:14.162805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-2d902b9d-de8c-47c0-b094-1360122ede18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd4942f71a644f9eb40a5b1de230d7f0'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:14.218106 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-2d902b9d-de8c-47c0-b094-1360122ede18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd4942f71a644f9eb40a5b1de230d7f0'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:14.219566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-2d902b9d-de8c-47c0-b094-1360122ede18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd4942f71a644f9eb40a5b1de230d7f0'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:14.238888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:14.241300 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-2d902b9d-de8c-47c0-b094-1360122ede18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd4942f71a644f9eb40a5b1de230d7f0'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:14.241999 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-2d902b9d-de8c-47c0-b094-1360122ede18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd4942f71a644f9eb40a5b1de230d7f0'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:14.254033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1200/2405] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:13 2022] DELETE /identity/v3/users/bd4942f71a644f9eb40a5b1de230d7f0 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:58:14.679830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06291a-1ff5-4abf-98ae-3e8ca16565ab admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:14.682188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-9b06291a-1ff5-4abf-98ae-3e8ca16565ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:14.696037 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06291a-1ff5-4abf-98ae-3e8ca16565ab admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:14.755229 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7113e-b00c-4e4d-a337-f4f257b95401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:14.756099 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7113e-b00c-4e4d-a337-f4f257b95401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:14.756383 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7113e-b00c-4e4d-a337-f4f257b95401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:14.756712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7113e-b00c-4e4d-a337-f4f257b95401 admin admin] PATH_INFO: `/v3/projects/02c829c927534b2b9e54df9c98833d86` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:14.757896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7113e-b00c-4e4d-a337-f4f257b95401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02c829c927534b2b9e54df9c98833d86)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:14.759858 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7113e-b00c-4e4d-a337-f4f257b95401 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:14.865949 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-71e7113e-b00c-4e4d-a337-f4f257b95401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c829c927534b2b9e54df9c98833d86', 'request_id': 'req-71e7113e-b00c-4e4d-a337-f4f257b95401'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:14.937467 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-71e7113e-b00c-4e4d-a337-f4f257b95401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c829c927534b2b9e54df9c98833d86', 'request_id': 'req-71e7113e-b00c-4e4d-a337-f4f257b95401'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:14.944089 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-71e7113e-b00c-4e4d-a337-f4f257b95401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c829c927534b2b9e54df9c98833d86', 'request_id': 'req-71e7113e-b00c-4e4d-a337-f4f257b95401'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:14.955585 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-71e7113e-b00c-4e4d-a337-f4f257b95401 admin admin] The token cache is being invalidate because project 02c829c927534b2b9e54df9c98833d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:58:14.955897 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-71e7113e-b00c-4e4d-a337-f4f257b95401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:14.956562 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-71e7113e-b00c-4e4d-a337-f4f257b95401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:14.958423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1206/2406] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:14 2022] DELETE /identity/v3/projects/02c829c927534b2b9e54df9c98833d86 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:14.963935 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5d343-a10b-489b-965e-c720d1e48cfb None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:14.964430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5d343-a10b-489b-965e-c720d1e48cfb None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:14.964615 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5d343-a10b-489b-965e-c720d1e48cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:14.982783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-70f5d343-a10b-489b-965e-c720d1e48cfb None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:14.983987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-70f5d343-a10b-489b-965e-c720d1e48cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:15.048093 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1201/2407] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:58:15.060607 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc1454-f0e9-4944-a66f-2249ae34b063 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:15.060607 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc1454-f0e9-4944-a66f-2249ae34b063 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:15.060607 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc1454-f0e9-4944-a66f-2249ae34b063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:15.077338 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-b4cc1454-f0e9-4944-a66f-2249ae34b063 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:15.079261 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b4cc1454-f0e9-4944-a66f-2249ae34b063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:15.087394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1207/2408] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:15.091586 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5d343-a10b-489b-965e-c720d1e48cfb None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:15.101778 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5d343-a10b-489b-965e-c720d1e48cfb None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:15.106298 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4100e9-29bb-4ec2-a868-c54257109e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:15.106959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4100e9-29bb-4ec2-a868-c54257109e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:15.107238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4100e9-29bb-4ec2-a868-c54257109e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:15.107513 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4100e9-29bb-4ec2-a868-c54257109e30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:15.108230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4100e9-29bb-4ec2-a868-c54257109e30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:58:15.108556 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4100e9-29bb-4ec2-a868-c54257109e30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:15.110253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4100e9-29bb-4ec2-a868-c54257109e30 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:15.121955 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1202/2409] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:58:15.126918 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc1454-f0e9-4944-a66f-2249ae34b063 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:15.135997 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc1454-f0e9-4944-a66f-2249ae34b063 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:15.141613 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83512b-d877-42b6-b0c9-90cacd0bae51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:15.142264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83512b-d877-42b6-b0c9-90cacd0bae51 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:15.142591 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83512b-d877-42b6-b0c9-90cacd0bae51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:15.142811 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83512b-d877-42b6-b0c9-90cacd0bae51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:15.143540 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83512b-d877-42b6-b0c9-90cacd0bae51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:15.145603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83512b-d877-42b6-b0c9-90cacd0bae51 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:15.235082 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1208/2410] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:58:15 2022] POST /identity/v3/projects => generated 405 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:58:15.238363 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4100e9-29bb-4ec2-a868-c54257109e30 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:15.250332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4100e9-29bb-4ec2-a868-c54257109e30 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:15.315606 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28935afd-77f5-4a40-a910-7f80b89b8082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:15.316387 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28935afd-77f5-4a40-a910-7f80b89b8082 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:15.316714 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28935afd-77f5-4a40-a910-7f80b89b8082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:15.316997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28935afd-77f5-4a40-a910-7f80b89b8082 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:15.317692 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28935afd-77f5-4a40-a910-7f80b89b8082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:15.319649 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28935afd-77f5-4a40-a910-7f80b89b8082 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:15.453059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1203/2411] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:58:15 2022] POST /identity/v3/users => generated 303 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:58:15.462971 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83512b-d877-42b6-b0c9-90cacd0bae51 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:15.473354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83512b-d877-42b6-b0c9-90cacd0bae51 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:15.477903 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b70fb-87e4-4d5c-88fd-d869016fd84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:15.478561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b70fb-87e4-4d5c-88fd-d869016fd84d admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:15.478843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b70fb-87e4-4d5c-88fd-d869016fd84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:15.479566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b70fb-87e4-4d5c-88fd-d869016fd84d admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:15.479905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b70fb-87e4-4d5c-88fd-d869016fd84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:15.481544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b70fb-87e4-4d5c-88fd-d869016fd84d admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:15.487304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:15.494260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1209/2412] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:58:15.498269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28935afd-77f5-4a40-a910-7f80b89b8082 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:15.508878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28935afd-77f5-4a40-a910-7f80b89b8082 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:15.513582 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d9dd5-605b-4295-9ee2-c950de07bf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:15.514235 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d9dd5-605b-4295-9ee2-c950de07bf8d admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:15.514515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d9dd5-605b-4295-9ee2-c950de07bf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:15.514794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d9dd5-605b-4295-9ee2-c950de07bf8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:15.515545 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d9dd5-605b-4295-9ee2-c950de07bf8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:15.517158 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d9dd5-605b-4295-9ee2-c950de07bf8d admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:15.527183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1204/2413] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:58:15.531212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b70fb-87e4-4d5c-88fd-d869016fd84d admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:15.541100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b70fb-87e4-4d5c-88fd-d869016fd84d admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:15.545709 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08a44e-c8bd-4026-84ba-15c4c9e046ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:15.547083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08a44e-c8bd-4026-84ba-15c4c9e046ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:15.547361 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08a44e-c8bd-4026-84ba-15c4c9e046ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:15.547635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08a44e-c8bd-4026-84ba-15c4c9e046ab admin admin] PATH_INFO: `/v3/projects/157c6b10fe2e4a349b1b3e84e9047ebc/users/06795fd07c06422e97b439efc2170a2d/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:15.563604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08a44e-c8bd-4026-84ba-15c4c9e046ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=157c6b10fe2e4a349b1b3e84e9047ebc, user_id=06795fd07c06422e97b439efc2170a2d, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:15.566388 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08a44e-c8bd-4026-84ba-15c4c9e046ab admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:15.640117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1210/2414] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:15 2022] PUT /identity/v3/projects/157c6b10fe2e4a349b1b3e84e9047ebc/users/06795fd07c06422e97b439efc2170a2d/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:15.645412 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bc1a9-ffec-48d8-9e7f-50d088a3060e None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:15.645706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bc1a9-ffec-48d8-9e7f-50d088a3060e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:15.645987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bc1a9-ffec-48d8-9e7f-50d088a3060e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:15.663400 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-886bc1a9-ffec-48d8-9e7f-50d088a3060e None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:15.664639 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-886bc1a9-ffec-48d8-9e7f-50d088a3060e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:15.709033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:15.722653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1205/2415] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:15.732044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08a44e-c8bd-4026-84ba-15c4c9e046ab admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:15.733842 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2c08a44e-c8bd-4026-84ba-15c4c9e046ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:15.790455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08a44e-c8bd-4026-84ba-15c4c9e046ab admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:15.794070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff2797-e57c-44a7-b8df-c26bdb3765e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:15.794705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff2797-e57c-44a7-b8df-c26bdb3765e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:15.794983 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff2797-e57c-44a7-b8df-c26bdb3765e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:15.795255 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff2797-e57c-44a7-b8df-c26bdb3765e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:15.804732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff2797-e57c-44a7-b8df-c26bdb3765e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:15.806146 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff2797-e57c-44a7-b8df-c26bdb3765e5 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:15.816962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1211/2416] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:17.128750 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3bd0d-0452-41e3-ab32-d3e3d639bb3a None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:17.129294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3bd0d-0452-41e3-ab32-d3e3d639bb3a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:17.129410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3bd0d-0452-41e3-ab32-d3e3d639bb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:17.156879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-75c3bd0d-0452-41e3-ab32-d3e3d639bb3a None None] MFA Rules not processed for user `06795fd07c06422e97b439efc2170a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:17.158101 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-75c3bd0d-0452-41e3-ab32-d3e3d639bb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:17.225425 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1206/2417] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:58:17.229897 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff2797-e57c-44a7-b8df-c26bdb3765e5 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:17.240157 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff2797-e57c-44a7-b8df-c26bdb3765e5 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:17.245030 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd87d06-480c-409b-8cc9-b0ee62b94833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:17.245673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd87d06-480c-409b-8cc9-b0ee62b94833 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:17.245960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd87d06-480c-409b-8cc9-b0ee62b94833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:17.246234 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd87d06-480c-409b-8cc9-b0ee62b94833 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:17.246916 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd87d06-480c-409b-8cc9-b0ee62b94833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:17.248867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd87d06-480c-409b-8cc9-b0ee62b94833 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:17.336972 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1212/2418] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:58:17 2022] POST /identity/v3/projects => generated 405 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:58:17.341071 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3bd0d-0452-41e3-ab32-d3e3d639bb3a None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:17.356387 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3bd0d-0452-41e3-ab32-d3e3d639bb3a None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:17.424769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20289a6-7e9c-43a4-ae00-421d556173df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:17.425450 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20289a6-7e9c-43a4-ae00-421d556173df admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:17.425731 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20289a6-7e9c-43a4-ae00-421d556173df admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:17.426004 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20289a6-7e9c-43a4-ae00-421d556173df admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:17.426701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20289a6-7e9c-43a4-ae00-421d556173df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:17.432639 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20289a6-7e9c-43a4-ae00-421d556173df admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:17.538822 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1207/2419] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:58:17 2022] POST /identity/v3/users => generated 309 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:58:17.540966 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd87d06-480c-409b-8cc9-b0ee62b94833 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:17.551494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd87d06-480c-409b-8cc9-b0ee62b94833 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:17.556260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8679496-f33e-458b-a39a-3d9c820e2c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:17.556956 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8679496-f33e-458b-a39a-3d9c820e2c0e admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:17.557239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8679496-f33e-458b-a39a-3d9c820e2c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:17.557514 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8679496-f33e-458b-a39a-3d9c820e2c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:17.558237 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8679496-f33e-458b-a39a-3d9c820e2c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:17.559837 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8679496-f33e-458b-a39a-3d9c820e2c0e admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:17.570542 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1213/2420] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:58:17.576169 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20289a6-7e9c-43a4-ae00-421d556173df admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:17.586605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20289a6-7e9c-43a4-ae00-421d556173df admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:17.591254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af95db-5266-478b-9f2a-0dfa166d4759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:17.592152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af95db-5266-478b-9f2a-0dfa166d4759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:17.592490 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af95db-5266-478b-9f2a-0dfa166d4759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:17.592795 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af95db-5266-478b-9f2a-0dfa166d4759 admin admin] PATH_INFO: `/v3/projects/526d40ba8adb43148a70ceadebde05ef/users/36c4cf6e220943deb9d59e0d9e549ea6/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:17.607899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af95db-5266-478b-9f2a-0dfa166d4759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=526d40ba8adb43148a70ceadebde05ef, user_id=36c4cf6e220943deb9d59e0d9e549ea6, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:17.611234 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af95db-5266-478b-9f2a-0dfa166d4759 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:17.666486 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8679496-f33e-458b-a39a-3d9c820e2c0e admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:17.668225 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b8679496-f33e-458b-a39a-3d9c820e2c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:17.691925 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1208/2421] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:17 2022] PUT /identity/v3/projects/526d40ba8adb43148a70ceadebde05ef/users/36c4cf6e220943deb9d59e0d9e549ea6/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:17.692853 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af95db-5266-478b-9f2a-0dfa166d4759 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:17.743861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8679496-f33e-458b-a39a-3d9c820e2c0e admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:17.745726 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:17.759622 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af95db-5266-478b-9f2a-0dfa166d4759 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:17.764568 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b99ae0-4748-4c59-9b39-3ba6fcd32621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:17.766154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b99ae0-4748-4c59-9b39-3ba6fcd32621 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:17.766614 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b99ae0-4748-4c59-9b39-3ba6fcd32621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:17.767316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b99ae0-4748-4c59-9b39-3ba6fcd32621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:17.768115 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b99ae0-4748-4c59-9b39-3ba6fcd32621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:17.770041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b99ae0-4748-4c59-9b39-3ba6fcd32621 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:17.779898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1209/2422] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:58:17.784558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b99ae0-4748-4c59-9b39-3ba6fcd32621 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:17.794350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f14d54-c845-40ba-88fc-dabc0677465b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:17.794700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b99ae0-4748-4c59-9b39-3ba6fcd32621 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:17.799142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f14d54-c845-40ba-88fc-dabc0677465b service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:17.799142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f14d54-c845-40ba-88fc-dabc0677465b service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:17.799142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f14d54-c845-40ba-88fc-dabc0677465b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:17.799142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-89f14d54-c845-40ba-88fc-dabc0677465b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:17.799927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9757f29-deb4-4fc4-b1f4-126e0e823ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:17.800925 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9757f29-deb4-4fc4-b1f4-126e0e823ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:17.801206 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9757f29-deb4-4fc4-b1f4-126e0e823ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:17.801474 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9757f29-deb4-4fc4-b1f4-126e0e823ab3 admin admin] PATH_INFO: `/v3/projects/526d40ba8adb43148a70ceadebde05ef/users/36c4cf6e220943deb9d59e0d9e549ea6/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:17.803486 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9757f29-deb4-4fc4-b1f4-126e0e823ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=526d40ba8adb43148a70ceadebde05ef, user_id=36c4cf6e220943deb9d59e0d9e549ea6, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:17.806329 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9757f29-deb4-4fc4-b1f4-126e0e823ab3 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:17.811107 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:17.817246 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1210/2423] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:17 2022] PUT /identity/v3/projects/526d40ba8adb43148a70ceadebde05ef/users/36c4cf6e220943deb9d59e0d9e549ea6/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:58:17.860036 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f14d54-c845-40ba-88fc-dabc0677465b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:17.861571 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f14d54-c845-40ba-88fc-dabc0677465b service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:17.871364 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1214/2424] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:58:19.069035 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3e578-fece-41ba-9b79-8efabf498dbb None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:19.069554 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3e578-fece-41ba-9b79-8efabf498dbb None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:19.070021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3e578-fece-41ba-9b79-8efabf498dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:19.108947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-7fa3e578-fece-41ba-9b79-8efabf498dbb None None] MFA Rules not processed for user `36c4cf6e220943deb9d59e0d9e549ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:19.112691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-7fa3e578-fece-41ba-9b79-8efabf498dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:19.185956 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1211/2425] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:19 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:20.422062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f14d54-c845-40ba-88fc-dabc0677465b service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:20.423553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-89f14d54-c845-40ba-88fc-dabc0677465b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:20.505975 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f14d54-c845-40ba-88fc-dabc0677465b service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:20.562789 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3e578-fece-41ba-9b79-8efabf498dbb None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:20.591660 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38819354-6572-4ca1-93d5-3104e35b67a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:20.592513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38819354-6572-4ca1-93d5-3104e35b67a1 service placement] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:20.592994 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38819354-6572-4ca1-93d5-3104e35b67a1 service placement] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:20.593454 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38819354-6572-4ca1-93d5-3104e35b67a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:20.595305 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-38819354-6572-4ca1-93d5-3104e35b67a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:20.610309 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38819354-6572-4ca1-93d5-3104e35b67a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:20.612721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38819354-6572-4ca1-93d5-3104e35b67a1 service placement] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:20.626381 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1215/2426] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:20.635609 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3e578-fece-41ba-9b79-8efabf498dbb None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:20.640330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033db76-812e-416b-aadf-94d4ad0b3cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:20.641871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033db76-812e-416b-aadf-94d4ad0b3cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:20.642162 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033db76-812e-416b-aadf-94d4ad0b3cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:20.645241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033db76-812e-416b-aadf-94d4ad0b3cb6 admin admin] PATH_INFO: `/v3/users/06795fd07c06422e97b439efc2170a2d` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:20.645241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033db76-812e-416b-aadf-94d4ad0b3cb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06795fd07c06422e97b439efc2170a2d)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:20.646284 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033db76-812e-416b-aadf-94d4ad0b3cb6 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:20.852664 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-4033db76-812e-416b-aadf-94d4ad0b3cb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06795fd07c06422e97b439efc2170a2d'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:20.957849 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-4033db76-812e-416b-aadf-94d4ad0b3cb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06795fd07c06422e97b439efc2170a2d'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:20.958504 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-4033db76-812e-416b-aadf-94d4ad0b3cb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06795fd07c06422e97b439efc2170a2d'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:20.961479 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:20.989312 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-4033db76-812e-416b-aadf-94d4ad0b3cb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06795fd07c06422e97b439efc2170a2d'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:20.990253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-4033db76-812e-416b-aadf-94d4ad0b3cb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06795fd07c06422e97b439efc2170a2d'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:21.009555 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1212/2427] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:20 2022] DELETE /identity/v3/users/06795fd07c06422e97b439efc2170a2d => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:21.295436 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38819354-6572-4ca1-93d5-3104e35b67a1 service placement] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:21.304675 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38819354-6572-4ca1-93d5-3104e35b67a1 service placement] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:21.350981 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:21.363325 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aeaf51-9753-4f1b-bbf9-95add3500c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:21.364205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aeaf51-9753-4f1b-bbf9-95add3500c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:21.364485 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aeaf51-9753-4f1b-bbf9-95add3500c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:21.364791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aeaf51-9753-4f1b-bbf9-95add3500c4f admin admin] PATH_INFO: `/v3/projects/157c6b10fe2e4a349b1b3e84e9047ebc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:21.366233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aeaf51-9753-4f1b-bbf9-95add3500c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=157c6b10fe2e4a349b1b3e84e9047ebc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:21.368252 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aeaf51-9753-4f1b-bbf9-95add3500c4f admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:21.478438 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-43aeaf51-9753-4f1b-bbf9-95add3500c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157c6b10fe2e4a349b1b3e84e9047ebc', 'request_id': 'req-43aeaf51-9753-4f1b-bbf9-95add3500c4f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:21.551683 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-43aeaf51-9753-4f1b-bbf9-95add3500c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157c6b10fe2e4a349b1b3e84e9047ebc', 'request_id': 'req-43aeaf51-9753-4f1b-bbf9-95add3500c4f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:21.558555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-43aeaf51-9753-4f1b-bbf9-95add3500c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157c6b10fe2e4a349b1b3e84e9047ebc', 'request_id': 'req-43aeaf51-9753-4f1b-bbf9-95add3500c4f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:21.569960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-43aeaf51-9753-4f1b-bbf9-95add3500c4f admin admin] The token cache is being invalidate because project 157c6b10fe2e4a349b1b3e84e9047ebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:58:21.571948 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-43aeaf51-9753-4f1b-bbf9-95add3500c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:21.571948 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-43aeaf51-9753-4f1b-bbf9-95add3500c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:21.572459 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1216/2428] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:21 2022] DELETE /identity/v3/projects/157c6b10fe2e4a349b1b3e84e9047ebc => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:21.576552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033db76-812e-416b-aadf-94d4ad0b3cb6 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:21.578595 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4033db76-812e-416b-aadf-94d4ad0b3cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:21.595187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033db76-812e-416b-aadf-94d4ad0b3cb6 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:21.658491 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545798a-424e-4f48-9c1e-0edc85bfdee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:21.659372 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545798a-424e-4f48-9c1e-0edc85bfdee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:21.659654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545798a-424e-4f48-9c1e-0edc85bfdee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:21.659932 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545798a-424e-4f48-9c1e-0edc85bfdee0 admin admin] PATH_INFO: `/v3/users/36c4cf6e220943deb9d59e0d9e549ea6` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:21.661173 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545798a-424e-4f48-9c1e-0edc85bfdee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c4cf6e220943deb9d59e0d9e549ea6)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:21.663138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545798a-424e-4f48-9c1e-0edc85bfdee0 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:21.916620 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-8545798a-424e-4f48-9c1e-0edc85bfdee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c4cf6e220943deb9d59e0d9e549ea6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:21.971954 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-8545798a-424e-4f48-9c1e-0edc85bfdee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c4cf6e220943deb9d59e0d9e549ea6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:21.972806 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-8545798a-424e-4f48-9c1e-0edc85bfdee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c4cf6e220943deb9d59e0d9e549ea6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:21.986876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-8545798a-424e-4f48-9c1e-0edc85bfdee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c4cf6e220943deb9d59e0d9e549ea6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:21.987583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-8545798a-424e-4f48-9c1e-0edc85bfdee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c4cf6e220943deb9d59e0d9e549ea6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:22.000934 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1213/2429] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:21 2022] DELETE /identity/v3/users/36c4cf6e220943deb9d59e0d9e549ea6 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:22.249466 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aeaf51-9753-4f1b-bbf9-95add3500c4f admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:22.251706 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-43aeaf51-9753-4f1b-bbf9-95add3500c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:22.273249 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aeaf51-9753-4f1b-bbf9-95add3500c4f admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:22.290531 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545798a-424e-4f48-9c1e-0edc85bfdee0 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:22.292557 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8545798a-424e-4f48-9c1e-0edc85bfdee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:22.338418 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f507403-c1cd-4366-9dde-2f14f10daf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:22.339202 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f507403-c1cd-4366-9dde-2f14f10daf04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:22.339514 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f507403-c1cd-4366-9dde-2f14f10daf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:22.339744 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f507403-c1cd-4366-9dde-2f14f10daf04 admin admin] PATH_INFO: `/v3/projects/526d40ba8adb43148a70ceadebde05ef` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:22.340956 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f507403-c1cd-4366-9dde-2f14f10daf04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=526d40ba8adb43148a70ceadebde05ef)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:22.343681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f507403-c1cd-4366-9dde-2f14f10daf04 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:22.349189 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:22.364006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545798a-424e-4f48-9c1e-0edc85bfdee0 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:22.369887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161db9e-91cf-4f07-ac64-7a2097366bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:22.370838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161db9e-91cf-4f07-ac64-7a2097366bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:22.371242 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161db9e-91cf-4f07-ac64-7a2097366bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:22.371583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161db9e-91cf-4f07-ac64-7a2097366bd1 admin admin] PATH_INFO: `/v3/users/88409716fa9b42bb9f054a391e4caabc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:22.372819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161db9e-91cf-4f07-ac64-7a2097366bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88409716fa9b42bb9f054a391e4caabc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:22.375672 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161db9e-91cf-4f07-ac64-7a2097366bd1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:22.438706 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-9f507403-c1cd-4366-9dde-2f14f10daf04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526d40ba8adb43148a70ceadebde05ef', 'request_id': 'req-9f507403-c1cd-4366-9dde-2f14f10daf04'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:22.540731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-9f507403-c1cd-4366-9dde-2f14f10daf04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526d40ba8adb43148a70ceadebde05ef', 'request_id': 'req-9f507403-c1cd-4366-9dde-2f14f10daf04'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:22.563124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-9f507403-c1cd-4366-9dde-2f14f10daf04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526d40ba8adb43148a70ceadebde05ef', 'request_id': 'req-9f507403-c1cd-4366-9dde-2f14f10daf04'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:22.563124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-9f507403-c1cd-4366-9dde-2f14f10daf04 admin admin] The token cache is being invalidate because project 526d40ba8adb43148a70ceadebde05ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:58:22.563124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-9f507403-c1cd-4366-9dde-2f14f10daf04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:22.563432 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-9f507403-c1cd-4366-9dde-2f14f10daf04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:22.565145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1217/2430] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:22 2022] DELETE /identity/v3/projects/526d40ba8adb43148a70ceadebde05ef => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:22.569950 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81807a-8cf2-4888-99c3-0c63b4a36fe5 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:22.570243 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81807a-8cf2-4888-99c3-0c63b4a36fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:22.570674 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81807a-8cf2-4888-99c3-0c63b4a36fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:22.582918 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:22.603040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-ee81807a-8cf2-4888-99c3-0c63b4a36fe5 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:22.604392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ee81807a-8cf2-4888-99c3-0c63b4a36fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:22.606596 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-2161db9e-91cf-4f07-ac64-7a2097366bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88409716fa9b42bb9f054a391e4caabc'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:22.666908 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1218/2431] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:58:22.678996 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d46a4-eb12-4c30-b9db-e62f82a992d9 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:22.679225 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d46a4-eb12-4c30-b9db-e62f82a992d9 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:22.679709 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d46a4-eb12-4c30-b9db-e62f82a992d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:22.699701 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-bd9d46a4-eb12-4c30-b9db-e62f82a992d9 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:22.700965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-bd9d46a4-eb12-4c30-b9db-e62f82a992d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:22.709140 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-2161db9e-91cf-4f07-ac64-7a2097366bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88409716fa9b42bb9f054a391e4caabc'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:22.709863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-2161db9e-91cf-4f07-ac64-7a2097366bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88409716fa9b42bb9f054a391e4caabc'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:22.712747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1219/2432] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:58:22.721446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d46a4-eb12-4c30-b9db-e62f82a992d9 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:22.730070 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-2161db9e-91cf-4f07-ac64-7a2097366bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88409716fa9b42bb9f054a391e4caabc'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:22.731007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-2161db9e-91cf-4f07-ac64-7a2097366bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88409716fa9b42bb9f054a391e4caabc'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:22.731118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d46a4-eb12-4c30-b9db-e62f82a992d9 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:22.736531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a023a-1d29-43b0-9e73-48d6f3092253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:22.737234 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a023a-1d29-43b0-9e73-48d6f3092253 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:22.737670 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a023a-1d29-43b0-9e73-48d6f3092253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:22.737954 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a023a-1d29-43b0-9e73-48d6f3092253 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:22.738695 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a023a-1d29-43b0-9e73-48d6f3092253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:58:22.739006 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a023a-1d29-43b0-9e73-48d6f3092253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:22.740644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a023a-1d29-43b0-9e73-48d6f3092253 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:22.747134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1214/2433] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:22 2022] DELETE /identity/v3/users/88409716fa9b42bb9f054a391e4caabc => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:22.751305 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1dc7a9-e681-442a-a5f9-e89b0919dd30 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:22.751682 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1dc7a9-e681-442a-a5f9-e89b0919dd30 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:22.752019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1dc7a9-e681-442a-a5f9-e89b0919dd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:22.756641 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1220/2434] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:58:22.758615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a023a-1d29-43b0-9e73-48d6f3092253 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:22.762127 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-840a023a-1d29-43b0-9e73-48d6f3092253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:22.771462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-8d1dc7a9-e681-442a-a5f9-e89b0919dd30 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:22.774266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8d1dc7a9-e681-442a-a5f9-e89b0919dd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:22.777923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a023a-1d29-43b0-9e73-48d6f3092253 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:22.840355 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1eff0c-9284-4c40-8c9c-d08842013029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:22.841065 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1eff0c-9284-4c40-8c9c-d08842013029 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:22.841346 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1eff0c-9284-4c40-8c9c-d08842013029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:22.841618 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1eff0c-9284-4c40-8c9c-d08842013029 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:22.842302 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1eff0c-9284-4c40-8c9c-d08842013029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:22.843336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1215/2435] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:58:22.847087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1eff0c-9284-4c40-8c9c-d08842013029 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:22.854685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1dc7a9-e681-442a-a5f9-e89b0919dd30 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:22.855618 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8d1dc7a9-e681-442a-a5f9-e89b0919dd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:22.917969 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1221/2436] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:58:22 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:58:22.919936 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1dc7a9-e681-442a-a5f9-e89b0919dd30 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:22.923741 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1eff0c-9284-4c40-8c9c-d08842013029 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:22.946043 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:22.969521 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de9b74-0b9e-425c-b5d9-c504e2636f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:22.970175 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de9b74-0b9e-425c-b5d9-c504e2636f0c service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:22.970460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de9b74-0b9e-425c-b5d9-c504e2636f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:22.970740 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de9b74-0b9e-425c-b5d9-c504e2636f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:22.989063 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1eff0c-9284-4c40-8c9c-d08842013029 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:22.994868 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d14dd-980f-4836-b65c-cdf9887db5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:22.995620 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d14dd-980f-4836-b65c-cdf9887db5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:22.996017 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d14dd-980f-4836-b65c-cdf9887db5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:22.996417 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d14dd-980f-4836-b65c-cdf9887db5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:22.997578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d14dd-980f-4836-b65c-cdf9887db5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:22.999616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d14dd-980f-4836-b65c-cdf9887db5a4 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:23.010596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:23.041966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de9b74-0b9e-425c-b5d9-c504e2636f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:23.043405 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de9b74-0b9e-425c-b5d9-c504e2636f0c service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:23.052958 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1216/2437] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:58:23.110067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1222/2438] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:58:22 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:58:23.111327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de9b74-0b9e-425c-b5d9-c504e2636f0c service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:23.121560 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de9b74-0b9e-425c-b5d9-c504e2636f0c service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:23.127607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c1602-7ccf-4715-993c-73e8f1862143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:23.128393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c1602-7ccf-4715-993c-73e8f1862143 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:23.128610 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c1602-7ccf-4715-993c-73e8f1862143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:23.128888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c1602-7ccf-4715-993c-73e8f1862143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:23.133697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c1602-7ccf-4715-993c-73e8f1862143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:23.133697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c1602-7ccf-4715-993c-73e8f1862143 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:23.141624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1217/2439] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:58:23.145466 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d14dd-980f-4836-b65c-cdf9887db5a4 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:23.155720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d14dd-980f-4836-b65c-cdf9887db5a4 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:23.161013 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940955d-c346-41f0-a0f5-9a32cd209fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:23.161676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940955d-c346-41f0-a0f5-9a32cd209fed admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:23.161962 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940955d-c346-41f0-a0f5-9a32cd209fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:23.162245 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940955d-c346-41f0-a0f5-9a32cd209fed admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:23.162967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940955d-c346-41f0-a0f5-9a32cd209fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:23.167763 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940955d-c346-41f0-a0f5-9a32cd209fed admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:23.174913 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1223/2440] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:58:23.179120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c1602-7ccf-4715-993c-73e8f1862143 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:23.188914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c1602-7ccf-4715-993c-73e8f1862143 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:23.193537 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ef657-c572-4cf9-bc44-e3beaf672174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:23.194411 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ef657-c572-4cf9-bc44-e3beaf672174 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:23.194690 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ef657-c572-4cf9-bc44-e3beaf672174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:23.194958 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ef657-c572-4cf9-bc44-e3beaf672174 admin admin] PATH_INFO: `/v3/projects/f9756394d70e43c4815b8291e4ca8307/users/41bad631b0b848df84f0765c7452aa2d/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:23.210068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ef657-c572-4cf9-bc44-e3beaf672174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9756394d70e43c4815b8291e4ca8307, user_id=41bad631b0b848df84f0765c7452aa2d, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:23.212720 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ef657-c572-4cf9-bc44-e3beaf672174 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:23.280573 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1218/2441] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:23 2022] PUT /identity/v3/projects/f9756394d70e43c4815b8291e4ca8307/users/41bad631b0b848df84f0765c7452aa2d/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:23.290879 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581c4c6-1f3b-4f6b-895a-29e2293c9388 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:23.291169 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581c4c6-1f3b-4f6b-895a-29e2293c9388 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:23.291449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581c4c6-1f3b-4f6b-895a-29e2293c9388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:23.318943 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-3581c4c6-1f3b-4f6b-895a-29e2293c9388 None None] MFA Rules not processed for user `41bad631b0b848df84f0765c7452aa2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:23.320180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3581c4c6-1f3b-4f6b-895a-29e2293c9388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:23.385336 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1224/2442] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:23.389780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ef657-c572-4cf9-bc44-e3beaf672174 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:23.450843 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ef657-c572-4cf9-bc44-e3beaf672174 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:23.456107 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f4f22-7b3a-4aeb-947b-be89b89e751a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:23.456791 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f4f22-7b3a-4aeb-947b-be89b89e751a admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:23.457100 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f4f22-7b3a-4aeb-947b-be89b89e751a admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:23.457380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f4f22-7b3a-4aeb-947b-be89b89e751a admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:23.458069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f4f22-7b3a-4aeb-947b-be89b89e751a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:23.459961 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f4f22-7b3a-4aeb-947b-be89b89e751a admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:23.465121 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581c4c6-1f3b-4f6b-895a-29e2293c9388 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:23.466602 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3581c4c6-1f3b-4f6b-895a-29e2293c9388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:23.488811 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581c4c6-1f3b-4f6b-895a-29e2293c9388 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:23.494285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a332c8-d9da-4100-91ef-b7a40a1b0048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:23.495182 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a332c8-d9da-4100-91ef-b7a40a1b0048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:23.495463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a332c8-d9da-4100-91ef-b7a40a1b0048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:23.495779 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a332c8-d9da-4100-91ef-b7a40a1b0048 admin admin] PATH_INFO: `/v3/projects/75c30fdf12c04987a7099a21b1ef4a8c` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:23.497112 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a332c8-d9da-4100-91ef-b7a40a1b0048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c30fdf12c04987a7099a21b1ef4a8c)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:23.499122 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a332c8-d9da-4100-91ef-b7a40a1b0048 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:23.527982 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1219/2443] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:58:23 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:58:23.531913 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f4f22-7b3a-4aeb-947b-be89b89e751a admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:23.561501 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:23.593014 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f4f22-7b3a-4aeb-947b-be89b89e751a admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:23.597970 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdb3ec-b70c-46db-a4c2-8d7926d5a1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:23.599099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdb3ec-b70c-46db-a4c2-8d7926d5a1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:23.599462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdb3ec-b70c-46db-a4c2-8d7926d5a1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:23.599732 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdb3ec-b70c-46db-a4c2-8d7926d5a1d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:23.600418 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdb3ec-b70c-46db-a4c2-8d7926d5a1d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:23.602384 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdb3ec-b70c-46db-a4c2-8d7926d5a1d9 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:23.615672 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-f2a332c8-d9da-4100-91ef-b7a40a1b0048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c30fdf12c04987a7099a21b1ef4a8c', 'request_id': 'req-f2a332c8-d9da-4100-91ef-b7a40a1b0048'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:23.680725 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-f2a332c8-d9da-4100-91ef-b7a40a1b0048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c30fdf12c04987a7099a21b1ef4a8c', 'request_id': 'req-f2a332c8-d9da-4100-91ef-b7a40a1b0048'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:23.691334 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1220/2444] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:58:23 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:58:23.691832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-f2a332c8-d9da-4100-91ef-b7a40a1b0048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c30fdf12c04987a7099a21b1ef4a8c', 'request_id': 'req-f2a332c8-d9da-4100-91ef-b7a40a1b0048'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:23.692504 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdb3ec-b70c-46db-a4c2-8d7926d5a1d9 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:23.703059 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-f2a332c8-d9da-4100-91ef-b7a40a1b0048 admin admin] The token cache is being invalidate because project 75c30fdf12c04987a7099a21b1ef4a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:58:23.703395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdb3ec-b70c-46db-a4c2-8d7926d5a1d9 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:23.703660 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-f2a332c8-d9da-4100-91ef-b7a40a1b0048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:23.704388 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-f2a332c8-d9da-4100-91ef-b7a40a1b0048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:23.709708 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1225/2445] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:23 2022] DELETE /identity/v3/projects/75c30fdf12c04987a7099a21b1ef4a8c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:58:23.710573 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a332c8-d9da-4100-91ef-b7a40a1b0048 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:23.715476 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f2a332c8-d9da-4100-91ef-b7a40a1b0048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:23.778654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db8070-e388-4cdd-9595-7c5455f610f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:23.779336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db8070-e388-4cdd-9595-7c5455f610f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:23.779613 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db8070-e388-4cdd-9595-7c5455f610f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:23.779937 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db8070-e388-4cdd-9595-7c5455f610f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:23.780823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db8070-e388-4cdd-9595-7c5455f610f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:23.783155 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db8070-e388-4cdd-9595-7c5455f610f2 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:23.784858 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:23.789388 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a332c8-d9da-4100-91ef-b7a40a1b0048 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:23.797898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1221/2446] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:58:23.799468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db8070-e388-4cdd-9595-7c5455f610f2 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:23.801324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d3db8070-e388-4cdd-9595-7c5455f610f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:23.805585 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890fa56-8705-42c1-b8c4-80846f177620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:23.807010 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890fa56-8705-42c1-b8c4-80846f177620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:23.807301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890fa56-8705-42c1-b8c4-80846f177620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:23.807584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890fa56-8705-42c1-b8c4-80846f177620 admin admin] PATH_INFO: `/v3/users/941088ce03bd4694b3c473ce022b73ac` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:23.808922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890fa56-8705-42c1-b8c4-80846f177620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=941088ce03bd4694b3c473ce022b73ac)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:23.811045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890fa56-8705-42c1-b8c4-80846f177620 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:23.814620 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db8070-e388-4cdd-9595-7c5455f610f2 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:23.819491 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a7792-333f-4092-9bcf-50238f13cabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:23.820384 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a7792-333f-4092-9bcf-50238f13cabf admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:23.820703 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a7792-333f-4092-9bcf-50238f13cabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:23.820978 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a7792-333f-4092-9bcf-50238f13cabf admin admin] PATH_INFO: `/v3/projects/0d6505aaac9f46b197f0080193157b29/users/79610395c86c4a62ac175e0f2a46d708/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:23.843452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a7792-333f-4092-9bcf-50238f13cabf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6505aaac9f46b197f0080193157b29, user_id=79610395c86c4a62ac175e0f2a46d708, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:23.843452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a7792-333f-4092-9bcf-50238f13cabf admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:23.972123 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1222/2447] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:23 2022] PUT /identity/v3/projects/0d6505aaac9f46b197f0080193157b29/users/79610395c86c4a62ac175e0f2a46d708/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:23.976017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a7792-333f-4092-9bcf-50238f13cabf admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:24.037537 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a7792-333f-4092-9bcf-50238f13cabf admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:24.042262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4af9b-1686-4b0e-914e-16b67fea3268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:24.042999 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4af9b-1686-4b0e-914e-16b67fea3268 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:24.043180 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4af9b-1686-4b0e-914e-16b67fea3268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:24.043525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4af9b-1686-4b0e-914e-16b67fea3268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:24.044262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4af9b-1686-4b0e-914e-16b67fea3268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:24.045956 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4af9b-1686-4b0e-914e-16b67fea3268 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:24.056019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1223/2448] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:58:24.060687 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4af9b-1686-4b0e-914e-16b67fea3268 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:24.070648 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4af9b-1686-4b0e-914e-16b67fea3268 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:24.075309 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6293ff-da0b-4a98-98ce-9ac741062cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:24.076175 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6293ff-da0b-4a98-98ce-9ac741062cab admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:24.076516 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6293ff-da0b-4a98-98ce-9ac741062cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:24.076824 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6293ff-da0b-4a98-98ce-9ac741062cab admin admin] PATH_INFO: `/v3/projects/0d6505aaac9f46b197f0080193157b29/users/79610395c86c4a62ac175e0f2a46d708/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:24.079376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6293ff-da0b-4a98-98ce-9ac741062cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6505aaac9f46b197f0080193157b29, user_id=79610395c86c4a62ac175e0f2a46d708, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:24.082020 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6293ff-da0b-4a98-98ce-9ac741062cab admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:24.091093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-5890fa56-8705-42c1-b8c4-80846f177620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '941088ce03bd4694b3c473ce022b73ac'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:24.091901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-5890fa56-8705-42c1-b8c4-80846f177620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '941088ce03bd4694b3c473ce022b73ac'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:24.092704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-5890fa56-8705-42c1-b8c4-80846f177620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '941088ce03bd4694b3c473ce022b73ac'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:24.103186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1224/2449] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:24 2022] PUT /identity/v3/projects/0d6505aaac9f46b197f0080193157b29/users/79610395c86c4a62ac175e0f2a46d708/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:58:24.105139 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f2a27-a298-453f-be4c-9ae978ef8e01 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:24.105386 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f2a27-a298-453f-be4c-9ae978ef8e01 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:24.109530 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f2a27-a298-453f-be4c-9ae978ef8e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:24.119323 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-5890fa56-8705-42c1-b8c4-80846f177620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '941088ce03bd4694b3c473ce022b73ac'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:24.128374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-5890fa56-8705-42c1-b8c4-80846f177620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '941088ce03bd4694b3c473ce022b73ac'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:24.132442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:24.133745 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-640f2a27-a298-453f-be4c-9ae978ef8e01 None None] MFA Rules not processed for user `79610395c86c4a62ac175e0f2a46d708`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:24.134957 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-640f2a27-a298-453f-be4c-9ae978ef8e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:24.202747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1225/2450] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:58:24.214025 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f2a27-a298-453f-be4c-9ae978ef8e01 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:24.215391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-640f2a27-a298-453f-be4c-9ae978ef8e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:24.236396 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1226/2451] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:23 2022] DELETE /identity/v3/users/941088ce03bd4694b3c473ce022b73ac => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:24.276722 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f2a27-a298-453f-be4c-9ae978ef8e01 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:24.330698 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fcfee-8b03-4d0f-ac30-6f3c2ad73cb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:24.331356 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fcfee-8b03-4d0f-ac30-6f3c2ad73cb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:24.331646 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fcfee-8b03-4d0f-ac30-6f3c2ad73cb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:24.331926 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fcfee-8b03-4d0f-ac30-6f3c2ad73cb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:24.392519 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3fcfee-8b03-4d0f-ac30-6f3c2ad73cb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:24.394059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3fcfee-8b03-4d0f-ac30-6f3c2ad73cb9 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:24.403641 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1226/2452] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:58:24.431759 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890fa56-8705-42c1-b8c4-80846f177620 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:24.433504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-5890fa56-8705-42c1-b8c4-80846f177620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:24.499628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890fa56-8705-42c1-b8c4-80846f177620 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:24.504898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3a49a-e870-4779-a7ca-0092d59b5c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:24.507047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3a49a-e870-4779-a7ca-0092d59b5c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:24.507047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3a49a-e870-4779-a7ca-0092d59b5c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:24.507047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3a49a-e870-4779-a7ca-0092d59b5c61 admin admin] PATH_INFO: `/v3/users/41bad631b0b848df84f0765c7452aa2d` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:24.507481 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3a49a-e870-4779-a7ca-0092d59b5c61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41bad631b0b848df84f0765c7452aa2d)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:24.509439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3a49a-e870-4779-a7ca-0092d59b5c61 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:24.680857 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fcfee-8b03-4d0f-ac30-6f3c2ad73cb9 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:24.682641 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-7d3fcfee-8b03-4d0f-ac30-6f3c2ad73cb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:24.693602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:24.698487 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fcfee-8b03-4d0f-ac30-6f3c2ad73cb9 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:24.703541 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b51fa-59aa-46fa-b18b-e3ec79dd991f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:24.704410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b51fa-59aa-46fa-b18b-e3ec79dd991f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:24.704787 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b51fa-59aa-46fa-b18b-e3ec79dd991f admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:24.705154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b51fa-59aa-46fa-b18b-e3ec79dd991f admin admin] PATH_INFO: `/v3/projects/32157cc5ee134c52a2943e791362156d` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:24.719056 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b51fa-59aa-46fa-b18b-e3ec79dd991f admin admin] RBAC: Authorizing `identity:delete_project(project_id=32157cc5ee134c52a2943e791362156d)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:24.719056 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b51fa-59aa-46fa-b18b-e3ec79dd991f admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:24.752103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-19e3a49a-e870-4779-a7ca-0092d59b5c61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41bad631b0b848df84f0765c7452aa2d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:24.752953 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-19e3a49a-e870-4779-a7ca-0092d59b5c61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41bad631b0b848df84f0765c7452aa2d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:24.753465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-19e3a49a-e870-4779-a7ca-0092d59b5c61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41bad631b0b848df84f0765c7452aa2d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:24.765359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-19e3a49a-e870-4779-a7ca-0092d59b5c61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41bad631b0b848df84f0765c7452aa2d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:24.772111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-19e3a49a-e870-4779-a7ca-0092d59b5c61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41bad631b0b848df84f0765c7452aa2d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:24.775688 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:24.800597 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f77b51fa-59aa-46fa-b18b-e3ec79dd991f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32157cc5ee134c52a2943e791362156d', 'request_id': 'req-f77b51fa-59aa-46fa-b18b-e3ec79dd991f'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:24.805882 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f77b51fa-59aa-46fa-b18b-e3ec79dd991f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32157cc5ee134c52a2943e791362156d', 'request_id': 'req-f77b51fa-59aa-46fa-b18b-e3ec79dd991f'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:24.897980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1227/2453] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:24 2022] DELETE /identity/v3/users/41bad631b0b848df84f0765c7452aa2d => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:24.902521 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827505b5-ff79-4e39-8aad-af483eceb1f1 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:24.902838 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827505b5-ff79-4e39-8aad-af483eceb1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:24.903118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827505b5-ff79-4e39-8aad-af483eceb1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:24.921041 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-827505b5-ff79-4e39-8aad-af483eceb1f1 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:24.922825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-827505b5-ff79-4e39-8aad-af483eceb1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:24.948850 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f77b51fa-59aa-46fa-b18b-e3ec79dd991f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32157cc5ee134c52a2943e791362156d', 'request_id': 'req-f77b51fa-59aa-46fa-b18b-e3ec79dd991f'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:24.960666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f77b51fa-59aa-46fa-b18b-e3ec79dd991f admin admin] The token cache is being invalidate because project 32157cc5ee134c52a2943e791362156d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:58:24.960963 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f77b51fa-59aa-46fa-b18b-e3ec79dd991f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:24.961605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-f77b51fa-59aa-46fa-b18b-e3ec79dd991f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:24.963385 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1227/2454] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:24 2022] DELETE /identity/v3/projects/32157cc5ee134c52a2943e791362156d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:58:24.967098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b51fa-59aa-46fa-b18b-e3ec79dd991f admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:24.968467 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f77b51fa-59aa-46fa-b18b-e3ec79dd991f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:24.980406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1228/2455] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:24.991855 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827505b5-ff79-4e39-8aad-af483eceb1f1 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:24.993377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-827505b5-ff79-4e39-8aad-af483eceb1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:25.034384 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b51fa-59aa-46fa-b18b-e3ec79dd991f admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:25.039165 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcf69c-2613-40ec-9766-7f2cbac3f63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:25.040065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcf69c-2613-40ec-9766-7f2cbac3f63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:25.040389 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcf69c-2613-40ec-9766-7f2cbac3f63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:25.040682 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcf69c-2613-40ec-9766-7f2cbac3f63d admin admin] PATH_INFO: `/v3/users/e6df6b17303446e09cdd3bb1cbf42716` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:25.041864 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcf69c-2613-40ec-9766-7f2cbac3f63d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6df6b17303446e09cdd3bb1cbf42716)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:25.043777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcf69c-2613-40ec-9766-7f2cbac3f63d admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:25.052259 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827505b5-ff79-4e39-8aad-af483eceb1f1 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:25.056289 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbadbc8-9032-458d-8b08-e2c1190b8c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:25.056987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbadbc8-9032-458d-8b08-e2c1190b8c93 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:25.057274 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbadbc8-9032-458d-8b08-e2c1190b8c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:25.057582 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbadbc8-9032-458d-8b08-e2c1190b8c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:25.069170 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbadbc8-9032-458d-8b08-e2c1190b8c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:25.070629 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbadbc8-9032-458d-8b08-e2c1190b8c93 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:25.080566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1229/2456] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:58:25.229223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-71fcf69c-2613-40ec-9766-7f2cbac3f63d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6df6b17303446e09cdd3bb1cbf42716'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:25.353313 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-71fcf69c-2613-40ec-9766-7f2cbac3f63d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6df6b17303446e09cdd3bb1cbf42716'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:25.353958 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-71fcf69c-2613-40ec-9766-7f2cbac3f63d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6df6b17303446e09cdd3bb1cbf42716'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:25.367653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-71fcf69c-2613-40ec-9766-7f2cbac3f63d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6df6b17303446e09cdd3bb1cbf42716'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:25.368378 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-71fcf69c-2613-40ec-9766-7f2cbac3f63d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6df6b17303446e09cdd3bb1cbf42716'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:25.381726 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1228/2457] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:24 2022] DELETE /identity/v3/users/e6df6b17303446e09cdd3bb1cbf42716 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:58:25.746687 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbadbc8-9032-458d-8b08-e2c1190b8c93 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:25.748274 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ddbadbc8-9032-458d-8b08-e2c1190b8c93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:25.761930 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbadbc8-9032-458d-8b08-e2c1190b8c93 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:25.802289 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcf69c-2613-40ec-9766-7f2cbac3f63d admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:25.803828 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-71fcf69c-2613-40ec-9766-7f2cbac3f63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:25.814679 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:25.831298 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547e635-4b51-445b-8db2-759b19b4360e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:25.832438 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547e635-4b51-445b-8db2-759b19b4360e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:25.832814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547e635-4b51-445b-8db2-759b19b4360e admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:25.833092 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547e635-4b51-445b-8db2-759b19b4360e admin admin] PATH_INFO: `/v3/projects/f9756394d70e43c4815b8291e4ca8307` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:25.834481 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547e635-4b51-445b-8db2-759b19b4360e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9756394d70e43c4815b8291e4ca8307)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:25.836436 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547e635-4b51-445b-8db2-759b19b4360e admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:25.873378 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcf69c-2613-40ec-9766-7f2cbac3f63d admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:25.878535 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c21b6-fd2b-40b4-96ef-aae10bb4e658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:25.879431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c21b6-fd2b-40b4-96ef-aae10bb4e658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:25.879716 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c21b6-fd2b-40b4-96ef-aae10bb4e658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:25.879995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c21b6-fd2b-40b4-96ef-aae10bb4e658 admin admin] PATH_INFO: `/v3/projects/8615d6d8c9334b95aab71d4bdeb2bcbb` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:25.881192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c21b6-fd2b-40b4-96ef-aae10bb4e658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8615d6d8c9334b95aab71d4bdeb2bcbb)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:25.883144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c21b6-fd2b-40b4-96ef-aae10bb4e658 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:25.955633 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:25.962531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2547e635-4b51-445b-8db2-759b19b4360e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9756394d70e43c4815b8291e4ca8307', 'request_id': 'req-2547e635-4b51-445b-8db2-759b19b4360e'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:25.985767 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-664c21b6-fd2b-40b4-96ef-aae10bb4e658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8615d6d8c9334b95aab71d4bdeb2bcbb', 'request_id': 'req-664c21b6-fd2b-40b4-96ef-aae10bb4e658'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:25.991417 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-664c21b6-fd2b-40b4-96ef-aae10bb4e658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8615d6d8c9334b95aab71d4bdeb2bcbb', 'request_id': 'req-664c21b6-fd2b-40b4-96ef-aae10bb4e658'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:26.034882 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2547e635-4b51-445b-8db2-759b19b4360e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9756394d70e43c4815b8291e4ca8307', 'request_id': 'req-2547e635-4b51-445b-8db2-759b19b4360e'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:26.041820 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2547e635-4b51-445b-8db2-759b19b4360e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9756394d70e43c4815b8291e4ca8307', 'request_id': 'req-2547e635-4b51-445b-8db2-759b19b4360e'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:26.052733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2547e635-4b51-445b-8db2-759b19b4360e admin admin] The token cache is being invalidate because project f9756394d70e43c4815b8291e4ca8307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:58:26.052986 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2547e635-4b51-445b-8db2-759b19b4360e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:26.053607 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2547e635-4b51-445b-8db2-759b19b4360e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:26.055367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1230/2458] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:25 2022] DELETE /identity/v3/projects/f9756394d70e43c4815b8291e4ca8307 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:26.059257 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547e635-4b51-445b-8db2-759b19b4360e admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:26.060727 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2547e635-4b51-445b-8db2-759b19b4360e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:26.083609 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-664c21b6-fd2b-40b4-96ef-aae10bb4e658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8615d6d8c9334b95aab71d4bdeb2bcbb', 'request_id': 'req-664c21b6-fd2b-40b4-96ef-aae10bb4e658'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:26.095190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-664c21b6-fd2b-40b4-96ef-aae10bb4e658 admin admin] The token cache is being invalidate because project 8615d6d8c9334b95aab71d4bdeb2bcbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:58:26.095485 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-664c21b6-fd2b-40b4-96ef-aae10bb4e658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:26.096116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-664c21b6-fd2b-40b4-96ef-aae10bb4e658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:26.097710 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1229/2459] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:25 2022] DELETE /identity/v3/projects/8615d6d8c9334b95aab71d4bdeb2bcbb => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:58:26.103538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3da8f0-bb74-4476-a140-2614aacbb848 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:26.103831 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3da8f0-bb74-4476-a140-2614aacbb848 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:26.104260 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3da8f0-bb74-4476-a140-2614aacbb848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:26.123079 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-fb3da8f0-bb74-4476-a140-2614aacbb848 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:26.124225 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-fb3da8f0-bb74-4476-a140-2614aacbb848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:26.126218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547e635-4b51-445b-8db2-759b19b4360e admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:26.180195 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852eca57-e6de-4c3e-8362-9b36b711aeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:26.181106 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852eca57-e6de-4c3e-8362-9b36b711aeb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:26.181388 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852eca57-e6de-4c3e-8362-9b36b711aeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:26.181683 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852eca57-e6de-4c3e-8362-9b36b711aeb2 admin admin] PATH_INFO: `/v3/users/79610395c86c4a62ac175e0f2a46d708` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:26.183052 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852eca57-e6de-4c3e-8362-9b36b711aeb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79610395c86c4a62ac175e0f2a46d708)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:26.184979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1230/2460] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:58:26.185118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852eca57-e6de-4c3e-8362-9b36b711aeb2 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:26.193487 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0221f-dfea-4bc7-9a3f-43e146e78578 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:26.193783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0221f-dfea-4bc7-9a3f-43e146e78578 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:26.194070 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0221f-dfea-4bc7-9a3f-43e146e78578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:26.212680 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-73b0221f-dfea-4bc7-9a3f-43e146e78578 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:26.213941 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-73b0221f-dfea-4bc7-9a3f-43e146e78578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:26.221807 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1231/2461] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:58:26.225934 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0221f-dfea-4bc7-9a3f-43e146e78578 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:26.235265 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0221f-dfea-4bc7-9a3f-43e146e78578 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:26.239896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22731efa-f9d3-4b12-8e9e-15143bc7105b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:26.240520 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22731efa-f9d3-4b12-8e9e-15143bc7105b admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:26.240831 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22731efa-f9d3-4b12-8e9e-15143bc7105b admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:26.241359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22731efa-f9d3-4b12-8e9e-15143bc7105b admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:26.242070 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22731efa-f9d3-4b12-8e9e-15143bc7105b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:58:26.242372 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22731efa-f9d3-4b12-8e9e-15143bc7105b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:26.243935 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22731efa-f9d3-4b12-8e9e-15143bc7105b admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:26.255704 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1232/2462] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:58:26.259689 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22731efa-f9d3-4b12-8e9e-15143bc7105b admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:26.268972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22731efa-f9d3-4b12-8e9e-15143bc7105b admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:26.273612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b975a-acb1-404a-b60c-ea5cb26fe4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:26.274215 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b975a-acb1-404a-b60c-ea5cb26fe4ef admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:26.274499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b975a-acb1-404a-b60c-ea5cb26fe4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:26.274783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b975a-acb1-404a-b60c-ea5cb26fe4ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:26.275448 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b975a-acb1-404a-b60c-ea5cb26fe4ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:26.277310 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b975a-acb1-404a-b60c-ea5cb26fe4ef admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:26.292894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:26.373699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1233/2463] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:58:26 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:58:26.377398 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b975a-acb1-404a-b60c-ea5cb26fe4ef admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:26.408655 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-852eca57-e6de-4c3e-8362-9b36b711aeb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79610395c86c4a62ac175e0f2a46d708'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:26.409338 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-852eca57-e6de-4c3e-8362-9b36b711aeb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79610395c86c4a62ac175e0f2a46d708'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:26.409956 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-852eca57-e6de-4c3e-8362-9b36b711aeb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79610395c86c4a62ac175e0f2a46d708'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:26.422690 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-852eca57-e6de-4c3e-8362-9b36b711aeb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79610395c86c4a62ac175e0f2a46d708'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:26.430196 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-852eca57-e6de-4c3e-8362-9b36b711aeb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79610395c86c4a62ac175e0f2a46d708'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:26.434251 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:26.438649 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b975a-acb1-404a-b60c-ea5cb26fe4ef admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:26.443308 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07590b4d-3c77-46c0-9d85-8b3ce440cf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:26.444624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07590b4d-3c77-46c0-9d85-8b3ce440cf61 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:26.444624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07590b4d-3c77-46c0-9d85-8b3ce440cf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:26.444624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07590b4d-3c77-46c0-9d85-8b3ce440cf61 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:26.445342 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07590b4d-3c77-46c0-9d85-8b3ce440cf61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:26.447245 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07590b4d-3c77-46c0-9d85-8b3ce440cf61 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:26.506989 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1231/2464] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:26 2022] DELETE /identity/v3/users/79610395c86c4a62ac175e0f2a46d708 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:58:26.536510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1234/2465] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:58:26 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:58:26.548635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852eca57-e6de-4c3e-8362-9b36b711aeb2 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:26.550059 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-852eca57-e6de-4c3e-8362-9b36b711aeb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:26.618520 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852eca57-e6de-4c3e-8362-9b36b711aeb2 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:26.623163 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42591e8-281c-4bff-9d26-b23fb270ee10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:26.623886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42591e8-281c-4bff-9d26-b23fb270ee10 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:26.624113 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42591e8-281c-4bff-9d26-b23fb270ee10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:26.624388 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42591e8-281c-4bff-9d26-b23fb270ee10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:26.625215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42591e8-281c-4bff-9d26-b23fb270ee10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:26.626830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42591e8-281c-4bff-9d26-b23fb270ee10 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:26.639653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1232/2466] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:58:26.640759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07590b4d-3c77-46c0-9d85-8b3ce440cf61 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:26.650913 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07590b4d-3c77-46c0-9d85-8b3ce440cf61 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:26.655635 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893860b2-3337-409b-9155-871fdca121b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:26.656828 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893860b2-3337-409b-9155-871fdca121b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:26.657112 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893860b2-3337-409b-9155-871fdca121b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:26.657419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893860b2-3337-409b-9155-871fdca121b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:26.658145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893860b2-3337-409b-9155-871fdca121b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:26.659804 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893860b2-3337-409b-9155-871fdca121b8 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:26.669593 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1235/2467] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:58:26.674321 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42591e8-281c-4bff-9d26-b23fb270ee10 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:26.684321 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42591e8-281c-4bff-9d26-b23fb270ee10 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:26.695133 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2a153-0945-4ee9-8760-5cb340992bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:26.695133 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2a153-0945-4ee9-8760-5cb340992bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:26.695133 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2a153-0945-4ee9-8760-5cb340992bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:26.695133 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2a153-0945-4ee9-8760-5cb340992bc8 admin admin] PATH_INFO: `/v3/projects/4f1f5c6247e2408b8b9ed18cbfc904a5/users/2138f2ae725b44e0ba2a2a5c163c2e37/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:26.707076 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2a153-0945-4ee9-8760-5cb340992bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1f5c6247e2408b8b9ed18cbfc904a5, user_id=2138f2ae725b44e0ba2a2a5c163c2e37, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:26.709787 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2a153-0945-4ee9-8760-5cb340992bc8 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:26.837779 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1233/2468] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:26 2022] PUT /identity/v3/projects/4f1f5c6247e2408b8b9ed18cbfc904a5/users/2138f2ae725b44e0ba2a2a5c163c2e37/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:26.850434 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e69de3-e8d9-4d21-91f6-7e1d26bd3f7d None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:26.850881 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e69de3-e8d9-4d21-91f6-7e1d26bd3f7d None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:26.851008 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e69de3-e8d9-4d21-91f6-7e1d26bd3f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:26.877056 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-e7e69de3-e8d9-4d21-91f6-7e1d26bd3f7d None None] MFA Rules not processed for user `2138f2ae725b44e0ba2a2a5c163c2e37`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:26.878182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e7e69de3-e8d9-4d21-91f6-7e1d26bd3f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:26.941372 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1236/2469] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:26.946074 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2a153-0945-4ee9-8760-5cb340992bc8 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:26.996665 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e69de3-e8d9-4d21-91f6-7e1d26bd3f7d None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:26.998269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e7e69de3-e8d9-4d21-91f6-7e1d26bd3f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:27.023194 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2a153-0945-4ee9-8760-5cb340992bc8 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:27.027805 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16b41e-0de8-41d8-a82b-b0fb93b7d5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:27.028483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16b41e-0de8-41d8-a82b-b0fb93b7d5ae admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.028802 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16b41e-0de8-41d8-a82b-b0fb93b7d5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.029083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16b41e-0de8-41d8-a82b-b0fb93b7d5ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.031398 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16b41e-0de8-41d8-a82b-b0fb93b7d5ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:27.032834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16b41e-0de8-41d8-a82b-b0fb93b7d5ae admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:27.072416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e69de3-e8d9-4d21-91f6-7e1d26bd3f7d None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:27.077124 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79f094-94a2-41be-bf9e-640a95fcb98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:27.077984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79f094-94a2-41be-bf9e-640a95fcb98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.078852 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79f094-94a2-41be-bf9e-640a95fcb98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.079135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79f094-94a2-41be-bf9e-640a95fcb98f admin admin] PATH_INFO: `/v3/projects/0d6505aaac9f46b197f0080193157b29` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.080552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79f094-94a2-41be-bf9e-640a95fcb98f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6505aaac9f46b197f0080193157b29)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:27.082590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79f094-94a2-41be-bf9e-640a95fcb98f admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:27.088885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:27.122198 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1234/2470] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:58:26 2022] POST /identity/v3/projects => generated 389 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:58:27.126704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16b41e-0de8-41d8-a82b-b0fb93b7d5ae admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:27.177263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:27.187363 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16b41e-0de8-41d8-a82b-b0fb93b7d5ae admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:27.193520 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-cf79f094-94a2-41be-bf9e-640a95fcb98f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6505aaac9f46b197f0080193157b29', 'request_id': 'req-cf79f094-94a2-41be-bf9e-640a95fcb98f'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:27.199560 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-cf79f094-94a2-41be-bf9e-640a95fcb98f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6505aaac9f46b197f0080193157b29', 'request_id': 'req-cf79f094-94a2-41be-bf9e-640a95fcb98f'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:27.242630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24d602-5f8c-4ba7-b208-22477c9ed550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:27.243412 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24d602-5f8c-4ba7-b208-22477c9ed550 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.243700 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24d602-5f8c-4ba7-b208-22477c9ed550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.243978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24d602-5f8c-4ba7-b208-22477c9ed550 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.244723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24d602-5f8c-4ba7-b208-22477c9ed550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:27.246648 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24d602-5f8c-4ba7-b208-22477c9ed550 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:27.272094 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-cf79f094-94a2-41be-bf9e-640a95fcb98f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6505aaac9f46b197f0080193157b29', 'request_id': 'req-cf79f094-94a2-41be-bf9e-640a95fcb98f'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:27.283801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-cf79f094-94a2-41be-bf9e-640a95fcb98f admin admin] The token cache is being invalidate because project 0d6505aaac9f46b197f0080193157b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:58:27.284100 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-cf79f094-94a2-41be-bf9e-640a95fcb98f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:27.284800 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-cf79f094-94a2-41be-bf9e-640a95fcb98f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:27.286374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1237/2471] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:26 2022] DELETE /identity/v3/projects/0d6505aaac9f46b197f0080193157b29 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:27.291122 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c6e28-27bf-415a-94ce-4481f53bc1bf None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.291415 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c6e28-27bf-415a-94ce-4481f53bc1bf None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.291747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c6e28-27bf-415a-94ce-4481f53bc1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.309858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-e78c6e28-27bf-415a-94ce-4481f53bc1bf None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:27.311059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e78c6e28-27bf-415a-94ce-4481f53bc1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:27.319324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1238/2472] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:27.326587 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c077f0-e3d9-487d-b0a0-1f924057c389 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.326870 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c077f0-e3d9-487d-b0a0-1f924057c389 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.327144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c077f0-e3d9-487d-b0a0-1f924057c389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.344945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-41c077f0-e3d9-487d-b0a0-1f924057c389 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:27.346158 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-41c077f0-e3d9-487d-b0a0-1f924057c389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:27.348284 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1235/2473] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:58:27 2022] POST /identity/v3/users => generated 301 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:58:27.353515 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24d602-5f8c-4ba7-b208-22477c9ed550 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:27.355118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-bd24d602-5f8c-4ba7-b208-22477c9ed550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:27.356898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1239/2474] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:58:27.357712 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c077f0-e3d9-487d-b0a0-1f924057c389 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:27.366926 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c077f0-e3d9-487d-b0a0-1f924057c389 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:27.367065 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24d602-5f8c-4ba7-b208-22477c9ed550 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:27.371348 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf0a87-e21a-4ef6-ba8c-2cb89a9809dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:27.371774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090dd48-c287-4a46-9cfa-501fd5e7812a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:27.371986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf0a87-e21a-4ef6-ba8c-2cb89a9809dd admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.372264 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf0a87-e21a-4ef6-ba8c-2cb89a9809dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.372458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090dd48-c287-4a46-9cfa-501fd5e7812a admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.372557 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf0a87-e21a-4ef6-ba8c-2cb89a9809dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.372784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090dd48-c287-4a46-9cfa-501fd5e7812a admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.373062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090dd48-c287-4a46-9cfa-501fd5e7812a admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.373285 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf0a87-e21a-4ef6-ba8c-2cb89a9809dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:58:27.373589 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf0a87-e21a-4ef6-ba8c-2cb89a9809dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:27.373851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090dd48-c287-4a46-9cfa-501fd5e7812a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:27.375753 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf0a87-e21a-4ef6-ba8c-2cb89a9809dd admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:27.376374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090dd48-c287-4a46-9cfa-501fd5e7812a admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:27.388968 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1240/2475] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:58:27.389353 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1236/2476] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:58:27.393946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf0a87-e21a-4ef6-ba8c-2cb89a9809dd admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:27.404105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf0a87-e21a-4ef6-ba8c-2cb89a9809dd admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:27.405067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090dd48-c287-4a46-9cfa-501fd5e7812a admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:27.408999 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0f0c9-e497-4bad-b455-2a6c113d28c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:27.409674 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0f0c9-e497-4bad-b455-2a6c113d28c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.409964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0f0c9-e497-4bad-b455-2a6c113d28c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.410249 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0f0c9-e497-4bad-b455-2a6c113d28c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.410947 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0f0c9-e497-4bad-b455-2a6c113d28c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:27.412884 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0f0c9-e497-4bad-b455-2a6c113d28c2 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:27.422954 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090dd48-c287-4a46-9cfa-501fd5e7812a admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:27.428251 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a99ed1-80ef-4651-95eb-809e34007091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:27.429123 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a99ed1-80ef-4651-95eb-809e34007091 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.429404 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a99ed1-80ef-4651-95eb-809e34007091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.429676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a99ed1-80ef-4651-95eb-809e34007091 admin admin] PATH_INFO: `/v3/projects/021eee8714d7454c9294b6f19a7a7a72/users/55a9035c2932488e8cf49781ab94bb32/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.444841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a99ed1-80ef-4651-95eb-809e34007091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=021eee8714d7454c9294b6f19a7a7a72, user_id=55a9035c2932488e8cf49781ab94bb32, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:27.447444 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a99ed1-80ef-4651-95eb-809e34007091 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:27.490866 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1241/2477] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:58:27 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:58:27.495290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0f0c9-e497-4bad-b455-2a6c113d28c2 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:27.537893 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1237/2478] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:27 2022] PUT /identity/v3/projects/021eee8714d7454c9294b6f19a7a7a72/users/55a9035c2932488e8cf49781ab94bb32/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:58:27.542299 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a99ed1-80ef-4651-95eb-809e34007091 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:27.560701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0f0c9-e497-4bad-b455-2a6c113d28c2 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:27.610584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:27.617889 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a99ed1-80ef-4651-95eb-809e34007091 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:27.620039 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af75af2-2eee-4fd3-925c-3e4d90d67eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:27.620744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af75af2-2eee-4fd3-925c-3e4d90d67eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.621028 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af75af2-2eee-4fd3-925c-3e4d90d67eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.621303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af75af2-2eee-4fd3-925c-3e4d90d67eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.621988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af75af2-2eee-4fd3-925c-3e4d90d67eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:27.622774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22773802-82bb-42d3-90cd-af6ecd679d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:27.623439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22773802-82bb-42d3-90cd-af6ecd679d30 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.623724 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22773802-82bb-42d3-90cd-af6ecd679d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.623887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af75af2-2eee-4fd3-925c-3e4d90d67eb6 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:27.624056 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22773802-82bb-42d3-90cd-af6ecd679d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.624870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22773802-82bb-42d3-90cd-af6ecd679d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:27.626542 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22773802-82bb-42d3-90cd-af6ecd679d30 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:27.639650 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1238/2479] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:58:27.641195 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22773802-82bb-42d3-90cd-af6ecd679d30 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:27.652037 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22773802-82bb-42d3-90cd-af6ecd679d30 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:27.655225 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574e779-1862-4c6d-96d7-f9739585bec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:27.656136 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574e779-1862-4c6d-96d7-f9739585bec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.657012 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574e779-1862-4c6d-96d7-f9739585bec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.657292 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574e779-1862-4c6d-96d7-f9739585bec5 admin admin] PATH_INFO: `/v3/projects/021eee8714d7454c9294b6f19a7a7a72/users/55a9035c2932488e8cf49781ab94bb32/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.659293 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574e779-1862-4c6d-96d7-f9739585bec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=021eee8714d7454c9294b6f19a7a7a72, user_id=55a9035c2932488e8cf49781ab94bb32, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:27.661979 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574e779-1862-4c6d-96d7-f9739585bec5 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:27.672053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1239/2480] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:27 2022] PUT /identity/v3/projects/021eee8714d7454c9294b6f19a7a7a72/users/55a9035c2932488e8cf49781ab94bb32/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:58:27.682187 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a73f33-fff5-4395-b9d8-a4b3c7317f62 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.682409 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a73f33-fff5-4395-b9d8-a4b3c7317f62 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.682684 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a73f33-fff5-4395-b9d8-a4b3c7317f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.700680 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1242/2481] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:58:27 2022] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:58:27.701703 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af75af2-2eee-4fd3-925c-3e4d90d67eb6 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:27.710308 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-01a73f33-fff5-4395-b9d8-a4b3c7317f62 None None] MFA Rules not processed for user `55a9035c2932488e8cf49781ab94bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:27.711527 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-01a73f33-fff5-4395-b9d8-a4b3c7317f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:27.711933 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af75af2-2eee-4fd3-925c-3e4d90d67eb6 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:27.738641 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:27.782877 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b767db-57f2-45db-8a6d-4acd6357f5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:27.783700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b767db-57f2-45db-8a6d-4acd6357f5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.783992 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b767db-57f2-45db-8a6d-4acd6357f5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.784266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b767db-57f2-45db-8a6d-4acd6357f5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.785253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b767db-57f2-45db-8a6d-4acd6357f5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:27.786052 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1240/2482] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:58:27.786888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b767db-57f2-45db-8a6d-4acd6357f5e9 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:27.796809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a73f33-fff5-4395-b9d8-a4b3c7317f62 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:27.798256 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-01a73f33-fff5-4395-b9d8-a4b3c7317f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:27.803895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1243/2483] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:58:27.809613 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b767db-57f2-45db-8a6d-4acd6357f5e9 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:27.819909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b767db-57f2-45db-8a6d-4acd6357f5e9 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:27.824510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380f2fe-13fe-464c-88cc-31c28832d118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:27.825245 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380f2fe-13fe-464c-88cc-31c28832d118 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.825543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380f2fe-13fe-464c-88cc-31c28832d118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.826555 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380f2fe-13fe-464c-88cc-31c28832d118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.827296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380f2fe-13fe-464c-88cc-31c28832d118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:27.829486 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380f2fe-13fe-464c-88cc-31c28832d118 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:27.842912 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1244/2484] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:58:27.844039 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380f2fe-13fe-464c-88cc-31c28832d118 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:27.856099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380f2fe-13fe-464c-88cc-31c28832d118 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:27.857032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a73f33-fff5-4395-b9d8-a4b3c7317f62 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:27.861408 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b0106-b0ed-4bbd-9140-31a63c71a315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:27.861581 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b0106-b0ed-4bbd-9140-31a63c71a315 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.861757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b0106-b0ed-4bbd-9140-31a63c71a315 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.862568 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b0106-b0ed-4bbd-9140-31a63c71a315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.865474 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e564f-7dfc-4a43-8047-39d0323abe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:27.866641 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e564f-7dfc-4a43-8047-39d0323abe4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.866919 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e564f-7dfc-4a43-8047-39d0323abe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.867227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e564f-7dfc-4a43-8047-39d0323abe4b admin admin] PATH_INFO: `/v3/projects/9dd5f883c21c421c8b3928bb2a98403f/users/fa09d49800374e078a30768fdc87c073/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.876111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b0106-b0ed-4bbd-9140-31a63c71a315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:27.878383 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b0106-b0ed-4bbd-9140-31a63c71a315 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:27.887700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e564f-7dfc-4a43-8047-39d0323abe4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd5f883c21c421c8b3928bb2a98403f, user_id=fa09d49800374e078a30768fdc87c073, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:27.890565 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1241/2485] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:58:27.891983 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b0106-b0ed-4bbd-9140-31a63c71a315 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:27.892762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e564f-7dfc-4a43-8047-39d0323abe4b admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:27.897078 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f01b0106-b0ed-4bbd-9140-31a63c71a315 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:27.951344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b0106-b0ed-4bbd-9140-31a63c71a315 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:27.956659 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bf95b-d987-47d6-a2c4-4f9521ca2216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:27.957316 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bf95b-d987-47d6-a2c4-4f9521ca2216 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.957605 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bf95b-d987-47d6-a2c4-4f9521ca2216 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.957977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bf95b-d987-47d6-a2c4-4f9521ca2216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.959854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b76bf95b-d987-47d6-a2c4-4f9521ca2216 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:27.971996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1245/2486] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:27 2022] PUT /identity/v3/projects/9dd5f883c21c421c8b3928bb2a98403f/users/fa09d49800374e078a30768fdc87c073/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:58:27.973442 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bf95b-d987-47d6-a2c4-4f9521ca2216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:27.976017 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bf95b-d987-47d6-a2c4-4f9521ca2216 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:27.983371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649b5de-84fe-451a-9ff2-17cf0f277134 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:27.983674 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649b5de-84fe-451a-9ff2-17cf0f277134 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:27.983953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649b5de-84fe-451a-9ff2-17cf0f277134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:27.991926 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1242/2487] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:28.021892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-b649b5de-84fe-451a-9ff2-17cf0f277134 None None] MFA Rules not processed for user `fa09d49800374e078a30768fdc87c073`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:28.023066 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-b649b5de-84fe-451a-9ff2-17cf0f277134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:28.029976 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bf95b-d987-47d6-a2c4-4f9521ca2216 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:28.038941 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bf95b-d987-47d6-a2c4-4f9521ca2216 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:28.130404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1246/2488] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:28.130553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aeee7c-5a54-49e4-95bf-30b204ca0ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:28.130553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aeee7c-5a54-49e4-95bf-30b204ca0ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:28.130553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aeee7c-5a54-49e4-95bf-30b204ca0ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:28.130553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aeee7c-5a54-49e4-95bf-30b204ca0ee5 admin admin] PATH_INFO: `/v3/users/2138f2ae725b44e0ba2a2a5c163c2e37` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:28.131382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aeee7c-5a54-49e4-95bf-30b204ca0ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2138f2ae725b44e0ba2a2a5c163c2e37)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:28.131623 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649b5de-84fe-451a-9ff2-17cf0f277134 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:28.139307 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aeee7c-5a54-49e4-95bf-30b204ca0ee5 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:28.159044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:28.161814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649b5de-84fe-451a-9ff2-17cf0f277134 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:28.168121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe510b08-a2b2-4c05-84c4-19620c54cd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:28.168894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe510b08-a2b2-4c05-84c4-19620c54cd8a admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:28.169322 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe510b08-a2b2-4c05-84c4-19620c54cd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:28.173766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe510b08-a2b2-4c05-84c4-19620c54cd8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:28.173766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe510b08-a2b2-4c05-84c4-19620c54cd8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:28.173766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe510b08-a2b2-4c05-84c4-19620c54cd8a admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:28.337546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1247/2489] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:58:28 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:58:28.342147 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe510b08-a2b2-4c05-84c4-19620c54cd8a admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:28.357420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:28.409569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe510b08-a2b2-4c05-84c4-19620c54cd8a admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:28.411142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e5aeee7c-5a54-49e4-95bf-30b204ca0ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2138f2ae725b44e0ba2a2a5c163c2e37'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:28.412001 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e5aeee7c-5a54-49e4-95bf-30b204ca0ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2138f2ae725b44e0ba2a2a5c163c2e37'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:28.412717 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e5aeee7c-5a54-49e4-95bf-30b204ca0ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2138f2ae725b44e0ba2a2a5c163c2e37'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:28.414635 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbed36c-b4be-4ee3-80f7-e6baf8f8660e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:28.415325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbed36c-b4be-4ee3-80f7-e6baf8f8660e admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:28.415624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbed36c-b4be-4ee3-80f7-e6baf8f8660e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:28.415892 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbed36c-b4be-4ee3-80f7-e6baf8f8660e admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:28.416608 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbed36c-b4be-4ee3-80f7-e6baf8f8660e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:28.418541 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbed36c-b4be-4ee3-80f7-e6baf8f8660e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:28.431335 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e5aeee7c-5a54-49e4-95bf-30b204ca0ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2138f2ae725b44e0ba2a2a5c163c2e37'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:28.439843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e5aeee7c-5a54-49e4-95bf-30b204ca0ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2138f2ae725b44e0ba2a2a5c163c2e37'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:28.550981 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1243/2490] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:28 2022] DELETE /identity/v3/users/2138f2ae725b44e0ba2a2a5c163c2e37 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:28.551956 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1248/2491] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:58:28 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:58:28.552473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d695a6-0b05-4209-afa8-dd2f9eb7a716 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:28.552816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d695a6-0b05-4209-afa8-dd2f9eb7a716 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:28.553100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d695a6-0b05-4209-afa8-dd2f9eb7a716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:28.561259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbed36c-b4be-4ee3-80f7-e6baf8f8660e admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:28.563104 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1cbed36c-b4be-4ee3-80f7-e6baf8f8660e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:28.576313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-b4d695a6-0b05-4209-afa8-dd2f9eb7a716 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:28.579768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b4d695a6-0b05-4209-afa8-dd2f9eb7a716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:28.580826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbed36c-b4be-4ee3-80f7-e6baf8f8660e admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:28.655271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1244/2492] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:28.661335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc08133-e38f-442a-a3a3-4b886ec42286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:28.662046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc08133-e38f-442a-a3a3-4b886ec42286 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:28.662338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc08133-e38f-442a-a3a3-4b886ec42286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:28.662627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc08133-e38f-442a-a3a3-4b886ec42286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:28.663369 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc08133-e38f-442a-a3a3-4b886ec42286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:28.665375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc08133-e38f-442a-a3a3-4b886ec42286 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:28.666117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d695a6-0b05-4209-afa8-dd2f9eb7a716 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:28.667557 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b4d695a6-0b05-4209-afa8-dd2f9eb7a716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:28.678269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1249/2493] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:58:28.685738 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc08133-e38f-442a-a3a3-4b886ec42286 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:28.698430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc08133-e38f-442a-a3a3-4b886ec42286 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:28.705608 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ede0c5-26f8-47fc-a412-18a1284222cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:28.706595 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ede0c5-26f8-47fc-a412-18a1284222cb admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:28.707010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ede0c5-26f8-47fc-a412-18a1284222cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:28.707398 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ede0c5-26f8-47fc-a412-18a1284222cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:28.708438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ede0c5-26f8-47fc-a412-18a1284222cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:28.710250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ede0c5-26f8-47fc-a412-18a1284222cb admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:28.723632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1250/2494] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:58:28.728047 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ede0c5-26f8-47fc-a412-18a1284222cb admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:28.743008 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ede0c5-26f8-47fc-a412-18a1284222cb admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:28.748527 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d695a6-0b05-4209-afa8-dd2f9eb7a716 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:28.750932 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fd7b8-59ed-4a4f-b2d6-aa46338f9622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:28.752035 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fd7b8-59ed-4a4f-b2d6-aa46338f9622 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:28.752506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fd7b8-59ed-4a4f-b2d6-aa46338f9622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:28.752682 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed0993-673b-4652-8834-0467bb9d4cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:28.752807 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fd7b8-59ed-4a4f-b2d6-aa46338f9622 admin admin] PATH_INFO: `/v3/projects/dde5315653c54f9cbee42b3f7102e3e4/users/9857b5b6be084681916b66dff8ef33ea/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:28.753320 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed0993-673b-4652-8834-0467bb9d4cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:28.753614 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed0993-673b-4652-8834-0467bb9d4cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:28.753894 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed0993-673b-4652-8834-0467bb9d4cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:28.764350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed0993-673b-4652-8834-0467bb9d4cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:28.766275 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed0993-673b-4652-8834-0467bb9d4cf2 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:28.772316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3fd7b8-59ed-4a4f-b2d6-aa46338f9622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde5315653c54f9cbee42b3f7102e3e4, user_id=9857b5b6be084681916b66dff8ef33ea, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:28.775334 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3fd7b8-59ed-4a4f-b2d6-aa46338f9622 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:28.779187 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1245/2495] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:58:28.853433 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1251/2496] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:28 2022] PUT /identity/v3/projects/dde5315653c54f9cbee42b3f7102e3e4/users/9857b5b6be084681916b66dff8ef33ea/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:58:28.858878 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea0361-5d1b-45d3-a5e2-fc3e10f8fc49 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:28.859397 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea0361-5d1b-45d3-a5e2-fc3e10f8fc49 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:28.871961 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea0361-5d1b-45d3-a5e2-fc3e10f8fc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:28.913751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-27ea0361-5d1b-45d3-a5e2-fc3e10f8fc49 None None] MFA Rules not processed for user `9857b5b6be084681916b66dff8ef33ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:28.914976 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-27ea0361-5d1b-45d3-a5e2-fc3e10f8fc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:28.933781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:28.980937 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1246/2497] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:28.985495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fd7b8-59ed-4a4f-b2d6-aa46338f9622 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:29.012778 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea0361-5d1b-45d3-a5e2-fc3e10f8fc49 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:29.013910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-27ea0361-5d1b-45d3-a5e2-fc3e10f8fc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:29.070150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fd7b8-59ed-4a4f-b2d6-aa46338f9622 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:29.075177 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eea044-6513-4efc-ad46-8ba91c1a5230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:29.075854 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eea044-6513-4efc-ad46-8ba91c1a5230 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:29.076403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eea044-6513-4efc-ad46-8ba91c1a5230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:29.076403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eea044-6513-4efc-ad46-8ba91c1a5230 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:29.077126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eea044-6513-4efc-ad46-8ba91c1a5230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:29.079589 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eea044-6513-4efc-ad46-8ba91c1a5230 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:29.084138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:29.102595 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea0361-5d1b-45d3-a5e2-fc3e10f8fc49 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:29.107387 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b00976-2014-4a1e-a328-c98efe9cc24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:29.108299 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b00976-2014-4a1e-a328-c98efe9cc24a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:29.108600 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b00976-2014-4a1e-a328-c98efe9cc24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:29.108891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b00976-2014-4a1e-a328-c98efe9cc24a admin admin] PATH_INFO: `/v3/users/f45b8987f3c24cf19de0fa81482c050a` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:29.110122 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b00976-2014-4a1e-a328-c98efe9cc24a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f45b8987f3c24cf19de0fa81482c050a)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:29.112065 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b00976-2014-4a1e-a328-c98efe9cc24a admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:29.180638 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1252/2498] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:58:28 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:58:29.183518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eea044-6513-4efc-ad46-8ba91c1a5230 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:29.249140 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eea044-6513-4efc-ad46-8ba91c1a5230 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:29.257950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef2be7-5549-496a-9822-137a275a9c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:29.258639 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef2be7-5549-496a-9822-137a275a9c54 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:29.258927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef2be7-5549-496a-9822-137a275a9c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:29.259209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef2be7-5549-496a-9822-137a275a9c54 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:29.259935 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef2be7-5549-496a-9822-137a275a9c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:29.265197 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef2be7-5549-496a-9822-137a275a9c54 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:29.296528 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-a4b00976-2014-4a1e-a328-c98efe9cc24a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f45b8987f3c24cf19de0fa81482c050a'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:29.298061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-a4b00976-2014-4a1e-a328-c98efe9cc24a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f45b8987f3c24cf19de0fa81482c050a'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:29.298776 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-a4b00976-2014-4a1e-a328-c98efe9cc24a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f45b8987f3c24cf19de0fa81482c050a'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:29.314431 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-a4b00976-2014-4a1e-a328-c98efe9cc24a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f45b8987f3c24cf19de0fa81482c050a'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:29.326477 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-a4b00976-2014-4a1e-a328-c98efe9cc24a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f45b8987f3c24cf19de0fa81482c050a'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:29.383963 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1253/2499] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:58:29 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:58:29.384704 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef2be7-5549-496a-9822-137a275a9c54 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:29.386385 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e8ef2be7-5549-496a-9822-137a275a9c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:29.399064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef2be7-5549-496a-9822-137a275a9c54 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:29.401091 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1247/2500] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:29 2022] DELETE /identity/v3/users/f45b8987f3c24cf19de0fa81482c050a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:29.402328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b00976-2014-4a1e-a328-c98efe9cc24a admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:29.404311 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a4b00976-2014-4a1e-a328-c98efe9cc24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:29.455876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:29.462814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728be520-e426-4ffc-9301-65e32e87f2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:29.463704 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728be520-e426-4ffc-9301-65e32e87f2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:29.466223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728be520-e426-4ffc-9301-65e32e87f2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:29.466223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728be520-e426-4ffc-9301-65e32e87f2e9 admin admin] PATH_INFO: `/v3/projects/4f1f5c6247e2408b8b9ed18cbfc904a5` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:29.466223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728be520-e426-4ffc-9301-65e32e87f2e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1f5c6247e2408b8b9ed18cbfc904a5)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:29.467435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728be520-e426-4ffc-9301-65e32e87f2e9 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:29.480749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b00976-2014-4a1e-a328-c98efe9cc24a admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:29.487192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935e28d-1ebf-4aa7-a665-3b7712c2c4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:29.487964 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935e28d-1ebf-4aa7-a665-3b7712c2c4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:29.488362 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935e28d-1ebf-4aa7-a665-3b7712c2c4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:29.488742 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935e28d-1ebf-4aa7-a665-3b7712c2c4d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:29.489580 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935e28d-1ebf-4aa7-a665-3b7712c2c4d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:29.491684 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935e28d-1ebf-4aa7-a665-3b7712c2c4d8 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:29.505158 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1248/2501] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:58:29.509446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935e28d-1ebf-4aa7-a665-3b7712c2c4d8 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:29.520451 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935e28d-1ebf-4aa7-a665-3b7712c2c4d8 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:29.526155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a8079-2e8a-41b6-aabe-125959cd645f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:29.526155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a8079-2e8a-41b6-aabe-125959cd645f admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:29.526361 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a8079-2e8a-41b6-aabe-125959cd645f admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:29.526594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a8079-2e8a-41b6-aabe-125959cd645f admin admin] PATH_INFO: `/v3/projects/45014337918b448f8717daadd6045f3f/users/2296037d736d4fbfb2b0438c5d1cc306/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:29.542349 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a8079-2e8a-41b6-aabe-125959cd645f admin admin] RBAC: Authorizing `identity:create_grant(project_id=45014337918b448f8717daadd6045f3f, user_id=2296037d736d4fbfb2b0438c5d1cc306, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:29.545088 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a8079-2e8a-41b6-aabe-125959cd645f admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:29.620747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1249/2502] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:29 2022] PUT /identity/v3/projects/45014337918b448f8717daadd6045f3f/users/2296037d736d4fbfb2b0438c5d1cc306/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:58:29.626092 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a8079-2e8a-41b6-aabe-125959cd645f admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:29.631847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-728be520-e426-4ffc-9301-65e32e87f2e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1f5c6247e2408b8b9ed18cbfc904a5', 'request_id': 'req-728be520-e426-4ffc-9301-65e32e87f2e9'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:29.637514 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-728be520-e426-4ffc-9301-65e32e87f2e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1f5c6247e2408b8b9ed18cbfc904a5', 'request_id': 'req-728be520-e426-4ffc-9301-65e32e87f2e9'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:29.687410 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a8079-2e8a-41b6-aabe-125959cd645f admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:29.710134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-728be520-e426-4ffc-9301-65e32e87f2e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1f5c6247e2408b8b9ed18cbfc904a5', 'request_id': 'req-728be520-e426-4ffc-9301-65e32e87f2e9'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:29.731400 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-728be520-e426-4ffc-9301-65e32e87f2e9 admin admin] The token cache is being invalidate because project 4f1f5c6247e2408b8b9ed18cbfc904a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:58:29.731981 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-728be520-e426-4ffc-9301-65e32e87f2e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:29.732963 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-728be520-e426-4ffc-9301-65e32e87f2e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:29.735236 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1254/2503] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:29 2022] DELETE /identity/v3/projects/4f1f5c6247e2408b8b9ed18cbfc904a5 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:29.736440 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728be520-e426-4ffc-9301-65e32e87f2e9 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:29.738151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-728be520-e426-4ffc-9301-65e32e87f2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:29.748737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:29.749890 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6dec8-f838-4919-97e5-a79932e87cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:29.751068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6dec8-f838-4919-97e5-a79932e87cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:29.751357 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6dec8-f838-4919-97e5-a79932e87cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:29.751637 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6dec8-f838-4919-97e5-a79932e87cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:29.752424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6dec8-f838-4919-97e5-a79932e87cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:29.754130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6dec8-f838-4919-97e5-a79932e87cd5 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:29.764206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1250/2504] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:58:29.771035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6dec8-f838-4919-97e5-a79932e87cd5 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:29.771035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-04f6dec8-f838-4919-97e5-a79932e87cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:29.781185 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6dec8-f838-4919-97e5-a79932e87cd5 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:29.786786 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bb867-a167-40cf-87a7-100fbd1892a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:29.788851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bb867-a167-40cf-87a7-100fbd1892a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:29.789367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bb867-a167-40cf-87a7-100fbd1892a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:29.789717 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bb867-a167-40cf-87a7-100fbd1892a7 admin admin] PATH_INFO: `/v3/users/55a9035c2932488e8cf49781ab94bb32` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:29.791244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bb867-a167-40cf-87a7-100fbd1892a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55a9035c2932488e8cf49781ab94bb32)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:29.793575 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bb867-a167-40cf-87a7-100fbd1892a7 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:29.813235 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728be520-e426-4ffc-9301-65e32e87f2e9 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:29.818351 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee9311-6157-4c4c-bf43-d19d710e1234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:29.819566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee9311-6157-4c4c-bf43-d19d710e1234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:29.819987 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee9311-6157-4c4c-bf43-d19d710e1234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:29.820407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee9311-6157-4c4c-bf43-d19d710e1234 admin admin] PATH_INFO: `/v3/projects/31ea80663206487ca3ea28c5bb4239f0` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:29.821786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee9311-6157-4c4c-bf43-d19d710e1234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31ea80663206487ca3ea28c5bb4239f0)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:29.823677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee9311-6157-4c4c-bf43-d19d710e1234 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:30.018330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-7a3bb867-a167-40cf-87a7-100fbd1892a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55a9035c2932488e8cf49781ab94bb32'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:30.018869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-beee9311-6157-4c4c-bf43-d19d710e1234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31ea80663206487ca3ea28c5bb4239f0', 'request_id': 'req-beee9311-6157-4c4c-bf43-d19d710e1234'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:30.019232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-7a3bb867-a167-40cf-87a7-100fbd1892a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55a9035c2932488e8cf49781ab94bb32'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:30.019628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-7a3bb867-a167-40cf-87a7-100fbd1892a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55a9035c2932488e8cf49781ab94bb32'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:30.024323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-beee9311-6157-4c4c-bf43-d19d710e1234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31ea80663206487ca3ea28c5bb4239f0', 'request_id': 'req-beee9311-6157-4c4c-bf43-d19d710e1234'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:30.032532 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-7a3bb867-a167-40cf-87a7-100fbd1892a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55a9035c2932488e8cf49781ab94bb32'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:30.039355 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-7a3bb867-a167-40cf-87a7-100fbd1892a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55a9035c2932488e8cf49781ab94bb32'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:30.127007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-beee9311-6157-4c4c-bf43-d19d710e1234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31ea80663206487ca3ea28c5bb4239f0', 'request_id': 'req-beee9311-6157-4c4c-bf43-d19d710e1234'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:30.140004 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-beee9311-6157-4c4c-bf43-d19d710e1234 admin admin] The token cache is being invalidate because project 31ea80663206487ca3ea28c5bb4239f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:58:30.140295 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-beee9311-6157-4c4c-bf43-d19d710e1234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:30.141019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-beee9311-6157-4c4c-bf43-d19d710e1234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:30.143150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1255/2505] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:29 2022] DELETE /identity/v3/projects/31ea80663206487ca3ea28c5bb4239f0 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:30.143969 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee9311-6157-4c4c-bf43-d19d710e1234 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:30.145392 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-beee9311-6157-4c4c-bf43-d19d710e1234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:30.199513 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1251/2506] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:29 2022] DELETE /identity/v3/users/55a9035c2932488e8cf49781ab94bb32 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:30.206602 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:30.225153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee9311-6157-4c4c-bf43-d19d710e1234 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:30.294570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c4bda-00e0-4247-b333-5628a6fea6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:30.295532 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c4bda-00e0-4247-b333-5628a6fea6e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:30.295818 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c4bda-00e0-4247-b333-5628a6fea6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:30.296094 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c4bda-00e0-4247-b333-5628a6fea6e1 admin admin] PATH_INFO: `/v3/projects/45014337918b448f8717daadd6045f3f/users/2296037d736d4fbfb2b0438c5d1cc306/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:30.298474 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c4bda-00e0-4247-b333-5628a6fea6e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45014337918b448f8717daadd6045f3f, user_id=2296037d736d4fbfb2b0438c5d1cc306, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:30.301438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c4bda-00e0-4247-b333-5628a6fea6e1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:30.313379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1256/2507] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:30 2022] PUT /identity/v3/projects/45014337918b448f8717daadd6045f3f/users/2296037d736d4fbfb2b0438c5d1cc306/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:30.325133 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678937d-92ef-403a-b5ca-0c58aaeac550 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:30.325555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678937d-92ef-403a-b5ca-0c58aaeac550 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:30.325909 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678937d-92ef-403a-b5ca-0c58aaeac550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:30.352826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-1678937d-92ef-403a-b5ca-0c58aaeac550 None None] MFA Rules not processed for user `2296037d736d4fbfb2b0438c5d1cc306`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:30.354037 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1678937d-92ef-403a-b5ca-0c58aaeac550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:30.420055 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1252/2508] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:30.433073 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c4bda-00e0-4247-b333-5628a6fea6e1 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:30.433664 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-bf2c4bda-00e0-4247-b333-5628a6fea6e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:30.492720 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c4bda-00e0-4247-b333-5628a6fea6e1 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:30.496150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:30.498844 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb21836-4bb0-45ed-b64c-2442628bbc93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:30.499532 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb21836-4bb0-45ed-b64c-2442628bbc93 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:30.499819 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb21836-4bb0-45ed-b64c-2442628bbc93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:30.504078 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb21836-4bb0-45ed-b64c-2442628bbc93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:30.509603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb21836-4bb0-45ed-b64c-2442628bbc93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:30.511089 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb21836-4bb0-45ed-b64c-2442628bbc93 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:30.521617 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1257/2509] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:30.693647 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678937d-92ef-403a-b5ca-0c58aaeac550 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:30.695113 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1678937d-92ef-403a-b5ca-0c58aaeac550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:30.707446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678937d-92ef-403a-b5ca-0c58aaeac550 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:30.710994 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3423125-222b-49c3-96c8-e6021e0f35dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:30.711633 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3423125-222b-49c3-96c8-e6021e0f35dd service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:30.711944 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3423125-222b-49c3-96c8-e6021e0f35dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:30.712221 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3423125-222b-49c3-96c8-e6021e0f35dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:30.714018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b3423125-222b-49c3-96c8-e6021e0f35dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:30.721081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb21836-4bb0-45ed-b64c-2442628bbc93 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:30.722439 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1fb21836-4bb0-45ed-b64c-2442628bbc93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:30.783705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3423125-222b-49c3-96c8-e6021e0f35dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:30.785301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3423125-222b-49c3-96c8-e6021e0f35dd service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:30.791536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb21836-4bb0-45ed-b64c-2442628bbc93 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:30.794201 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1253/2510] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:30.796347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c46be-54dc-44dc-9836-4d9fd0547dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:30.797282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c46be-54dc-44dc-9836-4d9fd0547dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:30.797566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c46be-54dc-44dc-9836-4d9fd0547dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:30.797847 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c46be-54dc-44dc-9836-4d9fd0547dfa admin admin] PATH_INFO: `/v3/projects/021eee8714d7454c9294b6f19a7a7a72` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:30.799030 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c46be-54dc-44dc-9836-4d9fd0547dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=021eee8714d7454c9294b6f19a7a7a72)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:30.800963 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c46be-54dc-44dc-9836-4d9fd0547dfa admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:30.918605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0d3c46be-54dc-44dc-9836-4d9fd0547dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '021eee8714d7454c9294b6f19a7a7a72', 'request_id': 'req-0d3c46be-54dc-44dc-9836-4d9fd0547dfa'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:30.924028 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0d3c46be-54dc-44dc-9836-4d9fd0547dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '021eee8714d7454c9294b6f19a7a7a72', 'request_id': 'req-0d3c46be-54dc-44dc-9836-4d9fd0547dfa'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:31.018257 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0d3c46be-54dc-44dc-9836-4d9fd0547dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '021eee8714d7454c9294b6f19a7a7a72', 'request_id': 'req-0d3c46be-54dc-44dc-9836-4d9fd0547dfa'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:31.029846 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0d3c46be-54dc-44dc-9836-4d9fd0547dfa admin admin] The token cache is being invalidate because project 021eee8714d7454c9294b6f19a7a7a72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:58:31.030417 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0d3c46be-54dc-44dc-9836-4d9fd0547dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:31.030772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0d3c46be-54dc-44dc-9836-4d9fd0547dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:31.032391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1258/2511] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:30 2022] DELETE /identity/v3/projects/021eee8714d7454c9294b6f19a7a7a72 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:58:31.037246 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec6993-2a5f-439b-9753-e2bab0f369d8 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:31.037682 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec6993-2a5f-439b-9753-e2bab0f369d8 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:31.037803 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec6993-2a5f-439b-9753-e2bab0f369d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:31.056415 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-3aec6993-2a5f-439b-9753-e2bab0f369d8 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:31.057854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3aec6993-2a5f-439b-9753-e2bab0f369d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:31.101798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:31.116197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1254/2512] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:31.124678 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed9b84-35ab-4dd2-aa5d-2780b9d65fe3 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:31.125070 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed9b84-35ab-4dd2-aa5d-2780b9d65fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:31.125381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed9b84-35ab-4dd2-aa5d-2780b9d65fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:31.143240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-8eed9b84-35ab-4dd2-aa5d-2780b9d65fe3 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:31.144430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8eed9b84-35ab-4dd2-aa5d-2780b9d65fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:31.153044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1259/2513] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:31.158205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec6993-2a5f-439b-9753-e2bab0f369d8 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:31.168414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec6993-2a5f-439b-9753-e2bab0f369d8 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:31.173677 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f37ac-bf2b-441f-a125-2445662c1d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:31.174373 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f37ac-bf2b-441f-a125-2445662c1d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:31.174647 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f37ac-bf2b-441f-a125-2445662c1d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:31.174918 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f37ac-bf2b-441f-a125-2445662c1d93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:31.175639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f37ac-bf2b-441f-a125-2445662c1d93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:58:31.175943 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f37ac-bf2b-441f-a125-2445662c1d93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:31.177570 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f37ac-bf2b-441f-a125-2445662c1d93 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:31.189219 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1255/2514] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:58:31.193450 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed9b84-35ab-4dd2-aa5d-2780b9d65fe3 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:31.199156 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:31.202814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed9b84-35ab-4dd2-aa5d-2780b9d65fe3 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:31.207978 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b369dbe-5cdf-4a93-bfde-2ff555855a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:31.213740 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b369dbe-5cdf-4a93-bfde-2ff555855a9e admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:31.213740 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b369dbe-5cdf-4a93-bfde-2ff555855a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:31.213740 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b369dbe-5cdf-4a93-bfde-2ff555855a9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:31.213740 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b369dbe-5cdf-4a93-bfde-2ff555855a9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:31.213740 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b369dbe-5cdf-4a93-bfde-2ff555855a9e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:31.298810 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1260/2515] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:58:31 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:58:31.303263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f37ac-bf2b-441f-a125-2445662c1d93 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:31.313299 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f37ac-bf2b-441f-a125-2445662c1d93 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:31.368808 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109df06e-ab6f-42aa-9582-9f47ceb96fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:31.369568 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109df06e-ab6f-42aa-9582-9f47ceb96fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:31.369855 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109df06e-ab6f-42aa-9582-9f47ceb96fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:31.370139 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109df06e-ab6f-42aa-9582-9f47ceb96fb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:31.370827 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109df06e-ab6f-42aa-9582-9f47ceb96fb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:31.372769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109df06e-ab6f-42aa-9582-9f47ceb96fb4 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:31.500601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1256/2516] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:58:31 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:58:31.506284 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b369dbe-5cdf-4a93-bfde-2ff555855a9e admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:31.515097 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b369dbe-5cdf-4a93-bfde-2ff555855a9e admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:31.520270 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788a952-356d-4f51-bdde-e82f6b29f44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:31.520960 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788a952-356d-4f51-bdde-e82f6b29f44e admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:31.521247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788a952-356d-4f51-bdde-e82f6b29f44e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:31.521526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788a952-356d-4f51-bdde-e82f6b29f44e admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:31.522251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788a952-356d-4f51-bdde-e82f6b29f44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:31.523883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788a952-356d-4f51-bdde-e82f6b29f44e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:31.534416 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1261/2517] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:58:31.538310 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109df06e-ab6f-42aa-9582-9f47ceb96fb4 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:31.548053 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109df06e-ab6f-42aa-9582-9f47ceb96fb4 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:31.552608 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34876ac8-0239-4534-9914-18776b4fa5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:31.553275 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876ac8-0239-4534-9914-18776b4fa5eb admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:31.553559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876ac8-0239-4534-9914-18776b4fa5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:31.553832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876ac8-0239-4534-9914-18776b4fa5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:31.554556 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34876ac8-0239-4534-9914-18776b4fa5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:31.556152 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34876ac8-0239-4534-9914-18776b4fa5eb admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:31.566590 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1257/2518] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:58:31.572441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788a952-356d-4f51-bdde-e82f6b29f44e admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:31.582890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788a952-356d-4f51-bdde-e82f6b29f44e admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:31.587890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89120b51-3610-4d74-bfc2-21269ca9d8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:31.588813 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89120b51-3610-4d74-bfc2-21269ca9d8fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:31.589105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89120b51-3610-4d74-bfc2-21269ca9d8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:31.589384 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89120b51-3610-4d74-bfc2-21269ca9d8fd admin admin] PATH_INFO: `/v3/projects/34bbb31dfc95466b99049b249cd0c0d6/users/15fe5d89bf354359a8ff70580361f6aa/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:31.609812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89120b51-3610-4d74-bfc2-21269ca9d8fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=34bbb31dfc95466b99049b249cd0c0d6, user_id=15fe5d89bf354359a8ff70580361f6aa, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:31.612526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89120b51-3610-4d74-bfc2-21269ca9d8fd admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:31.680518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1262/2519] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:31 2022] PUT /identity/v3/projects/34bbb31dfc95466b99049b249cd0c0d6/users/15fe5d89bf354359a8ff70580361f6aa/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:31.689035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e31ea-20f7-4ac4-aa55-db81b6a461c0 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:31.689330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e31ea-20f7-4ac4-aa55-db81b6a461c0 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:31.689610 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e31ea-20f7-4ac4-aa55-db81b6a461c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:31.712195 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-966e31ea-20f7-4ac4-aa55-db81b6a461c0 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:31.712195 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-966e31ea-20f7-4ac4-aa55-db81b6a461c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:31.770559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1258/2520] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:31.780138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89120b51-3610-4d74-bfc2-21269ca9d8fd admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:31.782057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-89120b51-3610-4d74-bfc2-21269ca9d8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:31.838696 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89120b51-3610-4d74-bfc2-21269ca9d8fd admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:31.842653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9146f90-4669-4d01-ba78-188bc7244d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:31.843311 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9146f90-4669-4d01-ba78-188bc7244d9d service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:31.843755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9146f90-4669-4d01-ba78-188bc7244d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:31.843879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9146f90-4669-4d01-ba78-188bc7244d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:31.853463 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9146f90-4669-4d01-ba78-188bc7244d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:31.854904 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9146f90-4669-4d01-ba78-188bc7244d9d service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:31.864556 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1263/2521] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:33.122521 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf178235-2367-44df-a02d-56d9d58be407 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:33.123088 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf178235-2367-44df-a02d-56d9d58be407 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:33.123088 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf178235-2367-44df-a02d-56d9d58be407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:33.150769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-cf178235-2367-44df-a02d-56d9d58be407 None None] MFA Rules not processed for user `15fe5d89bf354359a8ff70580361f6aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:33.152001 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-cf178235-2367-44df-a02d-56d9d58be407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:33.197744 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:33.223727 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1259/2522] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:33.225274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9146f90-4669-4d01-ba78-188bc7244d9d service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:33.235442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9146f90-4669-4d01-ba78-188bc7244d9d service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:33.244216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f1b38-78a8-4701-82e5-380c14da51ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:33.244216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f1b38-78a8-4701-82e5-380c14da51ea admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:33.244216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f1b38-78a8-4701-82e5-380c14da51ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:33.244216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f1b38-78a8-4701-82e5-380c14da51ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:33.244574 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f1b38-78a8-4701-82e5-380c14da51ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:33.245710 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f1b38-78a8-4701-82e5-380c14da51ea admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:33.366869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1264/2523] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:58:33 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:58:33.370971 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf178235-2367-44df-a02d-56d9d58be407 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:33.383141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf178235-2367-44df-a02d-56d9d58be407 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:33.440372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10dab8-3292-4473-a779-75126d3bb49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:33.441079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10dab8-3292-4473-a779-75126d3bb49b admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:33.441364 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10dab8-3292-4473-a779-75126d3bb49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:33.441645 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10dab8-3292-4473-a779-75126d3bb49b admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:33.442472 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10dab8-3292-4473-a779-75126d3bb49b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:33.444344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10dab8-3292-4473-a779-75126d3bb49b admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:33.560187 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1260/2524] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:58:33 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:58:33.566924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f1b38-78a8-4701-82e5-380c14da51ea admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:33.577307 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f1b38-78a8-4701-82e5-380c14da51ea admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:33.581932 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0978dd-846a-42de-9d96-0bca2de73dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:33.582597 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0978dd-846a-42de-9d96-0bca2de73dea admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:33.582890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0978dd-846a-42de-9d96-0bca2de73dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:33.583163 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0978dd-846a-42de-9d96-0bca2de73dea admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:33.583890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0978dd-846a-42de-9d96-0bca2de73dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:33.585528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0978dd-846a-42de-9d96-0bca2de73dea admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:33.596447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1265/2525] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:58:33.608799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10dab8-3292-4473-a779-75126d3bb49b admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:33.619448 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10dab8-3292-4473-a779-75126d3bb49b admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:33.624171 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa3634-5339-40ca-9c54-297e616f9aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:33.625080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa3634-5339-40ca-9c54-297e616f9aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:33.625413 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa3634-5339-40ca-9c54-297e616f9aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:33.626205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa3634-5339-40ca-9c54-297e616f9aa1 admin admin] PATH_INFO: `/v3/projects/608d8a4e1522422b96a615ba4b491ef7/users/1e2a324e6ce440a8a785e059550cb7ae/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:33.644293 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa3634-5339-40ca-9c54-297e616f9aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=608d8a4e1522422b96a615ba4b491ef7, user_id=1e2a324e6ce440a8a785e059550cb7ae, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:33.646981 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa3634-5339-40ca-9c54-297e616f9aa1 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:33.732893 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1261/2526] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:33 2022] PUT /identity/v3/projects/608d8a4e1522422b96a615ba4b491ef7/users/1e2a324e6ce440a8a785e059550cb7ae/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:33.737724 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0978dd-846a-42de-9d96-0bca2de73dea admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:33.748637 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0978dd-846a-42de-9d96-0bca2de73dea admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:33.808395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5577a24-e3ad-4756-8855-221860038de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:33.809106 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5577a24-e3ad-4756-8855-221860038de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:33.809395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5577a24-e3ad-4756-8855-221860038de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:33.809674 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5577a24-e3ad-4756-8855-221860038de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:33.810399 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5577a24-e3ad-4756-8855-221860038de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:33.811984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5577a24-e3ad-4756-8855-221860038de3 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:33.821871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1266/2527] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:58:33.826147 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa3634-5339-40ca-9c54-297e616f9aa1 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:33.837192 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa3634-5339-40ca-9c54-297e616f9aa1 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:33.846914 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db234532-3fb7-4455-b2d9-9d1f127665ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:33.846914 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db234532-3fb7-4455-b2d9-9d1f127665ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:33.846914 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db234532-3fb7-4455-b2d9-9d1f127665ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:33.846914 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db234532-3fb7-4455-b2d9-9d1f127665ed admin admin] PATH_INFO: `/v3/projects/608d8a4e1522422b96a615ba4b491ef7/users/1e2a324e6ce440a8a785e059550cb7ae/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:33.847226 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db234532-3fb7-4455-b2d9-9d1f127665ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=608d8a4e1522422b96a615ba4b491ef7, user_id=1e2a324e6ce440a8a785e059550cb7ae, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:33.848827 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db234532-3fb7-4455-b2d9-9d1f127665ed admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:33.859402 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1262/2528] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:33 2022] PUT /identity/v3/projects/608d8a4e1522422b96a615ba4b491ef7/users/1e2a324e6ce440a8a785e059550cb7ae/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:58:34.994639 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5577a24-e3ad-4756-8855-221860038de3 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:34.996318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d5577a24-e3ad-4756-8855-221860038de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:35.009395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5577a24-e3ad-4756-8855-221860038de3 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:35.017985 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:35.065215 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58e813-23b5-4e98-99d5-1efc45f40b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:35.066022 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58e813-23b5-4e98-99d5-1efc45f40b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:35.066306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58e813-23b5-4e98-99d5-1efc45f40b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:35.066579 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58e813-23b5-4e98-99d5-1efc45f40b6e admin admin] PATH_INFO: `/v3/users/fa09d49800374e078a30768fdc87c073` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:35.067781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58e813-23b5-4e98-99d5-1efc45f40b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa09d49800374e078a30768fdc87c073)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:35.069804 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58e813-23b5-4e98-99d5-1efc45f40b6e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:35.158859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca768f93-eb9c-45e4-805b-1a0b805f956b None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:35.159411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca768f93-eb9c-45e4-805b-1a0b805f956b None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:35.159637 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca768f93-eb9c-45e4-805b-1a0b805f956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:35.193800 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-ca768f93-eb9c-45e4-805b-1a0b805f956b None None] MFA Rules not processed for user `1e2a324e6ce440a8a785e059550cb7ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:35.195970 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ca768f93-eb9c-45e4-805b-1a0b805f956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:35.270393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ed58e813-23b5-4e98-99d5-1efc45f40b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa09d49800374e078a30768fdc87c073'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:35.275060 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1263/2529] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:58:35.287552 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca768f93-eb9c-45e4-805b-1a0b805f956b None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:35.289023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ca768f93-eb9c-45e4-805b-1a0b805f956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:35.316881 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:35.345420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca768f93-eb9c-45e4-805b-1a0b805f956b None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:35.349019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e4505-ce0d-492a-b6a1-b7d44c366146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:35.349663 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e4505-ce0d-492a-b6a1-b7d44c366146 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:35.349939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e4505-ce0d-492a-b6a1-b7d44c366146 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:35.350213 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e4505-ce0d-492a-b6a1-b7d44c366146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:35.359587 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ed58e813-23b5-4e98-99d5-1efc45f40b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa09d49800374e078a30768fdc87c073'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:35.360270 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ed58e813-23b5-4e98-99d5-1efc45f40b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa09d49800374e078a30768fdc87c073'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:35.377636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ed58e813-23b5-4e98-99d5-1efc45f40b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa09d49800374e078a30768fdc87c073'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:35.378388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ed58e813-23b5-4e98-99d5-1efc45f40b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa09d49800374e078a30768fdc87c073'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:35.394606 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1267/2530] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:34 2022] DELETE /identity/v3/users/fa09d49800374e078a30768fdc87c073 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:35.398990 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81608045-3a8a-4196-af65-7139483d9620 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:35.399276 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81608045-3a8a-4196-af65-7139483d9620 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:35.399554 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81608045-3a8a-4196-af65-7139483d9620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:35.412801 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e4505-ce0d-492a-b6a1-b7d44c366146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:35.414298 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e4505-ce0d-492a-b6a1-b7d44c366146 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:35.416548 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-81608045-3a8a-4196-af65-7139483d9620 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:35.417771 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-81608045-3a8a-4196-af65-7139483d9620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:35.424485 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1264/2531] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:58:35.478904 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1268/2532] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:58:35.489419 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e4505-ce0d-492a-b6a1-b7d44c366146 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:35.549477 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e4505-ce0d-492a-b6a1-b7d44c366146 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:35.598438 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebcdfd-1e8a-470b-8d99-c22857bf39a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:35.599007 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebcdfd-1e8a-470b-8d99-c22857bf39a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:35.599285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebcdfd-1e8a-470b-8d99-c22857bf39a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:35.599567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebcdfd-1e8a-470b-8d99-c22857bf39a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:35.608770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebcdfd-1e8a-470b-8d99-c22857bf39a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:35.610769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebcdfd-1e8a-470b-8d99-c22857bf39a4 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:35.620305 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1265/2533] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:36.058718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81608045-3a8a-4196-af65-7139483d9620 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:36.060245 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-81608045-3a8a-4196-af65-7139483d9620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:36.087388 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81608045-3a8a-4196-af65-7139483d9620 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:36.104046 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d638ef5-bbf5-4f36-a99d-ad548136a4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:36.104970 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d638ef5-bbf5-4f36-a99d-ad548136a4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:36.105254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d638ef5-bbf5-4f36-a99d-ad548136a4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:36.105531 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d638ef5-bbf5-4f36-a99d-ad548136a4df admin admin] PATH_INFO: `/v3/projects/9dd5f883c21c421c8b3928bb2a98403f` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:36.107082 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d638ef5-bbf5-4f36-a99d-ad548136a4df admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd5f883c21c421c8b3928bb2a98403f)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:36.109039 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d638ef5-bbf5-4f36-a99d-ad548136a4df admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:36.249390 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:36.265368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-4d638ef5-bbf5-4f36-a99d-ad548136a4df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd5f883c21c421c8b3928bb2a98403f', 'request_id': 'req-4d638ef5-bbf5-4f36-a99d-ad548136a4df'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:36.271580 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-4d638ef5-bbf5-4f36-a99d-ad548136a4df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd5f883c21c421c8b3928bb2a98403f', 'request_id': 'req-4d638ef5-bbf5-4f36-a99d-ad548136a4df'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:36.406321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-4d638ef5-bbf5-4f36-a99d-ad548136a4df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd5f883c21c421c8b3928bb2a98403f', 'request_id': 'req-4d638ef5-bbf5-4f36-a99d-ad548136a4df'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:36.417913 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-4d638ef5-bbf5-4f36-a99d-ad548136a4df admin admin] The token cache is being invalidate because project 9dd5f883c21c421c8b3928bb2a98403f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:58:36.418203 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-4d638ef5-bbf5-4f36-a99d-ad548136a4df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:36.418830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-4d638ef5-bbf5-4f36-a99d-ad548136a4df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:36.420361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1269/2534] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:36 2022] DELETE /identity/v3/projects/9dd5f883c21c421c8b3928bb2a98403f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:36.425064 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebcdfd-1e8a-470b-8d99-c22857bf39a4 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:36.434621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebcdfd-1e8a-470b-8d99-c22857bf39a4 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:36.467637 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:36.493512 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac36302-bcad-4a2f-a310-22edbe6c193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:36.494384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac36302-bcad-4a2f-a310-22edbe6c193a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:36.494668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac36302-bcad-4a2f-a310-22edbe6c193a admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:36.494945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac36302-bcad-4a2f-a310-22edbe6c193a admin admin] PATH_INFO: `/v3/users/9857b5b6be084681916b66dff8ef33ea` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:36.496224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac36302-bcad-4a2f-a310-22edbe6c193a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9857b5b6be084681916b66dff8ef33ea)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:36.498222 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac36302-bcad-4a2f-a310-22edbe6c193a admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:36.692843 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-7ac36302-bcad-4a2f-a310-22edbe6c193a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9857b5b6be084681916b66dff8ef33ea'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:36.693631 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-7ac36302-bcad-4a2f-a310-22edbe6c193a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9857b5b6be084681916b66dff8ef33ea'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:36.694093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-7ac36302-bcad-4a2f-a310-22edbe6c193a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9857b5b6be084681916b66dff8ef33ea'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:36.706652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-7ac36302-bcad-4a2f-a310-22edbe6c193a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9857b5b6be084681916b66dff8ef33ea'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:36.713301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-7ac36302-bcad-4a2f-a310-22edbe6c193a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9857b5b6be084681916b66dff8ef33ea'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:36.794804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1266/2535] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:36 2022] DELETE /identity/v3/users/9857b5b6be084681916b66dff8ef33ea => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:37.202239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d638ef5-bbf5-4f36-a99d-ad548136a4df admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:37.202239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4d638ef5-bbf5-4f36-a99d-ad548136a4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:37.260073 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d638ef5-bbf5-4f36-a99d-ad548136a4df admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:37.293026 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac36302-bcad-4a2f-a310-22edbe6c193a admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:37.295625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-7ac36302-bcad-4a2f-a310-22edbe6c193a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:37.327448 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d38d74-979f-47f6-8273-b18a24d64d29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:37.328873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d38d74-979f-47f6-8273-b18a24d64d29 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:37.329160 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d38d74-979f-47f6-8273-b18a24d64d29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:37.329509 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d38d74-979f-47f6-8273-b18a24d64d29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:37.331653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-b8d38d74-979f-47f6-8273-b18a24d64d29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:37.380930 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac36302-bcad-4a2f-a310-22edbe6c193a admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:37.385833 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364a35e-2b8c-4649-abdf-3881680a1082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:37.386702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364a35e-2b8c-4649-abdf-3881680a1082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:37.386986 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364a35e-2b8c-4649-abdf-3881680a1082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:37.387260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364a35e-2b8c-4649-abdf-3881680a1082 admin admin] PATH_INFO: `/v3/projects/dde5315653c54f9cbee42b3f7102e3e4` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:37.388474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364a35e-2b8c-4649-abdf-3881680a1082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde5315653c54f9cbee42b3f7102e3e4)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:37.390425 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364a35e-2b8c-4649-abdf-3881680a1082 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:37.415533 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d38d74-979f-47f6-8273-b18a24d64d29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:37.416929 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d38d74-979f-47f6-8273-b18a24d64d29 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:37.426574 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1270/2536] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:37.501625 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1364a35e-2b8c-4649-abdf-3881680a1082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde5315653c54f9cbee42b3f7102e3e4', 'request_id': 'req-1364a35e-2b8c-4649-abdf-3881680a1082'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:37.604223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1364a35e-2b8c-4649-abdf-3881680a1082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde5315653c54f9cbee42b3f7102e3e4', 'request_id': 'req-1364a35e-2b8c-4649-abdf-3881680a1082'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:37.606624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:37.611260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1364a35e-2b8c-4649-abdf-3881680a1082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde5315653c54f9cbee42b3f7102e3e4', 'request_id': 'req-1364a35e-2b8c-4649-abdf-3881680a1082'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:37.622730 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1364a35e-2b8c-4649-abdf-3881680a1082 admin admin] The token cache is being invalidate because project dde5315653c54f9cbee42b3f7102e3e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:58:37.623138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1364a35e-2b8c-4649-abdf-3881680a1082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:37.623866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1364a35e-2b8c-4649-abdf-3881680a1082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:37.626176 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1267/2537] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:37 2022] DELETE /identity/v3/projects/dde5315653c54f9cbee42b3f7102e3e4 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:37.630194 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d38d74-979f-47f6-8273-b18a24d64d29 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:37.640558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d38d74-979f-47f6-8273-b18a24d64d29 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:37.659048 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:37.697746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed4ae2-ac09-4f67-983c-dc5d69ac4b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:37.704318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed4ae2-ac09-4f67-983c-dc5d69ac4b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:37.704318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed4ae2-ac09-4f67-983c-dc5d69ac4b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:37.704318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed4ae2-ac09-4f67-983c-dc5d69ac4b9b admin admin] PATH_INFO: `/v3/users/2296037d736d4fbfb2b0438c5d1cc306` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:37.704318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed4ae2-ac09-4f67-983c-dc5d69ac4b9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2296037d736d4fbfb2b0438c5d1cc306)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:37.704318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed4ae2-ac09-4f67-983c-dc5d69ac4b9b admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:37.932673 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-46ed4ae2-ac09-4f67-983c-dc5d69ac4b9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2296037d736d4fbfb2b0438c5d1cc306'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:37.993007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-46ed4ae2-ac09-4f67-983c-dc5d69ac4b9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2296037d736d4fbfb2b0438c5d1cc306'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:37.993668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-46ed4ae2-ac09-4f67-983c-dc5d69ac4b9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2296037d736d4fbfb2b0438c5d1cc306'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:38.006271 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-46ed4ae2-ac09-4f67-983c-dc5d69ac4b9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2296037d736d4fbfb2b0438c5d1cc306'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:38.006912 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-46ed4ae2-ac09-4f67-983c-dc5d69ac4b9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2296037d736d4fbfb2b0438c5d1cc306'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:38.024288 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1271/2538] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:37 2022] DELETE /identity/v3/users/2296037d736d4fbfb2b0438c5d1cc306 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:38.436567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364a35e-2b8c-4649-abdf-3881680a1082 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:38.438140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1364a35e-2b8c-4649-abdf-3881680a1082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:38.451032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364a35e-2b8c-4649-abdf-3881680a1082 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:38.509477 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7644e-3b28-4fea-971a-037d5f5f73af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:38.510342 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7644e-3b28-4fea-971a-037d5f5f73af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:38.510630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7644e-3b28-4fea-971a-037d5f5f73af admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:38.510906 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7644e-3b28-4fea-971a-037d5f5f73af admin admin] PATH_INFO: `/v3/projects/45014337918b448f8717daadd6045f3f` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:38.512083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7644e-3b28-4fea-971a-037d5f5f73af admin admin] RBAC: Authorizing `identity:delete_project(project_id=45014337918b448f8717daadd6045f3f)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:38.514077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7644e-3b28-4fea-971a-037d5f5f73af admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:38.595288 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-a8b7644e-3b28-4fea-971a-037d5f5f73af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45014337918b448f8717daadd6045f3f', 'request_id': 'req-a8b7644e-3b28-4fea-971a-037d5f5f73af'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:38.646227 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-a8b7644e-3b28-4fea-971a-037d5f5f73af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45014337918b448f8717daadd6045f3f', 'request_id': 'req-a8b7644e-3b28-4fea-971a-037d5f5f73af'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:38.652444 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-a8b7644e-3b28-4fea-971a-037d5f5f73af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45014337918b448f8717daadd6045f3f', 'request_id': 'req-a8b7644e-3b28-4fea-971a-037d5f5f73af'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:38.663182 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-a8b7644e-3b28-4fea-971a-037d5f5f73af admin admin] The token cache is being invalidate because project 45014337918b448f8717daadd6045f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:58:38.663469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-a8b7644e-3b28-4fea-971a-037d5f5f73af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:38.664159 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-a8b7644e-3b28-4fea-971a-037d5f5f73af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:38.665731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1268/2539] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:38 2022] DELETE /identity/v3/projects/45014337918b448f8717daadd6045f3f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:38.673078 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7a515-b927-4dcf-863f-536bcac66a5d None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:38.673545 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7a515-b927-4dcf-863f-536bcac66a5d None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:38.673655 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7a515-b927-4dcf-863f-536bcac66a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:38.691387 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-b6e7a515-b927-4dcf-863f-536bcac66a5d None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:38.692573 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-b6e7a515-b927-4dcf-863f-536bcac66a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:38.750045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1272/2540] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:38.758393 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6315a-9b76-4f92-82f8-8025d840aeb8 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:38.758678 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6315a-9b76-4f92-82f8-8025d840aeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:38.758957 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6315a-9b76-4f92-82f8-8025d840aeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:38.777260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-8fa6315a-9b76-4f92-82f8-8025d840aeb8 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:38.778475 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-8fa6315a-9b76-4f92-82f8-8025d840aeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:38.786925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1269/2541] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:38.791130 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7a515-b927-4dcf-863f-536bcac66a5d None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:38.800620 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7a515-b927-4dcf-863f-536bcac66a5d None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:38.805108 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427afc50-9ba3-4354-a108-d82f8dad3168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:38.805752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427afc50-9ba3-4354-a108-d82f8dad3168 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:38.806034 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427afc50-9ba3-4354-a108-d82f8dad3168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:38.806309 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427afc50-9ba3-4354-a108-d82f8dad3168 admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:38.807057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427afc50-9ba3-4354-a108-d82f8dad3168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:58:38.807363 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427afc50-9ba3-4354-a108-d82f8dad3168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:38.808982 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427afc50-9ba3-4354-a108-d82f8dad3168 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:38.820080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1273/2542] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:58:38.824242 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6315a-9b76-4f92-82f8-8025d840aeb8 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:38.833784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6315a-9b76-4f92-82f8-8025d840aeb8 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:38.838423 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f29959-d2cc-478b-b5da-417cc5bfe571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:38.839065 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f29959-d2cc-478b-b5da-417cc5bfe571 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:38.839349 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f29959-d2cc-478b-b5da-417cc5bfe571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:38.839623 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f29959-d2cc-478b-b5da-417cc5bfe571 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:38.840304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f29959-d2cc-478b-b5da-417cc5bfe571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:38.842332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f29959-d2cc-478b-b5da-417cc5bfe571 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:38.974150 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1270/2543] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:58:38 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:58:38.976674 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427afc50-9ba3-4354-a108-d82f8dad3168 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:38.988519 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427afc50-9ba3-4354-a108-d82f8dad3168 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:39.038727 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:39.074776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb109ab2-d73f-4f1d-b184-e1cda68f679a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:39.075542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb109ab2-d73f-4f1d-b184-e1cda68f679a admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:39.075923 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb109ab2-d73f-4f1d-b184-e1cda68f679a admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:39.076205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb109ab2-d73f-4f1d-b184-e1cda68f679a admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:39.076950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb109ab2-d73f-4f1d-b184-e1cda68f679a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:39.079100 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb109ab2-d73f-4f1d-b184-e1cda68f679a admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:39.223798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1274/2544] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:58:38 2022] POST /identity/v3/users => generated 288 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:58:39.227996 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f29959-d2cc-478b-b5da-417cc5bfe571 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:39.237963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f29959-d2cc-478b-b5da-417cc5bfe571 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:39.242851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cdb78-fa3e-4e31-b424-5541bc84ebef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:39.243500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cdb78-fa3e-4e31-b424-5541bc84ebef admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:39.243782 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cdb78-fa3e-4e31-b424-5541bc84ebef admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:39.244057 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cdb78-fa3e-4e31-b424-5541bc84ebef admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:39.244807 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cdb78-fa3e-4e31-b424-5541bc84ebef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:39.246435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cdb78-fa3e-4e31-b424-5541bc84ebef admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:39.257258 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1271/2545] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:58:39.261026 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb109ab2-d73f-4f1d-b184-e1cda68f679a admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:39.271240 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb109ab2-d73f-4f1d-b184-e1cda68f679a admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:39.275907 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546267c-0679-4e5a-8009-4473cab57548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:39.276565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546267c-0679-4e5a-8009-4473cab57548 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:39.276874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546267c-0679-4e5a-8009-4473cab57548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:39.277153 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546267c-0679-4e5a-8009-4473cab57548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:39.286191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546267c-0679-4e5a-8009-4473cab57548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:39.286191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546267c-0679-4e5a-8009-4473cab57548 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:39.292380 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1275/2546] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:58:39.293536 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cdb78-fa3e-4e31-b424-5541bc84ebef admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:39.303860 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cdb78-fa3e-4e31-b424-5541bc84ebef admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:39.308780 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb359b-d903-434c-9e2f-cde0d989fd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:39.309771 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb359b-d903-434c-9e2f-cde0d989fd5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:39.310062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb359b-d903-434c-9e2f-cde0d989fd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:39.310339 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb359b-d903-434c-9e2f-cde0d989fd5f admin admin] PATH_INFO: `/v3/projects/8332bce1e1414c2f84ba8de65b29b198/users/ad78c9dc73a149c19e66e147dd9cbeed/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:39.326384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb359b-d903-434c-9e2f-cde0d989fd5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8332bce1e1414c2f84ba8de65b29b198, user_id=ad78c9dc73a149c19e66e147dd9cbeed, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:39.329930 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb359b-d903-434c-9e2f-cde0d989fd5f admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:39.382784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1272/2547] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:39 2022] PUT /identity/v3/projects/8332bce1e1414c2f84ba8de65b29b198/users/ad78c9dc73a149c19e66e147dd9cbeed/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:58:39.394395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd028173-6663-46a4-a75c-5726483fafa2 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:39.394913 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd028173-6663-46a4-a75c-5726483fafa2 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:39.395027 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd028173-6663-46a4-a75c-5726483fafa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:39.421555 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-fd028173-6663-46a4-a75c-5726483fafa2 None None] MFA Rules not processed for user `ad78c9dc73a149c19e66e147dd9cbeed`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:39.423271 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-fd028173-6663-46a4-a75c-5726483fafa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:39.493841 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1276/2548] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:39.506079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb359b-d903-434c-9e2f-cde0d989fd5f admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:39.525487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-afcb359b-d903-434c-9e2f-cde0d989fd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:39.526453 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:39.588250 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb359b-d903-434c-9e2f-cde0d989fd5f admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:39.588250 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636501c-626f-4e7c-aeeb-fb08630c2423 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:39.588250 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636501c-626f-4e7c-aeeb-fb08630c2423 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:39.588250 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636501c-626f-4e7c-aeeb-fb08630c2423 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:39.588650 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636501c-626f-4e7c-aeeb-fb08630c2423 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:39.596784 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636501c-626f-4e7c-aeeb-fb08630c2423 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:39.598352 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636501c-626f-4e7c-aeeb-fb08630c2423 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:39.607346 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1273/2549] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:41.543971 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a068dca-8fff-4837-a1bd-4a7fe0e0b0cd None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:41.544550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a068dca-8fff-4837-a1bd-4a7fe0e0b0cd None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:41.544550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a068dca-8fff-4837-a1bd-4a7fe0e0b0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:41.564271 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-6a068dca-8fff-4837-a1bd-4a7fe0e0b0cd None None] MFA Rules not processed for user `ad78c9dc73a149c19e66e147dd9cbeed`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:41.565506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6a068dca-8fff-4837-a1bd-4a7fe0e0b0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:41.573514 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1277/2550] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:47.545875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576e0bb-fe81-4628-b73a-45001ae026b8 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:47.546440 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576e0bb-fe81-4628-b73a-45001ae026b8 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:47.548150 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576e0bb-fe81-4628-b73a-45001ae026b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:47.581667 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-9576e0bb-fe81-4628-b73a-45001ae026b8 None None] MFA Rules not processed for user `46e692bef3e3484ebac5d1563e489e03`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:47.583188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-9576e0bb-fe81-4628-b73a-45001ae026b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:47.652726 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1274/2551] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:47.770932 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a068dca-8fff-4837-a1bd-4a7fe0e0b0cd None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:47.772565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6a068dca-8fff-4837-a1bd-4a7fe0e0b0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:47.902088 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:47.907483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a068dca-8fff-4837-a1bd-4a7fe0e0b0cd None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:47.914006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1390b4-5a08-4065-a7f8-30c12e8c8c21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:47.914677 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1390b4-5a08-4065-a7f8-30c12e8c8c21 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:47.914966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1390b4-5a08-4065-a7f8-30c12e8c8c21 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:47.915620 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1390b4-5a08-4065-a7f8-30c12e8c8c21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:47.917200 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6c1390b4-5a08-4065-a7f8-30c12e8c8c21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:47.931536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1390b4-5a08-4065-a7f8-30c12e8c8c21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:47.933463 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1390b4-5a08-4065-a7f8-30c12e8c8c21 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:47.945394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1278/2552] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:53.627250 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576e0bb-fe81-4628-b73a-45001ae026b8 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:53.628764 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-9576e0bb-fe81-4628-b73a-45001ae026b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:53.684689 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576e0bb-fe81-4628-b73a-45001ae026b8 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:53.688243 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be422d4-f6ff-4130-8e36-3fd4385d5b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:53.688914 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be422d4-f6ff-4130-8e36-3fd4385d5b82 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:53.689197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be422d4-f6ff-4130-8e36-3fd4385d5b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:53.689473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be422d4-f6ff-4130-8e36-3fd4385d5b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:53.691238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-0be422d4-f6ff-4130-8e36-3fd4385d5b82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:53.752188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be422d4-f6ff-4130-8e36-3fd4385d5b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:53.753651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be422d4-f6ff-4130-8e36-3fd4385d5b82 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:53.763050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1275/2553] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:58:55.928906 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1390b4-5a08-4065-a7f8-30c12e8c8c21 service nova] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:55.931060 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6c1390b4-5a08-4065-a7f8-30c12e8c8c21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:55.947868 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1390b4-5a08-4065-a7f8-30c12e8c8c21 service nova] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:55.958693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4cf9f-846b-4a19-9e1a-a22f09159ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:55.959945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4cf9f-846b-4a19-9e1a-a22f09159ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:55.965740 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4cf9f-846b-4a19-9e1a-a22f09159ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:55.966251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4cf9f-846b-4a19-9e1a-a22f09159ac1 admin admin] PATH_INFO: `/v3/users/15fe5d89bf354359a8ff70580361f6aa` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:55.967950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4cf9f-846b-4a19-9e1a-a22f09159ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15fe5d89bf354359a8ff70580361f6aa)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:55.970569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4cf9f-846b-4a19-9e1a-a22f09159ac1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:56.275934 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-50d4cf9f-846b-4a19-9e1a-a22f09159ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15fe5d89bf354359a8ff70580361f6aa'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:56.425618 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-50d4cf9f-846b-4a19-9e1a-a22f09159ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15fe5d89bf354359a8ff70580361f6aa'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:56.426393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-50d4cf9f-846b-4a19-9e1a-a22f09159ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15fe5d89bf354359a8ff70580361f6aa'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:56.441475 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-50d4cf9f-846b-4a19-9e1a-a22f09159ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15fe5d89bf354359a8ff70580361f6aa'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:56.442245 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-50d4cf9f-846b-4a19-9e1a-a22f09159ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15fe5d89bf354359a8ff70580361f6aa'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:56.457426 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1279/2554] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:55 2022] DELETE /identity/v3/users/15fe5d89bf354359a8ff70580361f6aa => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:57.122749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be422d4-f6ff-4130-8e36-3fd4385d5b82 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:57.134386 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be422d4-f6ff-4130-8e36-3fd4385d5b82 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:57.143801 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:57.209099 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed6f89-5f64-4351-81a3-55b681c4ec58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:57.210357 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed6f89-5f64-4351-81a3-55b681c4ec58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:57.210825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed6f89-5f64-4351-81a3-55b681c4ec58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:57.211319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed6f89-5f64-4351-81a3-55b681c4ec58 admin admin] PATH_INFO: `/v3/projects/34bbb31dfc95466b99049b249cd0c0d6` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:57.212921 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed6f89-5f64-4351-81a3-55b681c4ec58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34bbb31dfc95466b99049b249cd0c0d6)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:57.215034 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed6f89-5f64-4351-81a3-55b681c4ec58 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:57.354702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dfed6f89-5f64-4351-81a3-55b681c4ec58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34bbb31dfc95466b99049b249cd0c0d6', 'request_id': 'req-dfed6f89-5f64-4351-81a3-55b681c4ec58'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:57.435909 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dfed6f89-5f64-4351-81a3-55b681c4ec58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34bbb31dfc95466b99049b249cd0c0d6', 'request_id': 'req-dfed6f89-5f64-4351-81a3-55b681c4ec58'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:57.442939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dfed6f89-5f64-4351-81a3-55b681c4ec58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34bbb31dfc95466b99049b249cd0c0d6', 'request_id': 'req-dfed6f89-5f64-4351-81a3-55b681c4ec58'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:57.453507 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dfed6f89-5f64-4351-81a3-55b681c4ec58 admin admin] The token cache is being invalidate because project 34bbb31dfc95466b99049b249cd0c0d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:58:57.453804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dfed6f89-5f64-4351-81a3-55b681c4ec58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:57.454458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dfed6f89-5f64-4351-81a3-55b681c4ec58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:57.456548 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1276/2555] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:57 2022] DELETE /identity/v3/projects/34bbb31dfc95466b99049b249cd0c0d6 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:57.460644 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4cf9f-846b-4a19-9e1a-a22f09159ac1 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:57.462598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-50d4cf9f-846b-4a19-9e1a-a22f09159ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:57.476348 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4cf9f-846b-4a19-9e1a-a22f09159ac1 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:57.535117 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fcea9-cb0e-49d1-b671-244c2c54fbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:57.536001 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fcea9-cb0e-49d1-b671-244c2c54fbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:57.536285 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fcea9-cb0e-49d1-b671-244c2c54fbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:57.536564 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fcea9-cb0e-49d1-b671-244c2c54fbef admin admin] PATH_INFO: `/v3/users/1e2a324e6ce440a8a785e059550cb7ae` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:57.537775 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fcea9-cb0e-49d1-b671-244c2c54fbef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e2a324e6ce440a8a785e059550cb7ae)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:57.539728 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fcea9-cb0e-49d1-b671-244c2c54fbef admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:57.735095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-589fcea9-cb0e-49d1-b671-244c2c54fbef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e2a324e6ce440a8a785e059550cb7ae'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:57.808345 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-589fcea9-cb0e-49d1-b671-244c2c54fbef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e2a324e6ce440a8a785e059550cb7ae'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:57.808878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-589fcea9-cb0e-49d1-b671-244c2c54fbef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e2a324e6ce440a8a785e059550cb7ae'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:57.820187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:57.833234 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-589fcea9-cb0e-49d1-b671-244c2c54fbef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e2a324e6ce440a8a785e059550cb7ae'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:57.834001 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-589fcea9-cb0e-49d1-b671-244c2c54fbef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e2a324e6ce440a8a785e059550cb7ae'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:57.851431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1280/2556] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:57 2022] DELETE /identity/v3/users/1e2a324e6ce440a8a785e059550cb7ae => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:58.459948 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed6f89-5f64-4351-81a3-55b681c4ec58 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:58.463216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-dfed6f89-5f64-4351-81a3-55b681c4ec58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:58.499726 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed6f89-5f64-4351-81a3-55b681c4ec58 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:58.608019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26df26-8024-436b-a7f0-4024300e44bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:58.608019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26df26-8024-436b-a7f0-4024300e44bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:58.608019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26df26-8024-436b-a7f0-4024300e44bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:58.608019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26df26-8024-436b-a7f0-4024300e44bd admin admin] PATH_INFO: `/v3/projects/608d8a4e1522422b96a615ba4b491ef7` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:58.608822 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26df26-8024-436b-a7f0-4024300e44bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=608d8a4e1522422b96a615ba4b491ef7)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:58.610982 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26df26-8024-436b-a7f0-4024300e44bd admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:58.766426 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:58.772254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dc26df26-8024-436b-a7f0-4024300e44bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608d8a4e1522422b96a615ba4b491ef7', 'request_id': 'req-dc26df26-8024-436b-a7f0-4024300e44bd'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:58.898883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dc26df26-8024-436b-a7f0-4024300e44bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608d8a4e1522422b96a615ba4b491ef7', 'request_id': 'req-dc26df26-8024-436b-a7f0-4024300e44bd'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:58.907508 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dc26df26-8024-436b-a7f0-4024300e44bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608d8a4e1522422b96a615ba4b491ef7', 'request_id': 'req-dc26df26-8024-436b-a7f0-4024300e44bd'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:58.921974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dc26df26-8024-436b-a7f0-4024300e44bd admin admin] The token cache is being invalidate because project 608d8a4e1522422b96a615ba4b491ef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:58:58.922276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dc26df26-8024-436b-a7f0-4024300e44bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:58.923114 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dc26df26-8024-436b-a7f0-4024300e44bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:58.928138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1277/2557] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:58 2022] DELETE /identity/v3/projects/608d8a4e1522422b96a615ba4b491ef7 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:58.929944 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e482e3f-eb54-436d-a2d5-d90e04a59c1b None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:58.930428 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e482e3f-eb54-436d-a2d5-d90e04a59c1b None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:58.930505 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e482e3f-eb54-436d-a2d5-d90e04a59c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:58.963264 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-6e482e3f-eb54-436d-a2d5-d90e04a59c1b None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:58.964694 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6e482e3f-eb54-436d-a2d5-d90e04a59c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:59.047470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1281/2558] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:59.055605 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4254ee0-d92d-4b31-a8c9-369e4a3f1461 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:59.056915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4254ee0-d92d-4b31-a8c9-369e4a3f1461 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:59.056915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4254ee0-d92d-4b31-a8c9-369e4a3f1461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:59.075951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-f4254ee0-d92d-4b31-a8c9-369e4a3f1461 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:59.077189 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f4254ee0-d92d-4b31-a8c9-369e4a3f1461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:59.092821 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1278/2559] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:58:59.092931 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e482e3f-eb54-436d-a2d5-d90e04a59c1b None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:59.096305 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4254ee0-d92d-4b31-a8c9-369e4a3f1461 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:59.098561 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f4254ee0-d92d-4b31-a8c9-369e4a3f1461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:59.103696 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e482e3f-eb54-436d-a2d5-d90e04a59c1b None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:59.109111 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb9137-0902-44f2-b73a-bde3ed9fdc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:59.110131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb9137-0902-44f2-b73a-bde3ed9fdc60 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:59.110628 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb9137-0902-44f2-b73a-bde3ed9fdc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:59.111019 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb9137-0902-44f2-b73a-bde3ed9fdc60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:59.112122 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb9137-0902-44f2-b73a-bde3ed9fdc60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:58:59.112531 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb9137-0902-44f2-b73a-bde3ed9fdc60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:59.114544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb9137-0902-44f2-b73a-bde3ed9fdc60 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:59.119773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4254ee0-d92d-4b31-a8c9-369e4a3f1461 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:59.130227 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e214413-70ef-4565-9c75-23475b05ea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:59.131111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e214413-70ef-4565-9c75-23475b05ea79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:59.131457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e214413-70ef-4565-9c75-23475b05ea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:59.131724 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e214413-70ef-4565-9c75-23475b05ea79 admin admin] PATH_INFO: `/v3/users/388330e61ade4f188c40c11c4ac46fd0` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:59.132691 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1282/2560] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:58:59.133722 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb9137-0902-44f2-b73a-bde3ed9fdc60 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:59.133891 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e214413-70ef-4565-9c75-23475b05ea79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=388330e61ade4f188c40c11c4ac46fd0)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:59.136572 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e214413-70ef-4565-9c75-23475b05ea79 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:59.145511 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb9137-0902-44f2-b73a-bde3ed9fdc60 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:59.151602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc250d3c-d600-47b0-902a-9b90c707fdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:59.152354 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc250d3c-d600-47b0-902a-9b90c707fdd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:59.152793 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc250d3c-d600-47b0-902a-9b90c707fdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:59.153158 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc250d3c-d600-47b0-902a-9b90c707fdd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:59.153878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc250d3c-d600-47b0-902a-9b90c707fdd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:59.155827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc250d3c-d600-47b0-902a-9b90c707fdd2 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:59.307002 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1283/2561] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:58:59 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:58:59.310942 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc250d3c-d600-47b0-902a-9b90c707fdd2 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:59.372732 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc250d3c-d600-47b0-902a-9b90c707fdd2 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:59.377519 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd0853-b261-47fe-bad9-54908036b862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:59.378202 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd0853-b261-47fe-bad9-54908036b862 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:59.378490 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd0853-b261-47fe-bad9-54908036b862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:59.378772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd0853-b261-47fe-bad9-54908036b862 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:59.379646 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd0853-b261-47fe-bad9-54908036b862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:59.381609 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd0853-b261-47fe-bad9-54908036b862 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:59.443831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3e214413-70ef-4565-9c75-23475b05ea79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388330e61ade4f188c40c11c4ac46fd0'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:59.444487 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3e214413-70ef-4565-9c75-23475b05ea79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388330e61ade4f188c40c11c4ac46fd0'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:59.445119 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3e214413-70ef-4565-9c75-23475b05ea79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388330e61ade4f188c40c11c4ac46fd0'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:59.456559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3e214413-70ef-4565-9c75-23475b05ea79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388330e61ade4f188c40c11c4ac46fd0'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:59.466594 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3e214413-70ef-4565-9c75-23475b05ea79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388330e61ade4f188c40c11c4ac46fd0'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:58:59.560284 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1284/2562] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:58:59 2022] POST /identity/v3/users => generated 292 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:58:59.563734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd0853-b261-47fe-bad9-54908036b862 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:59.565619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-44bd0853-b261-47fe-bad9-54908036b862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:59.577999 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd0853-b261-47fe-bad9-54908036b862 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:59.584098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb366e-b10b-4fc4-bd14-5900c5009855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:59.585150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb366e-b10b-4fc4-bd14-5900c5009855 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:59.585443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb366e-b10b-4fc4-bd14-5900c5009855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:59.585723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb366e-b10b-4fc4-bd14-5900c5009855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:59.586449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb366e-b10b-4fc4-bd14-5900c5009855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:59.588053 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb366e-b10b-4fc4-bd14-5900c5009855 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:59.588832 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1279/2563] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:58:59 2022] DELETE /identity/v3/users/388330e61ade4f188c40c11c4ac46fd0 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:59.599491 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1285/2564] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:58:59.604839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e214413-70ef-4565-9c75-23475b05ea79 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:59.667663 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e214413-70ef-4565-9c75-23475b05ea79 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:59.672308 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff3568-4f99-47d9-8a2d-4f05448ea933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:59.673001 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff3568-4f99-47d9-8a2d-4f05448ea933 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:59.673279 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff3568-4f99-47d9-8a2d-4f05448ea933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:59.673548 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff3568-4f99-47d9-8a2d-4f05448ea933 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:59.674268 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff3568-4f99-47d9-8a2d-4f05448ea933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:59.675865 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff3568-4f99-47d9-8a2d-4f05448ea933 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:59.688790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1280/2565] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:58:59.690724 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb366e-b10b-4fc4-bd14-5900c5009855 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:59.701281 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb366e-b10b-4fc4-bd14-5900c5009855 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:59.706655 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab4703-188d-479a-a636-5645bb4d40e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:59.707672 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab4703-188d-479a-a636-5645bb4d40e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:59.707964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab4703-188d-479a-a636-5645bb4d40e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:59.708276 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab4703-188d-479a-a636-5645bb4d40e7 admin admin] PATH_INFO: `/v3/projects/2c39e19afaf5417a9abee705cd065440/users/d32a1f6b2bb243c1bed0ee78bb2c2e57/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:59.725885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab4703-188d-479a-a636-5645bb4d40e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c39e19afaf5417a9abee705cd065440, user_id=d32a1f6b2bb243c1bed0ee78bb2c2e57, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:59.728560 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab4703-188d-479a-a636-5645bb4d40e7 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:58:59.814473 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:59.819249 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1286/2566] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:58:59 2022] PUT /identity/v3/projects/2c39e19afaf5417a9abee705cd065440/users/d32a1f6b2bb243c1bed0ee78bb2c2e57/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:58:59.849936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff3568-4f99-47d9-8a2d-4f05448ea933 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:58:59.853995 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-9bff3568-4f99-47d9-8a2d-4f05448ea933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:59.870619 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff3568-4f99-47d9-8a2d-4f05448ea933 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:58:59.880824 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74885b39-467d-4f19-bb51-134497346f27 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:59.881116 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74885b39-467d-4f19-bb51-134497346f27 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:59.881395 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74885b39-467d-4f19-bb51-134497346f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:59.913814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-74885b39-467d-4f19-bb51-134497346f27 None None] MFA Rules not processed for user `d32a1f6b2bb243c1bed0ee78bb2c2e57`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:58:59.913814 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-74885b39-467d-4f19-bb51-134497346f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:58:59.935090 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ca33a-d4af-480f-b1ae-866bc2babc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:58:59.935959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ca33a-d4af-480f-b1ae-866bc2babc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:58:59.936242 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ca33a-d4af-480f-b1ae-866bc2babc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:58:59.936519 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ca33a-d4af-480f-b1ae-866bc2babc98 admin admin] PATH_INFO: `/v3/projects/8e24cfce792042e2b665ef2cca91b752` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:58:59.937774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ca33a-d4af-480f-b1ae-866bc2babc98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e24cfce792042e2b665ef2cca91b752)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:58:59.942320 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ca33a-d4af-480f-b1ae-866bc2babc98 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:00.001406 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1287/2567] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:58:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:00.007097 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74885b39-467d-4f19-bb51-134497346f27 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:00.018195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74885b39-467d-4f19-bb51-134497346f27 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:00.024564 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742bb9a-8de8-4619-aa08-3b25026d2d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:00.025465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742bb9a-8de8-4619-aa08-3b25026d2d69 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:00.025752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742bb9a-8de8-4619-aa08-3b25026d2d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:00.026031 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742bb9a-8de8-4619-aa08-3b25026d2d69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:00.026872 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742bb9a-8de8-4619-aa08-3b25026d2d69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:00.029008 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742bb9a-8de8-4619-aa08-3b25026d2d69 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:00.054301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-737ca33a-d4af-480f-b1ae-866bc2babc98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e24cfce792042e2b665ef2cca91b752', 'request_id': 'req-737ca33a-d4af-480f-b1ae-866bc2babc98'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:00.115175 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1288/2568] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:59:00 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:00.116373 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742bb9a-8de8-4619-aa08-3b25026d2d69 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:00.121829 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-737ca33a-d4af-480f-b1ae-866bc2babc98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e24cfce792042e2b665ef2cca91b752', 'request_id': 'req-737ca33a-d4af-480f-b1ae-866bc2babc98'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:00.129293 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-737ca33a-d4af-480f-b1ae-866bc2babc98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e24cfce792042e2b665ef2cca91b752', 'request_id': 'req-737ca33a-d4af-480f-b1ae-866bc2babc98'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:00.141122 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-737ca33a-d4af-480f-b1ae-866bc2babc98 admin admin] The token cache is being invalidate because project 8e24cfce792042e2b665ef2cca91b752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:59:00.141496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-737ca33a-d4af-480f-b1ae-866bc2babc98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:00.143021 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-737ca33a-d4af-480f-b1ae-866bc2babc98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:00.145528 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1281/2569] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:58:59 2022] DELETE /identity/v3/projects/8e24cfce792042e2b665ef2cca91b752 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:00.166103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0c56a-2fc4-40cd-b8d8-a3afa89182ad None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:00.166103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0c56a-2fc4-40cd-b8d8-a3afa89182ad None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:00.166103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0c56a-2fc4-40cd-b8d8-a3afa89182ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:00.169951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:00.193048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-22f0c56a-2fc4-40cd-b8d8-a3afa89182ad None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:00.194316 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-22f0c56a-2fc4-40cd-b8d8-a3afa89182ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:00.194606 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742bb9a-8de8-4619-aa08-3b25026d2d69 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:00.200342 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622eaab-8ead-4bce-b106-0c4886c80007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:00.200953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622eaab-8ead-4bce-b106-0c4886c80007 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:00.201463 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622eaab-8ead-4bce-b106-0c4886c80007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:00.201938 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622eaab-8ead-4bce-b106-0c4886c80007 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:00.202600 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1282/2570] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:59:00.202939 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622eaab-8ead-4bce-b106-0c4886c80007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:00.205657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622eaab-8ead-4bce-b106-0c4886c80007 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:00.211167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdaf8b-d36c-4984-b285-1a8858af55b4 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:00.212314 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdaf8b-d36c-4984-b285-1a8858af55b4 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:00.212314 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdaf8b-d36c-4984-b285-1a8858af55b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:00.240380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-9bfdaf8b-d36c-4984-b285-1a8858af55b4 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:00.241863 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-9bfdaf8b-d36c-4984-b285-1a8858af55b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:00.250052 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1283/2571] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:59:00.254346 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdaf8b-d36c-4984-b285-1a8858af55b4 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:00.263323 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdaf8b-d36c-4984-b285-1a8858af55b4 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:00.267893 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e28eb5-6e0c-4618-8084-73ccc2d928e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:00.268548 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e28eb5-6e0c-4618-8084-73ccc2d928e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:00.268864 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e28eb5-6e0c-4618-8084-73ccc2d928e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:00.269141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e28eb5-6e0c-4618-8084-73ccc2d928e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:00.269861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e28eb5-6e0c-4618-8084-73ccc2d928e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:59:00.270164 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e28eb5-6e0c-4618-8084-73ccc2d928e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:00.271757 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e28eb5-6e0c-4618-8084-73ccc2d928e9 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:00.288259 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1284/2572] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:59:00.290555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e28eb5-6e0c-4618-8084-73ccc2d928e9 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:00.301442 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e28eb5-6e0c-4618-8084-73ccc2d928e9 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:00.306245 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d7659-c13b-43dc-8c37-e8ea0a2ae69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:00.306930 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d7659-c13b-43dc-8c37-e8ea0a2ae69f admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:00.307212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d7659-c13b-43dc-8c37-e8ea0a2ae69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:00.307491 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d7659-c13b-43dc-8c37-e8ea0a2ae69f admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:00.308178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d7659-c13b-43dc-8c37-e8ea0a2ae69f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:00.310148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d7659-c13b-43dc-8c37-e8ea0a2ae69f admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:00.323905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1289/2573] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:59:00 2022] POST /identity/v3/users => generated 299 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:59:00.328070 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622eaab-8ead-4bce-b106-0c4886c80007 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:00.329905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-7622eaab-8ead-4bce-b106-0c4886c80007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:00.342317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622eaab-8ead-4bce-b106-0c4886c80007 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:00.347674 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1db99-ee1a-4591-acbd-86e9bac98e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:00.348362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1db99-ee1a-4591-acbd-86e9bac98e7b admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:00.348672 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1db99-ee1a-4591-acbd-86e9bac98e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:00.348963 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1db99-ee1a-4591-acbd-86e9bac98e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:00.350018 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1db99-ee1a-4591-acbd-86e9bac98e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:00.351237 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1db99-ee1a-4591-acbd-86e9bac98e7b admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:00.365148 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1290/2574] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:59:00.366135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1db99-ee1a-4591-acbd-86e9bac98e7b admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:00.376260 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1db99-ee1a-4591-acbd-86e9bac98e7b admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:00.384198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812a8c7-e459-4104-a83a-60d5e46520f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:00.385119 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812a8c7-e459-4104-a83a-60d5e46520f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:00.385400 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812a8c7-e459-4104-a83a-60d5e46520f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:00.385671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812a8c7-e459-4104-a83a-60d5e46520f0 admin admin] PATH_INFO: `/v3/projects/431b06c12ae647bd996d96828fd4b7e1/users/b8e65dc493564700bf57f2b5f276aa98/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:00.401759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812a8c7-e459-4104-a83a-60d5e46520f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=431b06c12ae647bd996d96828fd4b7e1, user_id=b8e65dc493564700bf57f2b5f276aa98, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:00.404386 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812a8c7-e459-4104-a83a-60d5e46520f0 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:00.421443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1285/2575] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:59:00 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:59:00.426806 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d7659-c13b-43dc-8c37-e8ea0a2ae69f admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:00.488086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d7659-c13b-43dc-8c37-e8ea0a2ae69f admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:00.493532 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58655d09-0201-439c-848b-30db633efbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:00.494245 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58655d09-0201-439c-848b-30db633efbad admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:00.494531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58655d09-0201-439c-848b-30db633efbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:00.494808 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58655d09-0201-439c-848b-30db633efbad admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:00.496172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58655d09-0201-439c-848b-30db633efbad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:00.498178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58655d09-0201-439c-848b-30db633efbad admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:00.503458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1291/2576] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:00 2022] PUT /identity/v3/projects/431b06c12ae647bd996d96828fd4b7e1/users/b8e65dc493564700bf57f2b5f276aa98/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:59:00.507299 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812a8c7-e459-4104-a83a-60d5e46520f0 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:00.579466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812a8c7-e459-4104-a83a-60d5e46520f0 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:00.585208 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74653c55-5716-4dc7-a770-099f809b908f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:00.585916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74653c55-5716-4dc7-a770-099f809b908f admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:00.586205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74653c55-5716-4dc7-a770-099f809b908f admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:00.586484 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74653c55-5716-4dc7-a770-099f809b908f admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:00.587248 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74653c55-5716-4dc7-a770-099f809b908f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:00.588890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74653c55-5716-4dc7-a770-099f809b908f admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:00.599282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1292/2577] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:00.603079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1286/2578] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:59:00 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:59:00.605216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74653c55-5716-4dc7-a770-099f809b908f admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:00.614699 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58655d09-0201-439c-848b-30db633efbad admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:00.618741 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74653c55-5716-4dc7-a770-099f809b908f admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:00.624610 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0b17e-e4a8-4b3e-a9fd-eb3f4708d8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:00.625579 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0b17e-e4a8-4b3e-a9fd-eb3f4708d8e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:00.625690 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58655d09-0201-439c-848b-30db633efbad admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:00.625936 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0b17e-e4a8-4b3e-a9fd-eb3f4708d8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:00.626340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0b17e-e4a8-4b3e-a9fd-eb3f4708d8e5 admin admin] PATH_INFO: `/v3/projects/431b06c12ae647bd996d96828fd4b7e1/users/b8e65dc493564700bf57f2b5f276aa98/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:00.629200 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0b17e-e4a8-4b3e-a9fd-eb3f4708d8e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=431b06c12ae647bd996d96828fd4b7e1, user_id=b8e65dc493564700bf57f2b5f276aa98, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:00.631276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58288255-1a3d-4f36-899d-9778e51e9e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:00.631960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58288255-1a3d-4f36-899d-9778e51e9e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:00.632078 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0b17e-e4a8-4b3e-a9fd-eb3f4708d8e5 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:00.632362 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58288255-1a3d-4f36-899d-9778e51e9e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:00.632685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58288255-1a3d-4f36-899d-9778e51e9e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:00.633410 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58288255-1a3d-4f36-899d-9778e51e9e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:00.635441 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58288255-1a3d-4f36-899d-9778e51e9e50 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:00.645421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1293/2579] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:00 2022] PUT /identity/v3/projects/431b06c12ae647bd996d96828fd4b7e1/users/b8e65dc493564700bf57f2b5f276aa98/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:59:00.649932 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1287/2580] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:59:00.656776 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0b17e-e4a8-4b3e-a9fd-eb3f4708d8e5 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:00.657280 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51cb4b-4a94-4814-9d24-5ac34e6f4a8e None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:00.657729 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51cb4b-4a94-4814-9d24-5ac34e6f4a8e None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:00.658160 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51cb4b-4a94-4814-9d24-5ac34e6f4a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:00.688003 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-eb51cb4b-4a94-4814-9d24-5ac34e6f4a8e None None] MFA Rules not processed for user `b8e65dc493564700bf57f2b5f276aa98`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:00.689573 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-eb51cb4b-4a94-4814-9d24-5ac34e6f4a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:00.725171 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0b17e-e4a8-4b3e-a9fd-eb3f4708d8e5 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:00.729972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5914c7-e14f-4769-8314-1864edfef5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:00.730641 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5914c7-e14f-4769-8314-1864edfef5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:00.730924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5914c7-e14f-4769-8314-1864edfef5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:00.731203 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5914c7-e14f-4769-8314-1864edfef5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:00.733915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5914c7-e14f-4769-8314-1864edfef5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:00.733915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5914c7-e14f-4769-8314-1864edfef5b0 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:00.744538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1294/2581] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:00.749291 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5914c7-e14f-4769-8314-1864edfef5b0 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:00.768013 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5914c7-e14f-4769-8314-1864edfef5b0 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:00.771526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82eca8-5519-4d65-bad3-5fd389507ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:00.772447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82eca8-5519-4d65-bad3-5fd389507ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:00.772765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82eca8-5519-4d65-bad3-5fd389507ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:00.773458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1288/2582] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:00.776854 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82eca8-5519-4d65-bad3-5fd389507ba1 admin admin] PATH_INFO: `/v3/projects/f4b50d6234cf4ffc865f1f3432c1aef2/users/9b73cbc658464f45b7f83c5f7f7626c2/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:00.785180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51cb4b-4a94-4814-9d24-5ac34e6f4a8e None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:00.786919 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-eb51cb4b-4a94-4814-9d24-5ac34e6f4a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:00.792926 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82eca8-5519-4d65-bad3-5fd389507ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b50d6234cf4ffc865f1f3432c1aef2, user_id=9b73cbc658464f45b7f83c5f7f7626c2, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:00.795805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82eca8-5519-4d65-bad3-5fd389507ba1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:00.807925 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:00.849381 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51cb4b-4a94-4814-9d24-5ac34e6f4a8e None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:00.853349 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfa507-9bc3-46aa-bec6-dabb3a6fde78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:00.853994 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfa507-9bc3-46aa-bec6-dabb3a6fde78 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:00.854272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfa507-9bc3-46aa-bec6-dabb3a6fde78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:00.854544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfa507-9bc3-46aa-bec6-dabb3a6fde78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:00.856332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b6cfa507-9bc3-46aa-bec6-dabb3a6fde78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:00.896386 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1295/2583] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:00 2022] PUT /identity/v3/projects/f4b50d6234cf4ffc865f1f3432c1aef2/users/9b73cbc658464f45b7f83c5f7f7626c2/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:59:00.903510 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:00.907461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bb4c0-39bd-4045-9d45-04893e9366b7 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:00.907911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bb4c0-39bd-4045-9d45-04893e9366b7 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:00.908341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bb4c0-39bd-4045-9d45-04893e9366b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:00.919744 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfa507-9bc3-46aa-bec6-dabb3a6fde78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:00.921226 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfa507-9bc3-46aa-bec6-dabb3a6fde78 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:00.930450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1289/2584] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:59:00.943262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-a11bb4c0-39bd-4045-9d45-04893e9366b7 None None] MFA Rules not processed for user `9b73cbc658464f45b7f83c5f7f7626c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:00.944854 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-a11bb4c0-39bd-4045-9d45-04893e9366b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:01.015726 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1296/2585] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:01.020858 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfa507-9bc3-46aa-bec6-dabb3a6fde78 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:01.031359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfa507-9bc3-46aa-bec6-dabb3a6fde78 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:01.089154 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d569613-a7ac-4765-b9f3-08be7c0638b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:01.089887 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d569613-a7ac-4765-b9f3-08be7c0638b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:01.090172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d569613-a7ac-4765-b9f3-08be7c0638b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:01.090444 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d569613-a7ac-4765-b9f3-08be7c0638b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:01.091117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d569613-a7ac-4765-b9f3-08be7c0638b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:01.093097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d569613-a7ac-4765-b9f3-08be7c0638b5 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:01.325759 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1290/2586] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:59:01 2022] POST /identity/v3/projects => generated 371 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:01.329227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bb4c0-39bd-4045-9d45-04893e9366b7 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:01.339877 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bb4c0-39bd-4045-9d45-04893e9366b7 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:01.343355 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:01.395857 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0d77d-67e8-4df0-a1df-a974045fd702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:01.396464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0d77d-67e8-4df0-a1df-a974045fd702 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:01.396784 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0d77d-67e8-4df0-a1df-a974045fd702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:01.397063 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0d77d-67e8-4df0-a1df-a974045fd702 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:01.397744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0d77d-67e8-4df0-a1df-a974045fd702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:01.399653 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0d77d-67e8-4df0-a1df-a974045fd702 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:01.522161 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1297/2587] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:59:01 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:59:01.526168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d569613-a7ac-4765-b9f3-08be7c0638b5 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:01.528551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:01.538815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d569613-a7ac-4765-b9f3-08be7c0638b5 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:01.543380 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813881a-6678-4101-a057-58c3434b3541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:01.544077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813881a-6678-4101-a057-58c3434b3541 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:01.544356 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813881a-6678-4101-a057-58c3434b3541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:01.544683 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813881a-6678-4101-a057-58c3434b3541 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:01.545401 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813881a-6678-4101-a057-58c3434b3541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:01.546988 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813881a-6678-4101-a057-58c3434b3541 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:01.558015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1291/2588] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:01.562296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0d77d-67e8-4df0-a1df-a974045fd702 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:01.572154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0d77d-67e8-4df0-a1df-a974045fd702 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:01.576784 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76934ff-b28b-44d1-a2e3-39cae99640c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:01.577707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76934ff-b28b-44d1-a2e3-39cae99640c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:01.577983 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76934ff-b28b-44d1-a2e3-39cae99640c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:01.578255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76934ff-b28b-44d1-a2e3-39cae99640c0 admin admin] PATH_INFO: `/v3/projects/01f1fa7ed96341e48ea29616537160b3/users/dbdce6d94cdc4a329c330dd231e70a95/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:01.594154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76934ff-b28b-44d1-a2e3-39cae99640c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f1fa7ed96341e48ea29616537160b3, user_id=dbdce6d94cdc4a329c330dd231e70a95, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:01.597341 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76934ff-b28b-44d1-a2e3-39cae99640c0 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:01.673499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1298/2589] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:01 2022] PUT /identity/v3/projects/01f1fa7ed96341e48ea29616537160b3/users/dbdce6d94cdc4a329c330dd231e70a95/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:59:01.677976 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813881a-6678-4101-a057-58c3434b3541 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:01.687745 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813881a-6678-4101-a057-58c3434b3541 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:01.742089 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe87dc-2530-4c8c-87b9-68cfd481af71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:01.743008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe87dc-2530-4c8c-87b9-68cfd481af71 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:01.743290 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe87dc-2530-4c8c-87b9-68cfd481af71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:01.743566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe87dc-2530-4c8c-87b9-68cfd481af71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:01.744286 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe87dc-2530-4c8c-87b9-68cfd481af71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:01.745926 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe87dc-2530-4c8c-87b9-68cfd481af71 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:01.764296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1292/2590] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:01.764401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76934ff-b28b-44d1-a2e3-39cae99640c0 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:01.770975 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76934ff-b28b-44d1-a2e3-39cae99640c0 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:01.777585 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e80d9-06d9-4b2f-8d8b-faeb79ff2d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:01.778604 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e80d9-06d9-4b2f-8d8b-faeb79ff2d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:01.778890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e80d9-06d9-4b2f-8d8b-faeb79ff2d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:01.779166 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e80d9-06d9-4b2f-8d8b-faeb79ff2d9d admin admin] PATH_INFO: `/v3/projects/01f1fa7ed96341e48ea29616537160b3/users/dbdce6d94cdc4a329c330dd231e70a95/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:01.781253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e80d9-06d9-4b2f-8d8b-faeb79ff2d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f1fa7ed96341e48ea29616537160b3, user_id=dbdce6d94cdc4a329c330dd231e70a95, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:01.783860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e80d9-06d9-4b2f-8d8b-faeb79ff2d9d admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:01.805562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1299/2591] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:01 2022] PUT /identity/v3/projects/01f1fa7ed96341e48ea29616537160b3/users/dbdce6d94cdc4a329c330dd231e70a95/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:59:01.808180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493878f2-f94b-41ad-8a57-de5f99fe1bc1 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:01.808479 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493878f2-f94b-41ad-8a57-de5f99fe1bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:01.808792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493878f2-f94b-41ad-8a57-de5f99fe1bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:01.837651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-493878f2-f94b-41ad-8a57-de5f99fe1bc1 None None] MFA Rules not processed for user `dbdce6d94cdc4a329c330dd231e70a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:01.838887 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-493878f2-f94b-41ad-8a57-de5f99fe1bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:01.925350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1293/2592] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:01.937154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e80d9-06d9-4b2f-8d8b-faeb79ff2d9d admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:01.938994 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ec5e80d9-06d9-4b2f-8d8b-faeb79ff2d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:01.997047 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e80d9-06d9-4b2f-8d8b-faeb79ff2d9d admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:02.000731 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf5a55-92b3-4791-bf77-911f623d2d99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:02.001383 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf5a55-92b3-4791-bf77-911f623d2d99 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:02.001675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf5a55-92b3-4791-bf77-911f623d2d99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:02.001955 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf5a55-92b3-4791-bf77-911f623d2d99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:02.037360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf5a55-92b3-4791-bf77-911f623d2d99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:02.038780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf5a55-92b3-4791-bf77-911f623d2d99 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:02.048381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1300/2593] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:03.004332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493878f2-f94b-41ad-8a57-de5f99fe1bc1 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:03.040474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:03.075034 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493878f2-f94b-41ad-8a57-de5f99fe1bc1 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:03.080535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a719aed-9f3e-4407-b02a-57cf5b0af388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:03.082055 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a719aed-9f3e-4407-b02a-57cf5b0af388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:03.082277 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a719aed-9f3e-4407-b02a-57cf5b0af388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:03.082557 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a719aed-9f3e-4407-b02a-57cf5b0af388 admin admin] PATH_INFO: `/v3/users/9b73cbc658464f45b7f83c5f7f7626c2` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:03.083814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a719aed-9f3e-4407-b02a-57cf5b0af388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b73cbc658464f45b7f83c5f7f7626c2)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:03.085798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a719aed-9f3e-4407-b02a-57cf5b0af388 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:03.387214 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-6a719aed-9f3e-4407-b02a-57cf5b0af388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b73cbc658464f45b7f83c5f7f7626c2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:03.387888 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-6a719aed-9f3e-4407-b02a-57cf5b0af388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b73cbc658464f45b7f83c5f7f7626c2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:03.388496 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-6a719aed-9f3e-4407-b02a-57cf5b0af388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b73cbc658464f45b7f83c5f7f7626c2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:03.411039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-6a719aed-9f3e-4407-b02a-57cf5b0af388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b73cbc658464f45b7f83c5f7f7626c2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:03.417835 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-6a719aed-9f3e-4407-b02a-57cf5b0af388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b73cbc658464f45b7f83c5f7f7626c2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:03.488239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1294/2594] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:59:03 2022] DELETE /identity/v3/users/9b73cbc658464f45b7f83c5f7f7626c2 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:03.493349 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6808a8-6e31-4e49-8821-fd407dd09d8d None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:03.493816 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6808a8-6e31-4e49-8821-fd407dd09d8d None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:03.493957 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6808a8-6e31-4e49-8821-fd407dd09d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:03.511941 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-1c6808a8-6e31-4e49-8821-fd407dd09d8d None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:03.513096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1c6808a8-6e31-4e49-8821-fd407dd09d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:03.594364 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1301/2595] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:59:03.599815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a719aed-9f3e-4407-b02a-57cf5b0af388 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:03.601316 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-6a719aed-9f3e-4407-b02a-57cf5b0af388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:03.671890 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a719aed-9f3e-4407-b02a-57cf5b0af388 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:03.676759 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0ca05-0d8c-497b-93cc-71d5172556ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:03.677424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0ca05-0d8c-497b-93cc-71d5172556ee service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:03.677706 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0ca05-0d8c-497b-93cc-71d5172556ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:03.678000 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0ca05-0d8c-497b-93cc-71d5172556ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:03.687877 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0ca05-0d8c-497b-93cc-71d5172556ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:03.689361 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0ca05-0d8c-497b-93cc-71d5172556ee service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:03.699331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1295/2596] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:04.204276 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6808a8-6e31-4e49-8821-fd407dd09d8d None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:04.207070 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-1c6808a8-6e31-4e49-8821-fd407dd09d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:04.216820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:04.222455 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6808a8-6e31-4e49-8821-fd407dd09d8d None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:04.228305 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b79407-b039-4594-9846-c9dad6e73056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:04.230447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b79407-b039-4594-9846-c9dad6e73056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:04.230447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b79407-b039-4594-9846-c9dad6e73056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:04.230447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b79407-b039-4594-9846-c9dad6e73056 admin admin] PATH_INFO: `/v3/projects/f4b50d6234cf4ffc865f1f3432c1aef2` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:04.233626 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b79407-b039-4594-9846-c9dad6e73056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b50d6234cf4ffc865f1f3432c1aef2)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:04.235739 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b79407-b039-4594-9846-c9dad6e73056 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:04.334181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-77b79407-b039-4594-9846-c9dad6e73056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b50d6234cf4ffc865f1f3432c1aef2', 'request_id': 'req-77b79407-b039-4594-9846-c9dad6e73056'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:04.339429 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-77b79407-b039-4594-9846-c9dad6e73056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b50d6234cf4ffc865f1f3432c1aef2', 'request_id': 'req-77b79407-b039-4594-9846-c9dad6e73056'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:04.427570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-77b79407-b039-4594-9846-c9dad6e73056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b50d6234cf4ffc865f1f3432c1aef2', 'request_id': 'req-77b79407-b039-4594-9846-c9dad6e73056'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:04.439137 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-77b79407-b039-4594-9846-c9dad6e73056 admin admin] The token cache is being invalidate because project f4b50d6234cf4ffc865f1f3432c1aef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:59:04.439422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-77b79407-b039-4594-9846-c9dad6e73056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:04.440036 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-77b79407-b039-4594-9846-c9dad6e73056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:04.442213 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1302/2597] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:59:04 2022] DELETE /identity/v3/projects/f4b50d6234cf4ffc865f1f3432c1aef2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:04.446251 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0ca05-0d8c-497b-93cc-71d5172556ee service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:04.455710 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0ca05-0d8c-497b-93cc-71d5172556ee service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:04.501590 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:04.511593 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be85a5-267b-4427-ac31-9479864f0e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:04.512466 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be85a5-267b-4427-ac31-9479864f0e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:04.512783 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be85a5-267b-4427-ac31-9479864f0e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:04.513077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be85a5-267b-4427-ac31-9479864f0e89 admin admin] PATH_INFO: `/v3/users/dbdce6d94cdc4a329c330dd231e70a95` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:04.514247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be85a5-267b-4427-ac31-9479864f0e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbdce6d94cdc4a329c330dd231e70a95)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:04.516181 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be85a5-267b-4427-ac31-9479864f0e89 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:04.653691 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-72be85a5-267b-4427-ac31-9479864f0e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbdce6d94cdc4a329c330dd231e70a95'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:04.654340 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-72be85a5-267b-4427-ac31-9479864f0e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbdce6d94cdc4a329c330dd231e70a95'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:04.654950 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-72be85a5-267b-4427-ac31-9479864f0e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbdce6d94cdc4a329c330dd231e70a95'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:04.667999 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-72be85a5-267b-4427-ac31-9479864f0e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbdce6d94cdc4a329c330dd231e70a95'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:04.678247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-72be85a5-267b-4427-ac31-9479864f0e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbdce6d94cdc4a329c330dd231e70a95'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:04.789699 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1296/2598] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:59:04 2022] DELETE /identity/v3/users/dbdce6d94cdc4a329c330dd231e70a95 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:05.038168 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dff520-7e43-4b84-a3fb-46f54fec6651 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:05.038168 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dff520-7e43-4b84-a3fb-46f54fec6651 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:05.038168 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dff520-7e43-4b84-a3fb-46f54fec6651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:05.057297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-06dff520-7e43-4b84-a3fb-46f54fec6651 None None] MFA Rules not processed for user `5890e1e70ffd4e33a812691e9c43b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:05.058191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-06dff520-7e43-4b84-a3fb-46f54fec6651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:05.119044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1303/2599] 10.222.0.66 () {58 vars in 1009 bytes} [Thu May 26 21:59:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:05.213059 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be85a5-267b-4427-ac31-9479864f0e89 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:05.214475 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-72be85a5-267b-4427-ac31-9479864f0e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:05.279362 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dff520-7e43-4b84-a3fb-46f54fec6651 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:05.281707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-06dff520-7e43-4b84-a3fb-46f54fec6651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:05.318800 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be85a5-267b-4427-ac31-9479864f0e89 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:05.324036 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c26912-a646-4784-b1a7-cab3228e6b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:05.324950 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c26912-a646-4784-b1a7-cab3228e6b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:05.325228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c26912-a646-4784-b1a7-cab3228e6b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:05.325508 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c26912-a646-4784-b1a7-cab3228e6b3d admin admin] PATH_INFO: `/v3/projects/01f1fa7ed96341e48ea29616537160b3` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:05.327155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c26912-a646-4784-b1a7-cab3228e6b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f1fa7ed96341e48ea29616537160b3)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:05.329111 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c26912-a646-4784-b1a7-cab3228e6b3d admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:05.385516 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dff520-7e43-4b84-a3fb-46f54fec6651 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:05.390707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab1ab5-bce9-4c7d-88a9-3a243934377a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6304e47844214d2db0acfae11e4714ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:05.391481 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab1ab5-bce9-4c7d-88a9-3a243934377a service swift] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:05.392607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab1ab5-bce9-4c7d-88a9-3a243934377a service swift] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:05.392607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab1ab5-bce9-4c7d-88a9-3a243934377a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:05.409699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab1ab5-bce9-4c7d-88a9-3a243934377a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:05.411734 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab1ab5-bce9-4c7d-88a9-3a243934377a service swift] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:05.429574 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1304/2600] 10.222.0.66 () {60 vars in 1384 bytes} [Thu May 26 21:59:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 21:59:05.561281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-48c26912-a646-4784-b1a7-cab3228e6b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f1fa7ed96341e48ea29616537160b3', 'request_id': 'req-48c26912-a646-4784-b1a7-cab3228e6b3d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:05.693565 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-48c26912-a646-4784-b1a7-cab3228e6b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f1fa7ed96341e48ea29616537160b3', 'request_id': 'req-48c26912-a646-4784-b1a7-cab3228e6b3d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:05.700526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-48c26912-a646-4784-b1a7-cab3228e6b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f1fa7ed96341e48ea29616537160b3', 'request_id': 'req-48c26912-a646-4784-b1a7-cab3228e6b3d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:05.707764 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:05.711483 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-48c26912-a646-4784-b1a7-cab3228e6b3d admin admin] The token cache is being invalidate because project 01f1fa7ed96341e48ea29616537160b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:59:05.711776 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-48c26912-a646-4784-b1a7-cab3228e6b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:05.712426 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-48c26912-a646-4784-b1a7-cab3228e6b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:05.716630 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1297/2601] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:59:05 2022] DELETE /identity/v3/projects/01f1fa7ed96341e48ea29616537160b3 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:59:05.718808 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0edb51-f5be-4f1e-baa9-07da8309c061 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:05.719099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0edb51-f5be-4f1e-baa9-07da8309c061 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:05.719379 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0edb51-f5be-4f1e-baa9-07da8309c061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:05.739289 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-cf0edb51-f5be-4f1e-baa9-07da8309c061 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:05.740872 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-cf0edb51-f5be-4f1e-baa9-07da8309c061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:05.755324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:05.803186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1305/2602] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:05.810751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dd76c-0012-4ac5-b86e-ec9de9209b82 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:05.811037 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dd76c-0012-4ac5-b86e-ec9de9209b82 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:05.811312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dd76c-0012-4ac5-b86e-ec9de9209b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:05.829437 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-6b1dd76c-0012-4ac5-b86e-ec9de9209b82 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:05.830702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-6b1dd76c-0012-4ac5-b86e-ec9de9209b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:05.838434 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1298/2603] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:05.842680 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0edb51-f5be-4f1e-baa9-07da8309c061 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:05.852434 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0edb51-f5be-4f1e-baa9-07da8309c061 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:05.857064 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afdb66-3949-409b-8496-26ea7f2e1ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:05.857756 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afdb66-3949-409b-8496-26ea7f2e1ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:05.858043 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afdb66-3949-409b-8496-26ea7f2e1ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:05.858326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afdb66-3949-409b-8496-26ea7f2e1ae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:05.859053 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afdb66-3949-409b-8496-26ea7f2e1ae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:59:05.859361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afdb66-3949-409b-8496-26ea7f2e1ae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:05.860995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afdb66-3949-409b-8496-26ea7f2e1ae2 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:05.873219 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1306/2604] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:59:05.877334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dd76c-0012-4ac5-b86e-ec9de9209b82 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:05.887233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dd76c-0012-4ac5-b86e-ec9de9209b82 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:05.892147 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361f1ad-6c4c-446e-9b9e-b1e2215650b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:05.892839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361f1ad-6c4c-446e-9b9e-b1e2215650b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:05.893126 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361f1ad-6c4c-446e-9b9e-b1e2215650b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:05.893401 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361f1ad-6c4c-446e-9b9e-b1e2215650b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:05.894161 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361f1ad-6c4c-446e-9b9e-b1e2215650b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:05.896054 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361f1ad-6c4c-446e-9b9e-b1e2215650b6 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:05.996525 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1299/2605] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:59:05 2022] POST /identity/v3/projects => generated 357 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:06.001094 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afdb66-3949-409b-8496-26ea7f2e1ae2 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:06.011766 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afdb66-3949-409b-8496-26ea7f2e1ae2 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:06.071286 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd5b5a-6c29-4265-a460-636b2beb9dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:06.071972 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd5b5a-6c29-4265-a460-636b2beb9dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:06.072261 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd5b5a-6c29-4265-a460-636b2beb9dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:06.073761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd5b5a-6c29-4265-a460-636b2beb9dc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:06.074468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd5b5a-6c29-4265-a460-636b2beb9dc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:06.076426 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd5b5a-6c29-4265-a460-636b2beb9dc9 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:06.157296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1307/2606] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:59:06 2022] POST /identity/v3/users => generated 279 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:06.164463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361f1ad-6c4c-446e-9b9e-b1e2215650b6 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:06.171001 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361f1ad-6c4c-446e-9b9e-b1e2215650b6 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:06.176321 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f6955-4046-4c6d-866a-e3e245f1d765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:06.177019 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f6955-4046-4c6d-866a-e3e245f1d765 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:06.177304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f6955-4046-4c6d-866a-e3e245f1d765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:06.177586 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f6955-4046-4c6d-866a-e3e245f1d765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:06.178314 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f6955-4046-4c6d-866a-e3e245f1d765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:06.179939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f6955-4046-4c6d-866a-e3e245f1d765 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:06.190362 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1300/2607] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:59:06.194436 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd5b5a-6c29-4265-a460-636b2beb9dc9 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:06.204957 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd5b5a-6c29-4265-a460-636b2beb9dc9 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:06.209798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0fda8-cf39-47fa-95bf-b1b0e26ef480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:06.210457 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0fda8-cf39-47fa-95bf-b1b0e26ef480 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:06.210740 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0fda8-cf39-47fa-95bf-b1b0e26ef480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:06.211016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0fda8-cf39-47fa-95bf-b1b0e26ef480 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:06.211739 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0fda8-cf39-47fa-95bf-b1b0e26ef480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:06.213378 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0fda8-cf39-47fa-95bf-b1b0e26ef480 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:06.223878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1308/2608] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:59:06.227848 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f6955-4046-4c6d-866a-e3e245f1d765 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:06.237295 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f6955-4046-4c6d-866a-e3e245f1d765 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:06.242433 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636204f-ca66-4dd6-b036-48ac4e55ffbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:06.243555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636204f-ca66-4dd6-b036-48ac4e55ffbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:06.243831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636204f-ca66-4dd6-b036-48ac4e55ffbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:06.244110 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636204f-ca66-4dd6-b036-48ac4e55ffbb admin admin] PATH_INFO: `/v3/projects/12ab080644dd44a79bc1b82e60942b6a/users/faf34f90f08b4461b6d9d583af1b5f90/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:06.259392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636204f-ca66-4dd6-b036-48ac4e55ffbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ab080644dd44a79bc1b82e60942b6a, user_id=faf34f90f08b4461b6d9d583af1b5f90, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:06.262092 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636204f-ca66-4dd6-b036-48ac4e55ffbb admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:06.294670 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d9618-fcbf-46a0-8f8d-3ede9a259de9 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:06.294962 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d9618-fcbf-46a0-8f8d-3ede9a259de9 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:06.295244 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d9618-fcbf-46a0-8f8d-3ede9a259de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:06.313332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-3d3d9618-fcbf-46a0-8f8d-3ede9a259de9 None None] MFA Rules not processed for user `5890e1e70ffd4e33a812691e9c43b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:06.314519 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3d3d9618-fcbf-46a0-8f8d-3ede9a259de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:06.373250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1309/2609] 10.222.0.66 () {58 vars in 967 bytes} [Thu May 26 21:59:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:59:06.376504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1301/2610] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:06 2022] PUT /identity/v3/projects/12ab080644dd44a79bc1b82e60942b6a/users/faf34f90f08b4461b6d9d583af1b5f90/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:06.385899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d9618-fcbf-46a0-8f8d-3ede9a259de9 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:06.386893 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bb1d7-3399-4761-a753-dd35dc60a8d8 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:06.387183 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bb1d7-3399-4761-a753-dd35dc60a8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:06.387477 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bb1d7-3399-4761-a753-dd35dc60a8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:06.387665 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3d3d9618-fcbf-46a0-8f8d-3ede9a259de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:06.413880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-180bb1d7-3399-4761-a753-dd35dc60a8d8 None None] MFA Rules not processed for user `faf34f90f08b4461b6d9d583af1b5f90`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:06.415108 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-180bb1d7-3399-4761-a753-dd35dc60a8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:06.457619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d9618-fcbf-46a0-8f8d-3ede9a259de9 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:06.476551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1302/2611] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:06 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:59:06.481397 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bb1d7-3399-4761-a753-dd35dc60a8d8 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:06.520391 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdff00-87c8-4bd3-a6c2-2be624f910e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6304e47844214d2db0acfae11e4714ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:06.521470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdff00-87c8-4bd3-a6c2-2be624f910e8 service swift] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:06.521706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdff00-87c8-4bd3-a6c2-2be624f910e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:06.524096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdff00-87c8-4bd3-a6c2-2be624f910e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:06.544790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bb1d7-3399-4761-a753-dd35dc60a8d8 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:06.549569 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273387c-256d-4c51-a072-0ae1c1526b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:06.550980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273387c-256d-4c51-a072-0ae1c1526b61 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:06.551315 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273387c-256d-4c51-a072-0ae1c1526b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:06.551599 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273387c-256d-4c51-a072-0ae1c1526b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:06.552300 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273387c-256d-4c51-a072-0ae1c1526b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:06.558714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273387c-256d-4c51-a072-0ae1c1526b61 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:06.591752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdff00-87c8-4bd3-a6c2-2be624f910e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:06.593509 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdff00-87c8-4bd3-a6c2-2be624f910e8 service swift] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:06.602074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1310/2612] 10.222.0.66 () {60 vars in 1384 bytes} [Thu May 26 21:59:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 21:59:06.652392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1303/2613] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:59:06 2022] POST /identity/v3/projects => generated 357 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:59:06.656513 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdff00-87c8-4bd3-a6c2-2be624f910e8 service swift] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:06.666901 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdff00-87c8-4bd3-a6c2-2be624f910e8 service swift] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:06.715286 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:06.730783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e78f6-429a-4b0a-8443-8a41d1ecd8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:06.731469 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e78f6-429a-4b0a-8443-8a41d1ecd8cf admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:06.731789 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e78f6-429a-4b0a-8443-8a41d1ecd8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:06.732070 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e78f6-429a-4b0a-8443-8a41d1ecd8cf admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:06.732801 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e78f6-429a-4b0a-8443-8a41d1ecd8cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:06.734711 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e78f6-429a-4b0a-8443-8a41d1ecd8cf admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:06.815218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1311/2614] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:59:06 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:06.819086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273387c-256d-4c51-a072-0ae1c1526b61 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:06.830815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273387c-256d-4c51-a072-0ae1c1526b61 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:06.835520 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a346ef-1468-476a-9f15-0ca25c9df561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:06.836406 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a346ef-1468-476a-9f15-0ca25c9df561 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:06.836796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a346ef-1468-476a-9f15-0ca25c9df561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:06.837133 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a346ef-1468-476a-9f15-0ca25c9df561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:06.838009 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a346ef-1468-476a-9f15-0ca25c9df561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:06.839604 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a346ef-1468-476a-9f15-0ca25c9df561 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:06.845359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:06.854011 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1304/2615] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:59:06.857044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e78f6-429a-4b0a-8443-8a41d1ecd8cf admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:06.868509 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e78f6-429a-4b0a-8443-8a41d1ecd8cf admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:06.873659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89798709-425c-4d4c-accd-50267763e7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:06.874794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89798709-425c-4d4c-accd-50267763e7cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:06.876084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:06.876675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89798709-425c-4d4c-accd-50267763e7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:06.877021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89798709-425c-4d4c-accd-50267763e7cf admin admin] PATH_INFO: `/v3/projects/3f4218618f2541a2af43eeaa815d90d4/users/89b4249948a34d848afab49696700d81/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:06.892172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89798709-425c-4d4c-accd-50267763e7cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4218618f2541a2af43eeaa815d90d4, user_id=89b4249948a34d848afab49696700d81, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:06.894874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89798709-425c-4d4c-accd-50267763e7cf admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:06.997579 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1312/2616] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:06 2022] PUT /identity/v3/projects/3f4218618f2541a2af43eeaa815d90d4/users/89b4249948a34d848afab49696700d81/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:07.001479 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a346ef-1468-476a-9f15-0ca25c9df561 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:07.011700 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a346ef-1468-476a-9f15-0ca25c9df561 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:07.076263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a771a4-26d8-4a16-9861-8c4a8ab959c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:07.076995 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a771a4-26d8-4a16-9861-8c4a8ab959c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:07.077270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a771a4-26d8-4a16-9861-8c4a8ab959c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:07.077538 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a771a4-26d8-4a16-9861-8c4a8ab959c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:07.078313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a771a4-26d8-4a16-9861-8c4a8ab959c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:07.081864 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a771a4-26d8-4a16-9861-8c4a8ab959c0 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:07.090158 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1305/2617] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:07.094412 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89798709-425c-4d4c-accd-50267763e7cf admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:07.105231 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89798709-425c-4d4c-accd-50267763e7cf admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:07.109891 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515427e-9ae0-4607-b188-90b0bab5d01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:07.110797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515427e-9ae0-4607-b188-90b0bab5d01a admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:07.111081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515427e-9ae0-4607-b188-90b0bab5d01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:07.111364 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515427e-9ae0-4607-b188-90b0bab5d01a admin admin] PATH_INFO: `/v3/projects/3f4218618f2541a2af43eeaa815d90d4/users/89b4249948a34d848afab49696700d81/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:07.113984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515427e-9ae0-4607-b188-90b0bab5d01a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4218618f2541a2af43eeaa815d90d4, user_id=89b4249948a34d848afab49696700d81, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:07.116622 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515427e-9ae0-4607-b188-90b0bab5d01a admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:07.127430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1313/2618] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:07 2022] PUT /identity/v3/projects/3f4218618f2541a2af43eeaa815d90d4/users/89b4249948a34d848afab49696700d81/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:59:07.138739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9444b89-d83d-4948-afb7-faf697f2353b None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:07.139043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9444b89-d83d-4948-afb7-faf697f2353b None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:07.139316 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9444b89-d83d-4948-afb7-faf697f2353b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:07.170452 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-c9444b89-d83d-4948-afb7-faf697f2353b None None] MFA Rules not processed for user `89b4249948a34d848afab49696700d81`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:07.171663 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-c9444b89-d83d-4948-afb7-faf697f2353b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:07.241865 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1306/2619] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:07 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:07.253464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515427e-9ae0-4607-b188-90b0bab5d01a admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:07.255188 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-5515427e-9ae0-4607-b188-90b0bab5d01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:07.311638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e53b4-2b7a-4121-becd-f1f7046e7fba None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:07.312273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e53b4-2b7a-4121-becd-f1f7046e7fba None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:07.312559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e53b4-2b7a-4121-becd-f1f7046e7fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:07.316386 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515427e-9ae0-4607-b188-90b0bab5d01a admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:07.320877 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a76e9-fe9b-4f55-8511-c139997c7fb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:07.321053 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a76e9-fe9b-4f55-8511-c139997c7fb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:07.321390 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a76e9-fe9b-4f55-8511-c139997c7fb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:07.321753 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a76e9-fe9b-4f55-8511-c139997c7fb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:07.332628 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a76e9-fe9b-4f55-8511-c139997c7fb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:07.333735 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a76e9-fe9b-4f55-8511-c139997c7fb3 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:07.334714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-969e53b4-2b7a-4121-becd-f1f7046e7fba None None] MFA Rules not processed for user `5890e1e70ffd4e33a812691e9c43b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:07.335991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-969e53b4-2b7a-4121-becd-f1f7046e7fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:07.344809 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1314/2620] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:07 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:07.401820 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1307/2621] 10.222.0.66 () {58 vars in 1009 bytes} [Thu May 26 21:59:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:59:07.414616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a76e9-fe9b-4f55-8511-c139997c7fb3 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:07.475679 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e53b4-2b7a-4121-becd-f1f7046e7fba None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:07.477504 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-969e53b4-2b7a-4121-becd-f1f7046e7fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:07.488815 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a76e9-fe9b-4f55-8511-c139997c7fb3 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:07.489392 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e53b4-2b7a-4121-becd-f1f7046e7fba None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:07.493460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5f16b-3c3a-4571-8f32-de2f535dbcef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:07.494118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5f16b-3c3a-4571-8f32-de2f535dbcef service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:07.494288 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314399e1-7d02-4680-b8cd-d70f18a1b05d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6304e47844214d2db0acfae11e4714ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:07.494412 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5f16b-3c3a-4571-8f32-de2f535dbcef service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:07.494697 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5f16b-3c3a-4571-8f32-de2f535dbcef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:07.494928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314399e1-7d02-4680-b8cd-d70f18a1b05d service swift] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:07.495214 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314399e1-7d02-4680-b8cd-d70f18a1b05d service swift] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:07.495490 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314399e1-7d02-4680-b8cd-d70f18a1b05d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:07.496462 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b2d5f16b-3c3a-4571-8f32-de2f535dbcef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:07.510021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314399e1-7d02-4680-b8cd-d70f18a1b05d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:07.510021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314399e1-7d02-4680-b8cd-d70f18a1b05d service swift] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:07.514194 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1315/2622] 10.222.0.66 () {60 vars in 1384 bytes} [Thu May 26 21:59:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:59:07.522923 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:07.561690 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5f16b-3c3a-4571-8f32-de2f535dbcef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:07.563208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5f16b-3c3a-4571-8f32-de2f535dbcef service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:07.573320 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1308/2623] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:59:07.586528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314399e1-7d02-4680-b8cd-d70f18a1b05d service swift] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:07.595917 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314399e1-7d02-4680-b8cd-d70f18a1b05d service swift] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:07.600440 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ad23c-72a4-4667-a37c-199287ff0fe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:07.601173 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ad23c-72a4-4667-a37c-199287ff0fe8 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:07.601460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ad23c-72a4-4667-a37c-199287ff0fe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:07.601735 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ad23c-72a4-4667-a37c-199287ff0fe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:07.667472 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ad23c-72a4-4667-a37c-199287ff0fe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:07.669424 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ad23c-72a4-4667-a37c-199287ff0fe8 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:07.673132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:07.680634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1316/2624] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:07 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:08.362769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef796d6-e28d-4568-983d-9a096fd198b7 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:08.363229 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef796d6-e28d-4568-983d-9a096fd198b7 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:08.368208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef796d6-e28d-4568-983d-9a096fd198b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:08.381961 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-9ef796d6-e28d-4568-983d-9a096fd198b7 None None] MFA Rules not processed for user `5890e1e70ffd4e33a812691e9c43b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:08.383519 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-9ef796d6-e28d-4568-983d-9a096fd198b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:08.391134 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1309/2625] 10.222.0.66 () {58 vars in 967 bytes} [Thu May 26 21:59:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:08.403651 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ad23c-72a4-4667-a37c-199287ff0fe8 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:08.415688 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ad23c-72a4-4667-a37c-199287ff0fe8 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:08.421462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774d15b-70a1-4b27-86e3-76c72188f37a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6304e47844214d2db0acfae11e4714ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:08.422154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774d15b-70a1-4b27-86e3-76c72188f37a service swift] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:08.422438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774d15b-70a1-4b27-86e3-76c72188f37a service swift] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:08.422712 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774d15b-70a1-4b27-86e3-76c72188f37a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:08.431651 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774d15b-70a1-4b27-86e3-76c72188f37a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:08.433266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774d15b-70a1-4b27-86e3-76c72188f37a service swift] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:08.443493 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1317/2626] 10.222.0.66 () {60 vars in 1384 bytes} [Thu May 26 21:59:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 21:59:11.334516 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef796d6-e28d-4568-983d-9a096fd198b7 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:11.338942 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-9ef796d6-e28d-4568-983d-9a096fd198b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:11.416800 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef796d6-e28d-4568-983d-9a096fd198b7 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:11.421351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d9684-6f0b-4d1a-83fd-65309392f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:11.422802 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d9684-6f0b-4d1a-83fd-65309392f018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:11.422802 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d9684-6f0b-4d1a-83fd-65309392f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:11.422802 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d9684-6f0b-4d1a-83fd-65309392f018 admin admin] PATH_INFO: `/v3/users/ad78c9dc73a149c19e66e147dd9cbeed` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:11.424056 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d9684-6f0b-4d1a-83fd-65309392f018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad78c9dc73a149c19e66e147dd9cbeed)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:11.426052 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d9684-6f0b-4d1a-83fd-65309392f018 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:11.667882 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-720d9684-6f0b-4d1a-83fd-65309392f018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad78c9dc73a149c19e66e147dd9cbeed'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:11.672369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-720d9684-6f0b-4d1a-83fd-65309392f018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad78c9dc73a149c19e66e147dd9cbeed'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:11.681130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-720d9684-6f0b-4d1a-83fd-65309392f018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad78c9dc73a149c19e66e147dd9cbeed'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:11.690417 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-720d9684-6f0b-4d1a-83fd-65309392f018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad78c9dc73a149c19e66e147dd9cbeed'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:11.702240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-720d9684-6f0b-4d1a-83fd-65309392f018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad78c9dc73a149c19e66e147dd9cbeed'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:11.792554 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1310/2627] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:59:11 2022] DELETE /identity/v3/users/ad78c9dc73a149c19e66e147dd9cbeed => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:11.798012 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109f722-f9ac-42e4-896f-d601ad56d894 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:11.799126 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109f722-f9ac-42e4-896f-d601ad56d894 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:11.800114 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109f722-f9ac-42e4-896f-d601ad56d894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:11.826789 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-a109f722-f9ac-42e4-896f-d601ad56d894 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:11.831219 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-a109f722-f9ac-42e4-896f-d601ad56d894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:11.904851 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1318/2628] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:59:11.915212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d9684-6f0b-4d1a-83fd-65309392f018 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:11.917586 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-720d9684-6f0b-4d1a-83fd-65309392f018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:11.960506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:11.981219 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d9684-6f0b-4d1a-83fd-65309392f018 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:11.985221 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62cf85-054f-4dfc-a0f1-066f2d261be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:11.992752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62cf85-054f-4dfc-a0f1-066f2d261be3 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:11.992752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62cf85-054f-4dfc-a0f1-066f2d261be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:11.992752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62cf85-054f-4dfc-a0f1-066f2d261be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:11.997035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62cf85-054f-4dfc-a0f1-066f2d261be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:11.998560 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62cf85-054f-4dfc-a0f1-066f2d261be3 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:12.010765 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1311/2629] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:12.424979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109f722-f9ac-42e4-896f-d601ad56d894 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:12.424979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-a109f722-f9ac-42e4-896f-d601ad56d894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:12.430452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109f722-f9ac-42e4-896f-d601ad56d894 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:12.436492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6fde7-ba9a-405a-9025-269fad92f631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:12.437720 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6fde7-ba9a-405a-9025-269fad92f631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:12.437909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6fde7-ba9a-405a-9025-269fad92f631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:12.438171 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6fde7-ba9a-405a-9025-269fad92f631 admin admin] PATH_INFO: `/v3/projects/8332bce1e1414c2f84ba8de65b29b198` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:12.439431 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6fde7-ba9a-405a-9025-269fad92f631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8332bce1e1414c2f84ba8de65b29b198)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:12.441997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6fde7-ba9a-405a-9025-269fad92f631 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:12.536869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-c3f6fde7-ba9a-405a-9025-269fad92f631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8332bce1e1414c2f84ba8de65b29b198', 'request_id': 'req-c3f6fde7-ba9a-405a-9025-269fad92f631'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:12.544298 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-c3f6fde7-ba9a-405a-9025-269fad92f631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8332bce1e1414c2f84ba8de65b29b198', 'request_id': 'req-c3f6fde7-ba9a-405a-9025-269fad92f631'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:12.646331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-c3f6fde7-ba9a-405a-9025-269fad92f631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8332bce1e1414c2f84ba8de65b29b198', 'request_id': 'req-c3f6fde7-ba9a-405a-9025-269fad92f631'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:12.657705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-c3f6fde7-ba9a-405a-9025-269fad92f631 admin admin] The token cache is being invalidate because project 8332bce1e1414c2f84ba8de65b29b198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:59:12.657988 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-c3f6fde7-ba9a-405a-9025-269fad92f631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:12.658610 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-c3f6fde7-ba9a-405a-9025-269fad92f631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:12.660803 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1319/2630] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:59:12 2022] DELETE /identity/v3/projects/8332bce1e1414c2f84ba8de65b29b198 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:13.936945 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62cf85-054f-4dfc-a0f1-066f2d261be3 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:13.938469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ac62cf85-054f-4dfc-a0f1-066f2d261be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:13.951176 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62cf85-054f-4dfc-a0f1-066f2d261be3 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:14.006753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34612d1b-1fe6-4bcb-8b70-155c79062068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:14.007877 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34612d1b-1fe6-4bcb-8b70-155c79062068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:14.008172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34612d1b-1fe6-4bcb-8b70-155c79062068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:14.008427 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34612d1b-1fe6-4bcb-8b70-155c79062068 admin admin] PATH_INFO: `/v3/users/d32a1f6b2bb243c1bed0ee78bb2c2e57` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:14.009624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34612d1b-1fe6-4bcb-8b70-155c79062068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d32a1f6b2bb243c1bed0ee78bb2c2e57)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:14.011534 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34612d1b-1fe6-4bcb-8b70-155c79062068 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:14.261624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-34612d1b-1fe6-4bcb-8b70-155c79062068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd32a1f6b2bb243c1bed0ee78bb2c2e57'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:14.262283 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-34612d1b-1fe6-4bcb-8b70-155c79062068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd32a1f6b2bb243c1bed0ee78bb2c2e57'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:14.262894 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-34612d1b-1fe6-4bcb-8b70-155c79062068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd32a1f6b2bb243c1bed0ee78bb2c2e57'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:14.275639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-34612d1b-1fe6-4bcb-8b70-155c79062068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd32a1f6b2bb243c1bed0ee78bb2c2e57'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:14.282746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-34612d1b-1fe6-4bcb-8b70-155c79062068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd32a1f6b2bb243c1bed0ee78bb2c2e57'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:14.405495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1312/2631] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:59:13 2022] DELETE /identity/v3/users/d32a1f6b2bb243c1bed0ee78bb2c2e57 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:59:14.410105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e91b7d-e402-471e-85b9-3a990bb33d61 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:14.410581 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e91b7d-e402-471e-85b9-3a990bb33d61 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:14.410720 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e91b7d-e402-471e-85b9-3a990bb33d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:14.431884 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-63e91b7d-e402-471e-85b9-3a990bb33d61 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:14.431884 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-63e91b7d-e402-471e-85b9-3a990bb33d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:14.494347 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1320/2632] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:14.504719 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34612d1b-1fe6-4bcb-8b70-155c79062068 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:14.506068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-34612d1b-1fe6-4bcb-8b70-155c79062068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:14.569425 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34612d1b-1fe6-4bcb-8b70-155c79062068 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:14.570179 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38949c-dbd1-4f9e-93ad-ade9f091ec5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:14.570840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38949c-dbd1-4f9e-93ad-ade9f091ec5e service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:14.571202 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38949c-dbd1-4f9e-93ad-ade9f091ec5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:14.571402 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38949c-dbd1-4f9e-93ad-ade9f091ec5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:14.588381 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38949c-dbd1-4f9e-93ad-ade9f091ec5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:14.589873 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38949c-dbd1-4f9e-93ad-ade9f091ec5e service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:14.594008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:14.600522 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1313/2633] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:14.991989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e91b7d-e402-471e-85b9-3a990bb33d61 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:14.993833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-63e91b7d-e402-471e-85b9-3a990bb33d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:15.007051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e91b7d-e402-471e-85b9-3a990bb33d61 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:15.011858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f3a77-d252-4a3c-acd2-041e440ad8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:15.012897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f3a77-d252-4a3c-acd2-041e440ad8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:15.013183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f3a77-d252-4a3c-acd2-041e440ad8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:15.013461 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f3a77-d252-4a3c-acd2-041e440ad8a6 admin admin] PATH_INFO: `/v3/projects/2c39e19afaf5417a9abee705cd065440` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:15.014787 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f3a77-d252-4a3c-acd2-041e440ad8a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c39e19afaf5417a9abee705cd065440)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:15.016760 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f3a77-d252-4a3c-acd2-041e440ad8a6 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:15.020007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:15.168159 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-294f3a77-d252-4a3c-acd2-041e440ad8a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c39e19afaf5417a9abee705cd065440', 'request_id': 'req-294f3a77-d252-4a3c-acd2-041e440ad8a6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:15.173539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-294f3a77-d252-4a3c-acd2-041e440ad8a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c39e19afaf5417a9abee705cd065440', 'request_id': 'req-294f3a77-d252-4a3c-acd2-041e440ad8a6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:15.293550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-294f3a77-d252-4a3c-acd2-041e440ad8a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c39e19afaf5417a9abee705cd065440', 'request_id': 'req-294f3a77-d252-4a3c-acd2-041e440ad8a6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:15.305092 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-294f3a77-d252-4a3c-acd2-041e440ad8a6 admin admin] The token cache is being invalidate because project 2c39e19afaf5417a9abee705cd065440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:59:15.305383 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-294f3a77-d252-4a3c-acd2-041e440ad8a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:15.306034 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-294f3a77-d252-4a3c-acd2-041e440ad8a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:15.307874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1321/2634] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:59:14 2022] DELETE /identity/v3/projects/2c39e19afaf5417a9abee705cd065440 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:15.311601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38949c-dbd1-4f9e-93ad-ade9f091ec5e service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:15.322233 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38949c-dbd1-4f9e-93ad-ade9f091ec5e service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:15.379434 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7538e-2348-44fc-be4c-df32c468ef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:15.380311 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7538e-2348-44fc-be4c-df32c468ef92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:15.380613 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7538e-2348-44fc-be4c-df32c468ef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:15.380898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7538e-2348-44fc-be4c-df32c468ef92 admin admin] PATH_INFO: `/v3/users/b8e65dc493564700bf57f2b5f276aa98` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:15.382095 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7538e-2348-44fc-be4c-df32c468ef92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e65dc493564700bf57f2b5f276aa98)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:15.384020 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7538e-2348-44fc-be4c-df32c468ef92 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:15.512519 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-07a7538e-2348-44fc-be4c-df32c468ef92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e65dc493564700bf57f2b5f276aa98'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:15.513197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-07a7538e-2348-44fc-be4c-df32c468ef92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e65dc493564700bf57f2b5f276aa98'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:15.513803 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-07a7538e-2348-44fc-be4c-df32c468ef92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e65dc493564700bf57f2b5f276aa98'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:15.525382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-07a7538e-2348-44fc-be4c-df32c468ef92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e65dc493564700bf57f2b5f276aa98'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:15.531988 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-07a7538e-2348-44fc-be4c-df32c468ef92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e65dc493564700bf57f2b5f276aa98'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:15.611732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1314/2635] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:59:15 2022] DELETE /identity/v3/users/b8e65dc493564700bf57f2b5f276aa98 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:16.024372 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f3a77-d252-4a3c-acd2-041e440ad8a6 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:16.025974 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-294f3a77-d252-4a3c-acd2-041e440ad8a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:16.040183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f3a77-d252-4a3c-acd2-041e440ad8a6 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:16.105546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdab9f-2a00-4e97-abb3-09d626770386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:16.106343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdab9f-2a00-4e97-abb3-09d626770386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:16.106654 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdab9f-2a00-4e97-abb3-09d626770386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:16.106975 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdab9f-2a00-4e97-abb3-09d626770386 admin admin] PATH_INFO: `/v3/projects/431b06c12ae647bd996d96828fd4b7e1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:16.108143 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdab9f-2a00-4e97-abb3-09d626770386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=431b06c12ae647bd996d96828fd4b7e1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:16.110112 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdab9f-2a00-4e97-abb3-09d626770386 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:16.229237 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dffdab9f-2a00-4e97-abb3-09d626770386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '431b06c12ae647bd996d96828fd4b7e1', 'request_id': 'req-dffdab9f-2a00-4e97-abb3-09d626770386'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:16.234675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dffdab9f-2a00-4e97-abb3-09d626770386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '431b06c12ae647bd996d96828fd4b7e1', 'request_id': 'req-dffdab9f-2a00-4e97-abb3-09d626770386'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:16.310530 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dffdab9f-2a00-4e97-abb3-09d626770386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '431b06c12ae647bd996d96828fd4b7e1', 'request_id': 'req-dffdab9f-2a00-4e97-abb3-09d626770386'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:16.322187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dffdab9f-2a00-4e97-abb3-09d626770386 admin admin] The token cache is being invalidate because project 431b06c12ae647bd996d96828fd4b7e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:59:16.322478 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dffdab9f-2a00-4e97-abb3-09d626770386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:16.323120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dffdab9f-2a00-4e97-abb3-09d626770386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:16.324694 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1322/2636] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:59:16 2022] DELETE /identity/v3/projects/431b06c12ae647bd996d96828fd4b7e1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:16.330749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346adc8-7125-4ddf-8091-9b5aa28ea33b None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:16.331240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346adc8-7125-4ddf-8091-9b5aa28ea33b None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:16.331340 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346adc8-7125-4ddf-8091-9b5aa28ea33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:16.351083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-b346adc8-7125-4ddf-8091-9b5aa28ea33b None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:16.352291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b346adc8-7125-4ddf-8091-9b5aa28ea33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:16.413068 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1315/2637] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:16.422752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c4cf3-002d-482b-92f2-57425bb00eda None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:16.423043 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c4cf3-002d-482b-92f2-57425bb00eda None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:16.423327 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c4cf3-002d-482b-92f2-57425bb00eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:16.442897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-b87c4cf3-002d-482b-92f2-57425bb00eda None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:16.444319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-b87c4cf3-002d-482b-92f2-57425bb00eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:16.457952 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1323/2638] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:16.459144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346adc8-7125-4ddf-8091-9b5aa28ea33b None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:16.472517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346adc8-7125-4ddf-8091-9b5aa28ea33b None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:16.477860 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf322cb8-55cd-45a7-baa0-d6a8f0144c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:16.478586 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf322cb8-55cd-45a7-baa0-d6a8f0144c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:16.479005 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf322cb8-55cd-45a7-baa0-d6a8f0144c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:16.479247 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf322cb8-55cd-45a7-baa0-d6a8f0144c19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:16.479976 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf322cb8-55cd-45a7-baa0-d6a8f0144c19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:59:16.480282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf322cb8-55cd-45a7-baa0-d6a8f0144c19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:16.481918 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf322cb8-55cd-45a7-baa0-d6a8f0144c19 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:16.494340 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1316/2639] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:59:16.498658 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c4cf3-002d-482b-92f2-57425bb00eda None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:16.508538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c4cf3-002d-482b-92f2-57425bb00eda None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:16.513170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441629b9-81a9-4dc7-a7b1-3416768637c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:16.513817 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441629b9-81a9-4dc7-a7b1-3416768637c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:16.514098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441629b9-81a9-4dc7-a7b1-3416768637c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:16.514372 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441629b9-81a9-4dc7-a7b1-3416768637c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:16.515057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441629b9-81a9-4dc7-a7b1-3416768637c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:16.516950 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441629b9-81a9-4dc7-a7b1-3416768637c1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:16.530141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:16.636161 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1324/2640] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:59:16 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:16.640094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf322cb8-55cd-45a7-baa0-d6a8f0144c19 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:16.647197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:16.650952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf322cb8-55cd-45a7-baa0-d6a8f0144c19 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:16.705384 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f33bc-d796-45bd-968f-b7c3a5a7aded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:16.705992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f33bc-d796-45bd-968f-b7c3a5a7aded admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:16.706268 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f33bc-d796-45bd-968f-b7c3a5a7aded admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:16.706544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f33bc-d796-45bd-968f-b7c3a5a7aded admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:16.707819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f33bc-d796-45bd-968f-b7c3a5a7aded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:16.709901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f33bc-d796-45bd-968f-b7c3a5a7aded admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:16.782239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1317/2641] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:59:16 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:16.786472 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441629b9-81a9-4dc7-a7b1-3416768637c1 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:16.796967 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441629b9-81a9-4dc7-a7b1-3416768637c1 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:16.801674 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca648321-9247-4a44-9793-2f224230d3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:16.802336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca648321-9247-4a44-9793-2f224230d3dc admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:16.802622 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca648321-9247-4a44-9793-2f224230d3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:16.802902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca648321-9247-4a44-9793-2f224230d3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:16.803629 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca648321-9247-4a44-9793-2f224230d3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:16.805297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca648321-9247-4a44-9793-2f224230d3dc admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:16.815549 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1325/2642] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:59:16.827667 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f33bc-d796-45bd-968f-b7c3a5a7aded admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:16.838148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f33bc-d796-45bd-968f-b7c3a5a7aded admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:16.842791 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f916fe6-401a-4b01-a56c-e2b8dcfd4a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:16.843445 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f916fe6-401a-4b01-a56c-e2b8dcfd4a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:16.843731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f916fe6-401a-4b01-a56c-e2b8dcfd4a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:16.844055 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f916fe6-401a-4b01-a56c-e2b8dcfd4a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:16.845117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f916fe6-401a-4b01-a56c-e2b8dcfd4a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:16.847493 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f916fe6-401a-4b01-a56c-e2b8dcfd4a74 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:16.857574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1318/2643] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:16.861679 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca648321-9247-4a44-9793-2f224230d3dc admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:16.872403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca648321-9247-4a44-9793-2f224230d3dc admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:16.877071 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843a720-d21f-4a69-8fd8-8dc7f1c98e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:16.877946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843a720-d21f-4a69-8fd8-8dc7f1c98e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:16.878228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843a720-d21f-4a69-8fd8-8dc7f1c98e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:16.878506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843a720-d21f-4a69-8fd8-8dc7f1c98e02 admin admin] PATH_INFO: `/v3/projects/6b070b6b61ec49bcb6d8c19868d893bc/users/9650a85774ea435e89cf16c4fada639c/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:16.893330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843a720-d21f-4a69-8fd8-8dc7f1c98e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b070b6b61ec49bcb6d8c19868d893bc, user_id=9650a85774ea435e89cf16c4fada639c, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:16.895984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843a720-d21f-4a69-8fd8-8dc7f1c98e02 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:16.982231 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1326/2644] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:16 2022] PUT /identity/v3/projects/6b070b6b61ec49bcb6d8c19868d893bc/users/9650a85774ea435e89cf16c4fada639c/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:16.994065 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804bc03-2c40-4a41-b0cd-a0841aebe771 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:16.994382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804bc03-2c40-4a41-b0cd-a0841aebe771 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:16.994663 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804bc03-2c40-4a41-b0cd-a0841aebe771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:17.021398 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-f804bc03-2c40-4a41-b0cd-a0841aebe771 None None] MFA Rules not processed for user `9650a85774ea435e89cf16c4fada639c`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:17.022601 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f804bc03-2c40-4a41-b0cd-a0841aebe771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:17.085607 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1319/2645] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:17.096885 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843a720-d21f-4a69-8fd8-8dc7f1c98e02 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:17.111648 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-7843a720-d21f-4a69-8fd8-8dc7f1c98e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:17.155007 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843a720-d21f-4a69-8fd8-8dc7f1c98e02 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:17.158713 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1ee77-b5a5-4410-9296-09599f7ec148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:17.159361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1ee77-b5a5-4410-9296-09599f7ec148 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:17.159648 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1ee77-b5a5-4410-9296-09599f7ec148 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:17.159932 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1ee77-b5a5-4410-9296-09599f7ec148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:17.168272 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1ee77-b5a5-4410-9296-09599f7ec148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:17.169729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1ee77-b5a5-4410-9296-09599f7ec148 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:17.179021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1327/2646] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:21.258753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804bc03-2c40-4a41-b0cd-a0841aebe771 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:21.319638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804bc03-2c40-4a41-b0cd-a0841aebe771 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:21.324092 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9bc14-3c9d-493a-8090-1ee03e25f52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:21.324995 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9bc14-3c9d-493a-8090-1ee03e25f52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:21.325282 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9bc14-3c9d-493a-8090-1ee03e25f52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:21.325559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9bc14-3c9d-493a-8090-1ee03e25f52c admin admin] PATH_INFO: `/v3/users/9650a85774ea435e89cf16c4fada639c` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:21.326738 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9bc14-3c9d-493a-8090-1ee03e25f52c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9650a85774ea435e89cf16c4fada639c)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:21.328692 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9bc14-3c9d-493a-8090-1ee03e25f52c admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:21.342359 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:21.518935 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-77f9bc14-3c9d-493a-8090-1ee03e25f52c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9650a85774ea435e89cf16c4fada639c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:21.519500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-77f9bc14-3c9d-493a-8090-1ee03e25f52c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9650a85774ea435e89cf16c4fada639c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:21.520098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-77f9bc14-3c9d-493a-8090-1ee03e25f52c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9650a85774ea435e89cf16c4fada639c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:21.531991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-77f9bc14-3c9d-493a-8090-1ee03e25f52c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9650a85774ea435e89cf16c4fada639c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:21.538916 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-77f9bc14-3c9d-493a-8090-1ee03e25f52c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9650a85774ea435e89cf16c4fada639c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:21.625413 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1320/2647] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:59:21 2022] DELETE /identity/v3/users/9650a85774ea435e89cf16c4fada639c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:21.630134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5abd2a-2433-4c44-9978-4543f2335e44 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:21.630616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5abd2a-2433-4c44-9978-4543f2335e44 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:21.630708 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5abd2a-2433-4c44-9978-4543f2335e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:21.648032 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-0c5abd2a-2433-4c44-9978-4543f2335e44 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:21.649272 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0c5abd2a-2433-4c44-9978-4543f2335e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:21.707346 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1328/2648] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:21.717054 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9bc14-3c9d-493a-8090-1ee03e25f52c admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:21.718457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-77f9bc14-3c9d-493a-8090-1ee03e25f52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:21.774949 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9bc14-3c9d-493a-8090-1ee03e25f52c admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:21.778522 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84147a70-b7ed-4f2b-92ff-dc177272e48a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:21.779161 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84147a70-b7ed-4f2b-92ff-dc177272e48a service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:21.779447 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84147a70-b7ed-4f2b-92ff-dc177272e48a service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:21.779722 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84147a70-b7ed-4f2b-92ff-dc177272e48a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:21.789104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84147a70-b7ed-4f2b-92ff-dc177272e48a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:21.790538 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84147a70-b7ed-4f2b-92ff-dc177272e48a service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:21.799749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1321/2649] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:22.224910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5abd2a-2433-4c44-9978-4543f2335e44 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:22.226405 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0c5abd2a-2433-4c44-9978-4543f2335e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:22.240192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5abd2a-2433-4c44-9978-4543f2335e44 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:22.245668 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952939e-6307-458b-9ea2-f8c234c226b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:22.246548 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952939e-6307-458b-9ea2-f8c234c226b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:22.246826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952939e-6307-458b-9ea2-f8c234c226b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:22.247100 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952939e-6307-458b-9ea2-f8c234c226b8 admin admin] PATH_INFO: `/v3/projects/6b070b6b61ec49bcb6d8c19868d893bc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:22.248384 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952939e-6307-458b-9ea2-f8c234c226b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b070b6b61ec49bcb6d8c19868d893bc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:22.250411 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952939e-6307-458b-9ea2-f8c234c226b8 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:22.354068 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-d952939e-6307-458b-9ea2-f8c234c226b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b070b6b61ec49bcb6d8c19868d893bc', 'request_id': 'req-d952939e-6307-458b-9ea2-f8c234c226b8'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:22.358781 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:22.359940 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-d952939e-6307-458b-9ea2-f8c234c226b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b070b6b61ec49bcb6d8c19868d893bc', 'request_id': 'req-d952939e-6307-458b-9ea2-f8c234c226b8'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:22.442817 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-d952939e-6307-458b-9ea2-f8c234c226b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b070b6b61ec49bcb6d8c19868d893bc', 'request_id': 'req-d952939e-6307-458b-9ea2-f8c234c226b8'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:22.453959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-d952939e-6307-458b-9ea2-f8c234c226b8 admin admin] The token cache is being invalidate because project 6b070b6b61ec49bcb6d8c19868d893bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:59:22.454247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-d952939e-6307-458b-9ea2-f8c234c226b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:22.454897 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-d952939e-6307-458b-9ea2-f8c234c226b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:22.456409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1329/2650] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:59:22 2022] DELETE /identity/v3/projects/6b070b6b61ec49bcb6d8c19868d893bc => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:22.461875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758feaaa-2b1f-43e8-9928-86d4787c0f82 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:22.462338 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758feaaa-2b1f-43e8-9928-86d4787c0f82 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:22.462426 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758feaaa-2b1f-43e8-9928-86d4787c0f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:22.481202 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-758feaaa-2b1f-43e8-9928-86d4787c0f82 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:22.482405 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-758feaaa-2b1f-43e8-9928-86d4787c0f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:22.541819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1322/2651] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:22.549688 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d6c0b-766c-49c7-94ba-3f9f62089a45 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:22.549978 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d6c0b-766c-49c7-94ba-3f9f62089a45 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:22.550286 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d6c0b-766c-49c7-94ba-3f9f62089a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:22.569795 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-a45d6c0b-766c-49c7-94ba-3f9f62089a45 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:22.570940 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-a45d6c0b-766c-49c7-94ba-3f9f62089a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:22.578978 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1330/2652] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:59:22.583958 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758feaaa-2b1f-43e8-9928-86d4787c0f82 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:22.593998 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758feaaa-2b1f-43e8-9928-86d4787c0f82 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:22.598652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a68a1-35f7-4aba-a971-fe09c6a78ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:22.599304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a68a1-35f7-4aba-a971-fe09c6a78ecd admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:22.599591 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a68a1-35f7-4aba-a971-fe09c6a78ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:22.599867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a68a1-35f7-4aba-a971-fe09c6a78ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:22.600606 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a68a1-35f7-4aba-a971-fe09c6a78ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:59:22.600931 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a68a1-35f7-4aba-a971-fe09c6a78ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:22.602531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a68a1-35f7-4aba-a971-fe09c6a78ecd admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:22.613944 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1323/2653] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:59:22.618048 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d6c0b-766c-49c7-94ba-3f9f62089a45 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:22.627405 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d6c0b-766c-49c7-94ba-3f9f62089a45 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:22.632538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a85ec-f390-44d3-9805-85e5604eb0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:22.633210 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a85ec-f390-44d3-9805-85e5604eb0ae admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:22.633493 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a85ec-f390-44d3-9805-85e5604eb0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:22.633770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a85ec-f390-44d3-9805-85e5604eb0ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:22.634462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a85ec-f390-44d3-9805-85e5604eb0ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:22.636336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a85ec-f390-44d3-9805-85e5604eb0ae admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:22.712921 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1331/2654] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:59:22 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:22.717028 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a68a1-35f7-4aba-a971-fe09c6a78ecd admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:22.727348 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a68a1-35f7-4aba-a971-fe09c6a78ecd admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:22.745707 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:22.783781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089259d4-3723-46fd-9907-07cff532aff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:22.784441 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089259d4-3723-46fd-9907-07cff532aff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:22.784763 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089259d4-3723-46fd-9907-07cff532aff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:22.785040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089259d4-3723-46fd-9907-07cff532aff0 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:22.785715 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089259d4-3723-46fd-9907-07cff532aff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:22.787672 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089259d4-3723-46fd-9907-07cff532aff0 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:22.891553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1324/2655] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:59:22 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:22.895529 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a85ec-f390-44d3-9805-85e5604eb0ae admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:22.905664 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a85ec-f390-44d3-9805-85e5604eb0ae admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:22.910265 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ad720-bc9b-4db7-9712-c6f03fd42773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:22.910920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ad720-bc9b-4db7-9712-c6f03fd42773 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:22.911205 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ad720-bc9b-4db7-9712-c6f03fd42773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:22.911482 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ad720-bc9b-4db7-9712-c6f03fd42773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:22.912211 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ad720-bc9b-4db7-9712-c6f03fd42773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:22.913820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ad720-bc9b-4db7-9712-c6f03fd42773 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:22.924891 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1332/2656] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:22.929193 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089259d4-3723-46fd-9907-07cff532aff0 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:22.939368 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089259d4-3723-46fd-9907-07cff532aff0 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:22.944544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397533fb-799f-4101-bc00-d40f9cdcb6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:22.945223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397533fb-799f-4101-bc00-d40f9cdcb6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:22.945500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397533fb-799f-4101-bc00-d40f9cdcb6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:22.945772 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397533fb-799f-4101-bc00-d40f9cdcb6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:22.946511 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397533fb-799f-4101-bc00-d40f9cdcb6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:22.948083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397533fb-799f-4101-bc00-d40f9cdcb6c2 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:22.957647 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1325/2657] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:59:22.961506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ad720-bc9b-4db7-9712-c6f03fd42773 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:22.971212 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ad720-bc9b-4db7-9712-c6f03fd42773 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:22.975764 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760a710-2bd0-4806-ac47-a337cb8c9f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:22.981157 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760a710-2bd0-4806-ac47-a337cb8c9f71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:22.981157 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760a710-2bd0-4806-ac47-a337cb8c9f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:22.981157 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760a710-2bd0-4806-ac47-a337cb8c9f71 admin admin] PATH_INFO: `/v3/projects/69051c67f0d744a9b99cb7da2c04d749/users/b000549ac6164bc6976b32a17c6b383d/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:22.991772 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760a710-2bd0-4806-ac47-a337cb8c9f71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69051c67f0d744a9b99cb7da2c04d749, user_id=b000549ac6164bc6976b32a17c6b383d, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:22.994699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760a710-2bd0-4806-ac47-a337cb8c9f71 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:23.070889 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1333/2658] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:22 2022] PUT /identity/v3/projects/69051c67f0d744a9b99cb7da2c04d749/users/b000549ac6164bc6976b32a17c6b383d/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:59:23.081910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e41313-80d9-4596-bb6a-228cf9471a9b None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:23.082201 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e41313-80d9-4596-bb6a-228cf9471a9b None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:23.082486 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e41313-80d9-4596-bb6a-228cf9471a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:23.108242 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-c5e41313-80d9-4596-bb6a-228cf9471a9b None None] MFA Rules not processed for user `b000549ac6164bc6976b32a17c6b383d`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:23.109501 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-c5e41313-80d9-4596-bb6a-228cf9471a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:23.172674 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1326/2659] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:23.177588 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760a710-2bd0-4806-ac47-a337cb8c9f71 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:23.237195 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760a710-2bd0-4806-ac47-a337cb8c9f71 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:23.242301 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ca307-2c40-4f3e-9c89-79e3b2d6f087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:23.242953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ca307-2c40-4f3e-9c89-79e3b2d6f087 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:23.243233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ca307-2c40-4f3e-9c89-79e3b2d6f087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:23.243763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ca307-2c40-4f3e-9c89-79e3b2d6f087 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:23.244448 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ca307-2c40-4f3e-9c89-79e3b2d6f087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:23.246356 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ca307-2c40-4f3e-9c89-79e3b2d6f087 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:23.334233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1334/2660] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:59:23 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:23.338354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e41313-80d9-4596-bb6a-228cf9471a9b None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:23.349478 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e41313-80d9-4596-bb6a-228cf9471a9b None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:23.405861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b17ede-225f-4971-9308-8ae5d6cab976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:23.406540 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b17ede-225f-4971-9308-8ae5d6cab976 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:23.406826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b17ede-225f-4971-9308-8ae5d6cab976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:23.407102 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b17ede-225f-4971-9308-8ae5d6cab976 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:23.407807 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b17ede-225f-4971-9308-8ae5d6cab976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:23.409761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b17ede-225f-4971-9308-8ae5d6cab976 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:23.488869 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1327/2661] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:59:23 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:23.493876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ca307-2c40-4f3e-9c89-79e3b2d6f087 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:23.504536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ca307-2c40-4f3e-9c89-79e3b2d6f087 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:23.509404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ff6ea-9d25-4848-90f9-8ad32e39d4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:23.510071 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ff6ea-9d25-4848-90f9-8ad32e39d4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:23.510375 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ff6ea-9d25-4848-90f9-8ad32e39d4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:23.510680 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ff6ea-9d25-4848-90f9-8ad32e39d4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:23.511393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ff6ea-9d25-4848-90f9-8ad32e39d4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:23.513098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ff6ea-9d25-4848-90f9-8ad32e39d4a3 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:23.524010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1335/2662] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:23.528077 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b17ede-225f-4971-9308-8ae5d6cab976 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:23.538589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b17ede-225f-4971-9308-8ae5d6cab976 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:23.543208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886faf56-9071-40ca-b271-b8c8febf94b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:23.543865 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886faf56-9071-40ca-b271-b8c8febf94b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:23.544157 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886faf56-9071-40ca-b271-b8c8febf94b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:23.544437 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886faf56-9071-40ca-b271-b8c8febf94b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:23.545201 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886faf56-9071-40ca-b271-b8c8febf94b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:23.546805 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886faf56-9071-40ca-b271-b8c8febf94b1 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:23.557649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1328/2663] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:23.562342 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ff6ea-9d25-4848-90f9-8ad32e39d4a3 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:23.572550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ff6ea-9d25-4848-90f9-8ad32e39d4a3 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:23.577482 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25830af7-085f-4d3b-9c09-62a29168faed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:23.578956 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25830af7-085f-4d3b-9c09-62a29168faed admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:23.579370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25830af7-085f-4d3b-9c09-62a29168faed admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:23.579542 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25830af7-085f-4d3b-9c09-62a29168faed admin admin] PATH_INFO: `/v3/projects/d2418e4f3b364e7c91dfa071ee17a522/users/19f8c1a939aa49ceac4792899779382a/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:23.596374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25830af7-085f-4d3b-9c09-62a29168faed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2418e4f3b364e7c91dfa071ee17a522, user_id=19f8c1a939aa49ceac4792899779382a, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:23.599893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25830af7-085f-4d3b-9c09-62a29168faed admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:23.663946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1336/2664] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:23 2022] PUT /identity/v3/projects/d2418e4f3b364e7c91dfa071ee17a522/users/19f8c1a939aa49ceac4792899779382a/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:23.674495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694610a8-3eb0-4b04-b2db-c8aba1effe3d None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:23.674786 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694610a8-3eb0-4b04-b2db-c8aba1effe3d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:23.675067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694610a8-3eb0-4b04-b2db-c8aba1effe3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:23.693306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:23.701992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-694610a8-3eb0-4b04-b2db-c8aba1effe3d None None] MFA Rules not processed for user `19f8c1a939aa49ceac4792899779382a`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:23.703142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-694610a8-3eb0-4b04-b2db-c8aba1effe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:23.766018 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1329/2665] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:23.770610 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25830af7-085f-4d3b-9c09-62a29168faed admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:23.804808 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:23.831805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25830af7-085f-4d3b-9c09-62a29168faed admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:23.837782 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97029207-9772-4fc4-9447-b97cb69d4afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:23.841770 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97029207-9772-4fc4-9447-b97cb69d4afc admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:23.842506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97029207-9772-4fc4-9447-b97cb69d4afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:23.843465 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97029207-9772-4fc4-9447-b97cb69d4afc admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:23.844434 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97029207-9772-4fc4-9447-b97cb69d4afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:23.846679 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97029207-9772-4fc4-9447-b97cb69d4afc admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:23.935387 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1337/2666] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:59:23 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:23.939458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694610a8-3eb0-4b04-b2db-c8aba1effe3d None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:23.950445 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694610a8-3eb0-4b04-b2db-c8aba1effe3d None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:24.006382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b5d2a-033c-4101-9759-71f3ee6ac753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:24.007051 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b5d2a-033c-4101-9759-71f3ee6ac753 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:24.007336 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b5d2a-033c-4101-9759-71f3ee6ac753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:24.007642 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b5d2a-033c-4101-9759-71f3ee6ac753 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:24.008354 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b5d2a-033c-4101-9759-71f3ee6ac753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:24.010306 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b5d2a-033c-4101-9759-71f3ee6ac753 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:24.088592 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1330/2667] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:59:23 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:24.092467 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97029207-9772-4fc4-9447-b97cb69d4afc admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:24.102767 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97029207-9772-4fc4-9447-b97cb69d4afc admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:24.107457 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fab79b-600b-4cec-a5a3-87dc1c5ac489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:24.108117 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fab79b-600b-4cec-a5a3-87dc1c5ac489 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:24.108404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fab79b-600b-4cec-a5a3-87dc1c5ac489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:24.108722 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fab79b-600b-4cec-a5a3-87dc1c5ac489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:24.109441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fab79b-600b-4cec-a5a3-87dc1c5ac489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:24.111094 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fab79b-600b-4cec-a5a3-87dc1c5ac489 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:24.122302 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1338/2668] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:24.126473 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b5d2a-033c-4101-9759-71f3ee6ac753 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:24.136984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b5d2a-033c-4101-9759-71f3ee6ac753 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:24.141697 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fc27b-3bdc-4b83-9637-232fa28394d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:24.142574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fc27b-3bdc-4b83-9637-232fa28394d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:24.142856 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fc27b-3bdc-4b83-9637-232fa28394d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:24.143131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fc27b-3bdc-4b83-9637-232fa28394d7 admin admin] PATH_INFO: `/v3/projects/dfcf467af59e4d109e385e9f82b791fa/users/2dcb76f131e44caeb6ace944fe471ee9/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:24.161334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fc27b-3bdc-4b83-9637-232fa28394d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfcf467af59e4d109e385e9f82b791fa, user_id=2dcb76f131e44caeb6ace944fe471ee9, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:24.164015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fc27b-3bdc-4b83-9637-232fa28394d7 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:24.265896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1331/2669] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:24 2022] PUT /identity/v3/projects/dfcf467af59e4d109e385e9f82b791fa/users/2dcb76f131e44caeb6ace944fe471ee9/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:24.269883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fab79b-600b-4cec-a5a3-87dc1c5ac489 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:24.280328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fab79b-600b-4cec-a5a3-87dc1c5ac489 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:24.335057 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81ca1c-e817-409d-944d-52fbec015e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:24.335712 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81ca1c-e817-409d-944d-52fbec015e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:24.335993 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81ca1c-e817-409d-944d-52fbec015e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:24.336267 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81ca1c-e817-409d-944d-52fbec015e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:24.337029 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81ca1c-e817-409d-944d-52fbec015e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:24.338651 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81ca1c-e817-409d-944d-52fbec015e77 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:24.348344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1339/2670] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:24.352634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fc27b-3bdc-4b83-9637-232fa28394d7 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:24.362888 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fc27b-3bdc-4b83-9637-232fa28394d7 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:24.368069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6cfa3-3e1c-409a-bdc8-35946a07e335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:24.369240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6cfa3-3e1c-409a-bdc8-35946a07e335 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:24.369514 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6cfa3-3e1c-409a-bdc8-35946a07e335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:24.369786 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6cfa3-3e1c-409a-bdc8-35946a07e335 admin admin] PATH_INFO: `/v3/projects/dfcf467af59e4d109e385e9f82b791fa/users/2dcb76f131e44caeb6ace944fe471ee9/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:24.371714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6cfa3-3e1c-409a-bdc8-35946a07e335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfcf467af59e4d109e385e9f82b791fa, user_id=2dcb76f131e44caeb6ace944fe471ee9, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:24.374356 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6cfa3-3e1c-409a-bdc8-35946a07e335 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:24.384676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1332/2671] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:24 2022] PUT /identity/v3/projects/dfcf467af59e4d109e385e9f82b791fa/users/2dcb76f131e44caeb6ace944fe471ee9/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:24.396242 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a727728-7964-4f41-98a7-739b1cb645f7 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:24.396527 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a727728-7964-4f41-98a7-739b1cb645f7 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:24.396833 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a727728-7964-4f41-98a7-739b1cb645f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:24.423023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-3a727728-7964-4f41-98a7-739b1cb645f7 None None] MFA Rules not processed for user `2dcb76f131e44caeb6ace944fe471ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:24.424213 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3a727728-7964-4f41-98a7-739b1cb645f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:24.491394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1340/2672] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:59:24.503086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6cfa3-3e1c-409a-bdc8-35946a07e335 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:24.504859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-c1b6cfa3-3e1c-409a-bdc8-35946a07e335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:24.561649 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6cfa3-3e1c-409a-bdc8-35946a07e335 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:24.565351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555471c-3b13-45c7-9142-2467b6d39590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:24.566000 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555471c-3b13-45c7-9142-2467b6d39590 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:24.566286 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555471c-3b13-45c7-9142-2467b6d39590 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:24.566566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555471c-3b13-45c7-9142-2467b6d39590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:24.570875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:24.622911 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555471c-3b13-45c7-9142-2467b6d39590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:24.624428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555471c-3b13-45c7-9142-2467b6d39590 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:24.633421 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1333/2673] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:26.414121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a727728-7964-4f41-98a7-739b1cb645f7 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:26.415491 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3a727728-7964-4f41-98a7-739b1cb645f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:26.446253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:26.480928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a727728-7964-4f41-98a7-739b1cb645f7 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:26.485543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18e2e0-4730-41cd-8973-32e76bbcb66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:26.486420 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18e2e0-4730-41cd-8973-32e76bbcb66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:26.486711 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18e2e0-4730-41cd-8973-32e76bbcb66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:26.486996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18e2e0-4730-41cd-8973-32e76bbcb66d admin admin] PATH_INFO: `/v3/users/faf34f90f08b4461b6d9d583af1b5f90` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:26.488179 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18e2e0-4730-41cd-8973-32e76bbcb66d admin admin] RBAC: Authorizing `identity:delete_user(user_id=faf34f90f08b4461b6d9d583af1b5f90)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:26.490114 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18e2e0-4730-41cd-8973-32e76bbcb66d admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:26.679096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dd18e2e0-4730-41cd-8973-32e76bbcb66d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faf34f90f08b4461b6d9d583af1b5f90'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:26.750751 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dd18e2e0-4730-41cd-8973-32e76bbcb66d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faf34f90f08b4461b6d9d583af1b5f90'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:26.751402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dd18e2e0-4730-41cd-8973-32e76bbcb66d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faf34f90f08b4461b6d9d583af1b5f90'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:26.768421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dd18e2e0-4730-41cd-8973-32e76bbcb66d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faf34f90f08b4461b6d9d583af1b5f90'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:26.769158 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dd18e2e0-4730-41cd-8973-32e76bbcb66d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faf34f90f08b4461b6d9d583af1b5f90'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:26.782216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1341/2674] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:59:26 2022] DELETE /identity/v3/users/faf34f90f08b4461b6d9d583af1b5f90 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:26.787836 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573a85e-84d5-478c-a7a1-7e0f62c35259 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:26.788303 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573a85e-84d5-478c-a7a1-7e0f62c35259 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:26.788524 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573a85e-84d5-478c-a7a1-7e0f62c35259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:26.793614 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18e2e0-4730-41cd-8973-32e76bbcb66d admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:26.795354 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-dd18e2e0-4730-41cd-8973-32e76bbcb66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:26.806727 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-f573a85e-84d5-478c-a7a1-7e0f62c35259 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:26.807910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f573a85e-84d5-478c-a7a1-7e0f62c35259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:26.853570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18e2e0-4730-41cd-8973-32e76bbcb66d admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:26.857634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe5092-0608-4f28-ac79-97f18d1d52c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:26.858283 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe5092-0608-4f28-ac79-97f18d1d52c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:26.858566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe5092-0608-4f28-ac79-97f18d1d52c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:26.858850 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe5092-0608-4f28-ac79-97f18d1d52c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:26.860666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-7cfe5092-0608-4f28-ac79-97f18d1d52c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:26.869318 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1334/2675] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:26.879471 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573a85e-84d5-478c-a7a1-7e0f62c35259 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:26.881462 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f573a85e-84d5-478c-a7a1-7e0f62c35259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:26.919877 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe5092-0608-4f28-ac79-97f18d1d52c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:26.921336 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe5092-0608-4f28-ac79-97f18d1d52c1 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:26.925783 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:26.930946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1342/2676] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:59:26.939259 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573a85e-84d5-478c-a7a1-7e0f62c35259 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:26.942503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2d4a1-5e30-451b-8ae5-8e98d19a97f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:26.943775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2d4a1-5e30-451b-8ae5-8e98d19a97f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:26.944055 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2d4a1-5e30-451b-8ae5-8e98d19a97f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:26.944325 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2d4a1-5e30-451b-8ae5-8e98d19a97f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:26.953669 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2d4a1-5e30-451b-8ae5-8e98d19a97f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:26.955112 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2d4a1-5e30-451b-8ae5-8e98d19a97f0 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:26.964910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1335/2677] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:59:27.404608 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe5092-0608-4f28-ac79-97f18d1d52c1 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:27.412109 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-7cfe5092-0608-4f28-ac79-97f18d1d52c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:27.423227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe5092-0608-4f28-ac79-97f18d1d52c1 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:27.429760 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555ce9b-a212-4eab-a142-b642cd030a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:27.430742 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555ce9b-a212-4eab-a142-b642cd030a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:27.430941 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555ce9b-a212-4eab-a142-b642cd030a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:27.431224 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555ce9b-a212-4eab-a142-b642cd030a2e admin admin] PATH_INFO: `/v3/projects/12ab080644dd44a79bc1b82e60942b6a` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:27.432493 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555ce9b-a212-4eab-a142-b642cd030a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ab080644dd44a79bc1b82e60942b6a)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:27.434457 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555ce9b-a212-4eab-a142-b642cd030a2e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:27.546321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-7555ce9b-a212-4eab-a142-b642cd030a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ab080644dd44a79bc1b82e60942b6a', 'request_id': 'req-7555ce9b-a212-4eab-a142-b642cd030a2e'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:27.551945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-7555ce9b-a212-4eab-a142-b642cd030a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ab080644dd44a79bc1b82e60942b6a', 'request_id': 'req-7555ce9b-a212-4eab-a142-b642cd030a2e'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:27.648408 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-7555ce9b-a212-4eab-a142-b642cd030a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ab080644dd44a79bc1b82e60942b6a', 'request_id': 'req-7555ce9b-a212-4eab-a142-b642cd030a2e'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:27.660138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-7555ce9b-a212-4eab-a142-b642cd030a2e admin admin] The token cache is being invalidate because project 12ab080644dd44a79bc1b82e60942b6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:59:27.660318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-7555ce9b-a212-4eab-a142-b642cd030a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:27.661041 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-7555ce9b-a212-4eab-a142-b642cd030a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:27.663208 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1343/2678] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:59:27 2022] DELETE /identity/v3/projects/12ab080644dd44a79bc1b82e60942b6a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:27.667183 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2d4a1-5e30-451b-8ae5-8e98d19a97f0 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:27.676952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2d4a1-5e30-451b-8ae5-8e98d19a97f0 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:27.722522 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:27.735319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce94603-66e0-444a-983e-ff39e267ac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:27.737113 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce94603-66e0-444a-983e-ff39e267ac22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:27.737113 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce94603-66e0-444a-983e-ff39e267ac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:27.737113 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce94603-66e0-444a-983e-ff39e267ac22 admin admin] PATH_INFO: `/v3/users/89b4249948a34d848afab49696700d81` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:27.737985 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce94603-66e0-444a-983e-ff39e267ac22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b4249948a34d848afab49696700d81)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:27.739932 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce94603-66e0-444a-983e-ff39e267ac22 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:27.907707 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-4ce94603-66e0-444a-983e-ff39e267ac22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b4249948a34d848afab49696700d81'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:27.908375 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-4ce94603-66e0-444a-983e-ff39e267ac22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b4249948a34d848afab49696700d81'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:27.908981 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-4ce94603-66e0-444a-983e-ff39e267ac22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b4249948a34d848afab49696700d81'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:27.921074 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-4ce94603-66e0-444a-983e-ff39e267ac22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b4249948a34d848afab49696700d81'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:27.927890 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-4ce94603-66e0-444a-983e-ff39e267ac22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b4249948a34d848afab49696700d81'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:28.013378 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1336/2679] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:59:27 2022] DELETE /identity/v3/users/89b4249948a34d848afab49696700d81 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:28.418844 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555ce9b-a212-4eab-a142-b642cd030a2e admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:28.421197 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-7555ce9b-a212-4eab-a142-b642cd030a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:28.434351 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555ce9b-a212-4eab-a142-b642cd030a2e admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:28.500861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ff7f7-3153-4966-b19c-d5b1135aef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:28.501789 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ff7f7-3153-4966-b19c-d5b1135aef07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:28.502072 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ff7f7-3153-4966-b19c-d5b1135aef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:28.502345 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ff7f7-3153-4966-b19c-d5b1135aef07 admin admin] PATH_INFO: `/v3/projects/3f4218618f2541a2af43eeaa815d90d4` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:28.503532 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ff7f7-3153-4966-b19c-d5b1135aef07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4218618f2541a2af43eeaa815d90d4)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:28.505473 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ff7f7-3153-4966-b19c-d5b1135aef07 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:28.530283 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce94603-66e0-444a-983e-ff39e267ac22 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:28.531853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-4ce94603-66e0-444a-983e-ff39e267ac22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:28.589113 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce94603-66e0-444a-983e-ff39e267ac22 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:28.592676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f9385-33ea-48ef-8f3f-98bf8a105fb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:28.593326 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f9385-33ea-48ef-8f3f-98bf8a105fb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:28.593611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f9385-33ea-48ef-8f3f-98bf8a105fb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:28.593885 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f9385-33ea-48ef-8f3f-98bf8a105fb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:28.595626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2b7f9385-33ea-48ef-8f3f-98bf8a105fb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:28.630631 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0a9ff7f7-3153-4966-b19c-d5b1135aef07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4218618f2541a2af43eeaa815d90d4', 'request_id': 'req-0a9ff7f7-3153-4966-b19c-d5b1135aef07'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:28.636122 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0a9ff7f7-3153-4966-b19c-d5b1135aef07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4218618f2541a2af43eeaa815d90d4', 'request_id': 'req-0a9ff7f7-3153-4966-b19c-d5b1135aef07'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:28.658862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f9385-33ea-48ef-8f3f-98bf8a105fb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:28.660299 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f9385-33ea-48ef-8f3f-98bf8a105fb4 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:28.670271 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1337/2680] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:28.702931 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0a9ff7f7-3153-4966-b19c-d5b1135aef07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4218618f2541a2af43eeaa815d90d4', 'request_id': 'req-0a9ff7f7-3153-4966-b19c-d5b1135aef07'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:28.714451 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0a9ff7f7-3153-4966-b19c-d5b1135aef07 admin admin] The token cache is being invalidate because project 3f4218618f2541a2af43eeaa815d90d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:59:28.714744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0a9ff7f7-3153-4966-b19c-d5b1135aef07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:28.715374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0a9ff7f7-3153-4966-b19c-d5b1135aef07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:28.716942 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1344/2681] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:59:28 2022] DELETE /identity/v3/projects/3f4218618f2541a2af43eeaa815d90d4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:28.721987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74c01c-e1a7-4dbf-b2dc-4df9f6779604 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:28.722278 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74c01c-e1a7-4dbf-b2dc-4df9f6779604 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:28.722558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74c01c-e1a7-4dbf-b2dc-4df9f6779604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:28.740821 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-6d74c01c-e1a7-4dbf-b2dc-4df9f6779604 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:28.742167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-6d74c01c-e1a7-4dbf-b2dc-4df9f6779604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:28.754151 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:28.800148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1338/2682] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:28.808484 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9ca98-28e0-4391-95ce-7ee7ef22ae01 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:28.808805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9ca98-28e0-4391-95ce-7ee7ef22ae01 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:28.809114 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9ca98-28e0-4391-95ce-7ee7ef22ae01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:28.827891 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-bca9ca98-28e0-4391-95ce-7ee7ef22ae01 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:28.829135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-bca9ca98-28e0-4391-95ce-7ee7ef22ae01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:28.837590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1345/2683] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:28.841709 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74c01c-e1a7-4dbf-b2dc-4df9f6779604 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:28.851414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74c01c-e1a7-4dbf-b2dc-4df9f6779604 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:28.856015 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29b22e-b45a-4c7d-a308-a57361496bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:28.856729 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29b22e-b45a-4c7d-a308-a57361496bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:28.857016 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29b22e-b45a-4c7d-a308-a57361496bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:28.857296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29b22e-b45a-4c7d-a308-a57361496bc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:28.858024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29b22e-b45a-4c7d-a308-a57361496bc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:59:28.858331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29b22e-b45a-4c7d-a308-a57361496bc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:28.859935 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29b22e-b45a-4c7d-a308-a57361496bc4 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:28.873398 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1339/2684] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:59:28.879625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9ca98-28e0-4391-95ce-7ee7ef22ae01 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:28.897849 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9ca98-28e0-4391-95ce-7ee7ef22ae01 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:28.902589 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfeff5-b328-43ed-856a-9b6374703fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:28.903258 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfeff5-b328-43ed-856a-9b6374703fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:28.903541 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfeff5-b328-43ed-856a-9b6374703fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:28.903840 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfeff5-b328-43ed-856a-9b6374703fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:28.904537 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfeff5-b328-43ed-856a-9b6374703fc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:28.906488 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfeff5-b328-43ed-856a-9b6374703fc2 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:28.910335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:29.013655 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1346/2685] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:59:28 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:29.017957 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29b22e-b45a-4c7d-a308-a57361496bc4 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:29.028333 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29b22e-b45a-4c7d-a308-a57361496bc4 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:29.082874 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0db606-52a7-4b4f-94ec-dea1a20c9c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:29.083568 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0db606-52a7-4b4f-94ec-dea1a20c9c77 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:29.083851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0db606-52a7-4b4f-94ec-dea1a20c9c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:29.084128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0db606-52a7-4b4f-94ec-dea1a20c9c77 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:29.084857 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0db606-52a7-4b4f-94ec-dea1a20c9c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:29.086768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0db606-52a7-4b4f-94ec-dea1a20c9c77 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:29.185156 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1340/2686] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:59:29 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:29.189444 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfeff5-b328-43ed-856a-9b6374703fc2 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:29.200288 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfeff5-b328-43ed-856a-9b6374703fc2 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:29.204865 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36005d5f-0f30-4106-8248-bc5193592a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:29.205518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36005d5f-0f30-4106-8248-bc5193592a9b admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:29.205818 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36005d5f-0f30-4106-8248-bc5193592a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:29.206071 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36005d5f-0f30-4106-8248-bc5193592a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:29.206782 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36005d5f-0f30-4106-8248-bc5193592a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:29.208481 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36005d5f-0f30-4106-8248-bc5193592a9b admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:29.218255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1347/2687] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:29.222416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0db606-52a7-4b4f-94ec-dea1a20c9c77 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:29.233140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0db606-52a7-4b4f-94ec-dea1a20c9c77 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:29.237933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36879c6-5747-49b9-8ae5-950fa4dd61d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:29.238589 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36879c6-5747-49b9-8ae5-950fa4dd61d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:29.238875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36879c6-5747-49b9-8ae5-950fa4dd61d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:29.239155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36879c6-5747-49b9-8ae5-950fa4dd61d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:29.239974 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36879c6-5747-49b9-8ae5-950fa4dd61d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:29.242167 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36879c6-5747-49b9-8ae5-950fa4dd61d0 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:29.252224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1341/2688] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:29.256259 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36005d5f-0f30-4106-8248-bc5193592a9b admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:29.266086 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36005d5f-0f30-4106-8248-bc5193592a9b admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:29.270666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bb660-a06f-49c6-8a97-d48265b97f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:29.271562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bb660-a06f-49c6-8a97-d48265b97f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:29.271849 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bb660-a06f-49c6-8a97-d48265b97f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:29.272132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bb660-a06f-49c6-8a97-d48265b97f08 admin admin] PATH_INFO: `/v3/projects/04a76e9b7a91441ebad3c3a1814f5233/users/9759d5ac855e4406ab7ded9bd06490e0/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:29.287306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165bb660-a06f-49c6-8a97-d48265b97f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a76e9b7a91441ebad3c3a1814f5233, user_id=9759d5ac855e4406ab7ded9bd06490e0, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:29.289974 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165bb660-a06f-49c6-8a97-d48265b97f08 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:29.391016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1348/2689] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:29 2022] PUT /identity/v3/projects/04a76e9b7a91441ebad3c3a1814f5233/users/9759d5ac855e4406ab7ded9bd06490e0/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:59:29.402347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9a54e-e979-4405-bfec-73c86bba2d8a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:29.402634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9a54e-e979-4405-bfec-73c86bba2d8a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:29.402937 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9a54e-e979-4405-bfec-73c86bba2d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:29.429806 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-d9c9a54e-e979-4405-bfec-73c86bba2d8a None None] MFA Rules not processed for user `9759d5ac855e4406ab7ded9bd06490e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:29.431044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d9c9a54e-e979-4405-bfec-73c86bba2d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:29.495155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1342/2690] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:29.504651 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bb660-a06f-49c6-8a97-d48265b97f08 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:29.565605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bb660-a06f-49c6-8a97-d48265b97f08 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:29.570198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e172a4-f280-4ec8-96b4-cc60833a434e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:29.570964 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e172a4-f280-4ec8-96b4-cc60833a434e admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:29.571248 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e172a4-f280-4ec8-96b4-cc60833a434e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:29.571540 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e172a4-f280-4ec8-96b4-cc60833a434e admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:29.572212 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e172a4-f280-4ec8-96b4-cc60833a434e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:29.574203 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e172a4-f280-4ec8-96b4-cc60833a434e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:29.658761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1349/2691] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:59:29 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:29.663202 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9a54e-e979-4405-bfec-73c86bba2d8a None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:29.675394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9a54e-e979-4405-bfec-73c86bba2d8a None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:29.684220 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:29.730214 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7bb7f-7f13-4a89-82b3-9be9b0ec8f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:29.730911 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7bb7f-7f13-4a89-82b3-9be9b0ec8f2a admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:29.731195 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7bb7f-7f13-4a89-82b3-9be9b0ec8f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:29.731477 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7bb7f-7f13-4a89-82b3-9be9b0ec8f2a admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:29.732160 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7bb7f-7f13-4a89-82b3-9be9b0ec8f2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:29.734130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7bb7f-7f13-4a89-82b3-9be9b0ec8f2a admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:29.799993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1343/2692] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:59:29 2022] POST /identity/v3/users => generated 299 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:29.804000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e172a4-f280-4ec8-96b4-cc60833a434e admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:29.814449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e172a4-f280-4ec8-96b4-cc60833a434e admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:29.819058 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760304e-905a-48c8-8c25-b1202ab16cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:29.819713 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760304e-905a-48c8-8c25-b1202ab16cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:29.820000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760304e-905a-48c8-8c25-b1202ab16cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:29.820271 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760304e-905a-48c8-8c25-b1202ab16cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:29.821027 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760304e-905a-48c8-8c25-b1202ab16cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:29.822637 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760304e-905a-48c8-8c25-b1202ab16cb1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:29.833016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1350/2693] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:29.837552 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7bb7f-7f13-4a89-82b3-9be9b0ec8f2a admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:29.847457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7bb7f-7f13-4a89-82b3-9be9b0ec8f2a admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:29.852755 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4e318-7cdf-41e7-9aec-ca42b8a70871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:29.853624 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4e318-7cdf-41e7-9aec-ca42b8a70871 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:29.853908 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4e318-7cdf-41e7-9aec-ca42b8a70871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:29.854187 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4e318-7cdf-41e7-9aec-ca42b8a70871 admin admin] PATH_INFO: `/v3/projects/2b21ac6963a0425489463aabed4115fc/users/d1f5c191440b498f871e26306efb3a6a/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:29.869959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4e318-7cdf-41e7-9aec-ca42b8a70871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b21ac6963a0425489463aabed4115fc, user_id=d1f5c191440b498f871e26306efb3a6a, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:29.872626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4e318-7cdf-41e7-9aec-ca42b8a70871 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:29.943320 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1344/2694] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:29 2022] PUT /identity/v3/projects/2b21ac6963a0425489463aabed4115fc/users/d1f5c191440b498f871e26306efb3a6a/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:29.947323 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760304e-905a-48c8-8c25-b1202ab16cb1 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:29.962049 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760304e-905a-48c8-8c25-b1202ab16cb1 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:30.020252 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e1875-0ddc-45dc-97b0-dd9af3285f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:30.020966 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e1875-0ddc-45dc-97b0-dd9af3285f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:30.021249 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e1875-0ddc-45dc-97b0-dd9af3285f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:30.023826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e1875-0ddc-45dc-97b0-dd9af3285f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:30.023826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e1875-0ddc-45dc-97b0-dd9af3285f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:30.023826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e1875-0ddc-45dc-97b0-dd9af3285f08 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:30.033850 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1351/2695] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:30.038632 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4e318-7cdf-41e7-9aec-ca42b8a70871 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:30.049583 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4e318-7cdf-41e7-9aec-ca42b8a70871 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:30.054511 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b1af7-3cbf-4901-a7e9-d677a2017666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:30.055390 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b1af7-3cbf-4901-a7e9-d677a2017666 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:30.055672 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b1af7-3cbf-4901-a7e9-d677a2017666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:30.055947 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b1af7-3cbf-4901-a7e9-d677a2017666 admin admin] PATH_INFO: `/v3/projects/2b21ac6963a0425489463aabed4115fc/users/d1f5c191440b498f871e26306efb3a6a/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:30.058065 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b1af7-3cbf-4901-a7e9-d677a2017666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b21ac6963a0425489463aabed4115fc, user_id=d1f5c191440b498f871e26306efb3a6a, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:30.060773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b1af7-3cbf-4901-a7e9-d677a2017666 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:30.074360 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1345/2696] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:30 2022] PUT /identity/v3/projects/2b21ac6963a0425489463aabed4115fc/users/d1f5c191440b498f871e26306efb3a6a/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:30.133456 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd37bcd-6c0e-4e2c-9d73-568f5ae7d1e8 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:30.133744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd37bcd-6c0e-4e2c-9d73-568f5ae7d1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:30.134030 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd37bcd-6c0e-4e2c-9d73-568f5ae7d1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:30.161331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-4fd37bcd-6c0e-4e2c-9d73-568f5ae7d1e8 None None] MFA Rules not processed for user `d1f5c191440b498f871e26306efb3a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:30.162543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4fd37bcd-6c0e-4e2c-9d73-568f5ae7d1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:30.174701 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:30.238758 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1352/2697] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:30.250803 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b1af7-3cbf-4901-a7e9-d677a2017666 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:30.252663 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ec8b1af7-3cbf-4901-a7e9-d677a2017666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:30.311828 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b1af7-3cbf-4901-a7e9-d677a2017666 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:30.315634 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7c2df-5bea-4c93-b67c-d66c3ccb0200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:30.316425 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7c2df-5bea-4c93-b67c-d66c3ccb0200 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:30.316746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7c2df-5bea-4c93-b67c-d66c3ccb0200 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:30.317025 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7c2df-5bea-4c93-b67c-d66c3ccb0200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:30.327612 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7c2df-5bea-4c93-b67c-d66c3ccb0200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:30.329017 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7c2df-5bea-4c93-b67c-d66c3ccb0200 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:30.339577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1346/2698] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:30.407652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd37bcd-6c0e-4e2c-9d73-568f5ae7d1e8 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:30.471751 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd37bcd-6c0e-4e2c-9d73-568f5ae7d1e8 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:30.476403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe245c9-9007-4b64-bdd0-086698fd72f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:30.477367 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe245c9-9007-4b64-bdd0-086698fd72f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:30.477661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe245c9-9007-4b64-bdd0-086698fd72f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:30.477942 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe245c9-9007-4b64-bdd0-086698fd72f0 admin admin] PATH_INFO: `/v3/users/9759d5ac855e4406ab7ded9bd06490e0` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:30.479174 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe245c9-9007-4b64-bdd0-086698fd72f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9759d5ac855e4406ab7ded9bd06490e0)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:30.493480 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe245c9-9007-4b64-bdd0-086698fd72f0 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:30.655915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dbe245c9-9007-4b64-bdd0-086698fd72f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9759d5ac855e4406ab7ded9bd06490e0'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:30.711401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dbe245c9-9007-4b64-bdd0-086698fd72f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9759d5ac855e4406ab7ded9bd06490e0'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:30.712175 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dbe245c9-9007-4b64-bdd0-086698fd72f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9759d5ac855e4406ab7ded9bd06490e0'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:30.725930 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dbe245c9-9007-4b64-bdd0-086698fd72f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9759d5ac855e4406ab7ded9bd06490e0'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:30.726581 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-dbe245c9-9007-4b64-bdd0-086698fd72f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9759d5ac855e4406ab7ded9bd06490e0'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:30.738933 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1353/2699] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:59:30 2022] DELETE /identity/v3/users/9759d5ac855e4406ab7ded9bd06490e0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:30.744343 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8435ec4-bf26-48c7-917f-a5e68f23d872 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:30.744689 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8435ec4-bf26-48c7-917f-a5e68f23d872 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:30.744975 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8435ec4-bf26-48c7-917f-a5e68f23d872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:30.763805 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-d8435ec4-bf26-48c7-917f-a5e68f23d872 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:30.765065 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d8435ec4-bf26-48c7-917f-a5e68f23d872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:30.826883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1347/2700] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:30.836679 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe245c9-9007-4b64-bdd0-086698fd72f0 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:30.838093 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-dbe245c9-9007-4b64-bdd0-086698fd72f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:30.866252 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:30.894349 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe245c9-9007-4b64-bdd0-086698fd72f0 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:30.898200 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885f071-942d-411d-a97d-8350e916eef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:30.898848 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885f071-942d-411d-a97d-8350e916eef3 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:30.899131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885f071-942d-411d-a97d-8350e916eef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:30.899415 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885f071-942d-411d-a97d-8350e916eef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:30.908809 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885f071-942d-411d-a97d-8350e916eef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:30.910256 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885f071-942d-411d-a97d-8350e916eef3 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:30.920181 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1354/2701] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:31.353056 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8435ec4-bf26-48c7-917f-a5e68f23d872 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:31.354402 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d8435ec4-bf26-48c7-917f-a5e68f23d872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:31.366328 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8435ec4-bf26-48c7-917f-a5e68f23d872 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:31.371177 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f588f-513b-45d4-b507-45a2d1bf5a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:31.372043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f588f-513b-45d4-b507-45a2d1bf5a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:31.372636 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f588f-513b-45d4-b507-45a2d1bf5a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:31.372762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f588f-513b-45d4-b507-45a2d1bf5a0c admin admin] PATH_INFO: `/v3/projects/04a76e9b7a91441ebad3c3a1814f5233` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:31.377230 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f588f-513b-45d4-b507-45a2d1bf5a0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a76e9b7a91441ebad3c3a1814f5233)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:31.377230 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f588f-513b-45d4-b507-45a2d1bf5a0c admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:31.379049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:31.516515 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-157f588f-513b-45d4-b507-45a2d1bf5a0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a76e9b7a91441ebad3c3a1814f5233', 'request_id': 'req-157f588f-513b-45d4-b507-45a2d1bf5a0c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:31.585925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-157f588f-513b-45d4-b507-45a2d1bf5a0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a76e9b7a91441ebad3c3a1814f5233', 'request_id': 'req-157f588f-513b-45d4-b507-45a2d1bf5a0c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:31.592886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-157f588f-513b-45d4-b507-45a2d1bf5a0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a76e9b7a91441ebad3c3a1814f5233', 'request_id': 'req-157f588f-513b-45d4-b507-45a2d1bf5a0c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:31.603918 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-157f588f-513b-45d4-b507-45a2d1bf5a0c admin admin] The token cache is being invalidate because project 04a76e9b7a91441ebad3c3a1814f5233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:59:31.604166 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-157f588f-513b-45d4-b507-45a2d1bf5a0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:31.604927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-157f588f-513b-45d4-b507-45a2d1bf5a0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:31.606476 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1348/2702] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:59:31 2022] DELETE /identity/v3/projects/04a76e9b7a91441ebad3c3a1814f5233 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:31.610340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885f071-942d-411d-a97d-8350e916eef3 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:31.621117 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885f071-942d-411d-a97d-8350e916eef3 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:31.677918 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39466d-29aa-4968-938e-73a7d8a802fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:31.678788 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39466d-29aa-4968-938e-73a7d8a802fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:31.679075 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39466d-29aa-4968-938e-73a7d8a802fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:31.679354 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39466d-29aa-4968-938e-73a7d8a802fe admin admin] PATH_INFO: `/v3/users/d1f5c191440b498f871e26306efb3a6a` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:31.680978 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39466d-29aa-4968-938e-73a7d8a802fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f5c191440b498f871e26306efb3a6a)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:31.682945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39466d-29aa-4968-938e-73a7d8a802fe admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:31.956831 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ec39466d-29aa-4968-938e-73a7d8a802fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f5c191440b498f871e26306efb3a6a'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:32.051610 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ec39466d-29aa-4968-938e-73a7d8a802fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f5c191440b498f871e26306efb3a6a'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:32.052304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ec39466d-29aa-4968-938e-73a7d8a802fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f5c191440b498f871e26306efb3a6a'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:32.064834 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ec39466d-29aa-4968-938e-73a7d8a802fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f5c191440b498f871e26306efb3a6a'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:32.065467 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-ec39466d-29aa-4968-938e-73a7d8a802fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f5c191440b498f871e26306efb3a6a'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:32.080852 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1355/2703] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:59:31 2022] DELETE /identity/v3/users/d1f5c191440b498f871e26306efb3a6a => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:32.510984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f588f-513b-45d4-b507-45a2d1bf5a0c admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:32.512547 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-157f588f-513b-45d4-b507-45a2d1bf5a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:32.525963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f588f-513b-45d4-b507-45a2d1bf5a0c admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:32.583352 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3027e18-aab3-4094-adee-7b964c6d09b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:32.584876 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3027e18-aab3-4094-adee-7b964c6d09b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:32.585165 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3027e18-aab3-4094-adee-7b964c6d09b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:32.585443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3027e18-aab3-4094-adee-7b964c6d09b3 admin admin] PATH_INFO: `/v3/projects/2b21ac6963a0425489463aabed4115fc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:32.586639 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3027e18-aab3-4094-adee-7b964c6d09b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b21ac6963a0425489463aabed4115fc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:32.588554 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3027e18-aab3-4094-adee-7b964c6d09b3 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:32.704005 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e3027e18-aab3-4094-adee-7b964c6d09b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b21ac6963a0425489463aabed4115fc', 'request_id': 'req-e3027e18-aab3-4094-adee-7b964c6d09b3'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:32.799887 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e3027e18-aab3-4094-adee-7b964c6d09b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b21ac6963a0425489463aabed4115fc', 'request_id': 'req-e3027e18-aab3-4094-adee-7b964c6d09b3'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:32.806893 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e3027e18-aab3-4094-adee-7b964c6d09b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b21ac6963a0425489463aabed4115fc', 'request_id': 'req-e3027e18-aab3-4094-adee-7b964c6d09b3'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:32.817554 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e3027e18-aab3-4094-adee-7b964c6d09b3 admin admin] The token cache is being invalidate because project 2b21ac6963a0425489463aabed4115fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:59:32.817845 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e3027e18-aab3-4094-adee-7b964c6d09b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:32.819130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e3027e18-aab3-4094-adee-7b964c6d09b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:32.820764 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1349/2704] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:59:32 2022] DELETE /identity/v3/projects/2b21ac6963a0425489463aabed4115fc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:32.825844 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41deb3-7469-48d9-ab98-23433ae41c13 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:32.826326 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41deb3-7469-48d9-ab98-23433ae41c13 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:32.826430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41deb3-7469-48d9-ab98-23433ae41c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:32.844370 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-bb41deb3-7469-48d9-ab98-23433ae41c13 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:32.845614 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-bb41deb3-7469-48d9-ab98-23433ae41c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:32.886965 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:32.903729 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1356/2705] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:32.911368 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29d0ba-9beb-4cb6-9476-6c3aabaef9f0 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:32.911662 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29d0ba-9beb-4cb6-9476-6c3aabaef9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:32.911980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29d0ba-9beb-4cb6-9476-6c3aabaef9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:32.930439 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-bb29d0ba-9beb-4cb6-9476-6c3aabaef9f0 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:32.931635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-bb29d0ba-9beb-4cb6-9476-6c3aabaef9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:32.939378 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1350/2706] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:32.944306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41deb3-7469-48d9-ab98-23433ae41c13 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:32.953871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41deb3-7469-48d9-ab98-23433ae41c13 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:32.959112 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93ed2d-ea8c-4b17-bbde-a3ec832000e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:32.959707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93ed2d-ea8c-4b17-bbde-a3ec832000e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:32.959990 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93ed2d-ea8c-4b17-bbde-a3ec832000e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:32.960266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93ed2d-ea8c-4b17-bbde-a3ec832000e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:32.961023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93ed2d-ea8c-4b17-bbde-a3ec832000e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:59:32.961331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93ed2d-ea8c-4b17-bbde-a3ec832000e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:32.962913 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93ed2d-ea8c-4b17-bbde-a3ec832000e4 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:32.974280 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1357/2707] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:59:32.979280 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29d0ba-9beb-4cb6-9476-6c3aabaef9f0 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:32.988252 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29d0ba-9beb-4cb6-9476-6c3aabaef9f0 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:32.993738 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fafc2f-3948-4b2d-b378-99e33cd5821e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:32.994643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fafc2f-3948-4b2d-b378-99e33cd5821e admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:32.996155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fafc2f-3948-4b2d-b378-99e33cd5821e admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:32.996155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fafc2f-3948-4b2d-b378-99e33cd5821e admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:32.996155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fafc2f-3948-4b2d-b378-99e33cd5821e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:32.998095 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fafc2f-3948-4b2d-b378-99e33cd5821e admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:33.011003 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:33.078087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1351/2708] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:59:32 2022] POST /identity/v3/projects => generated 399 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:33.082432 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93ed2d-ea8c-4b17-bbde-a3ec832000e4 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:33.092223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93ed2d-ea8c-4b17-bbde-a3ec832000e4 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:33.147318 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51da56-8d1a-494f-afb1-3d65ea2cb247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:33.147983 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51da56-8d1a-494f-afb1-3d65ea2cb247 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:33.148265 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51da56-8d1a-494f-afb1-3d65ea2cb247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:33.148540 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51da56-8d1a-494f-afb1-3d65ea2cb247 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:33.149255 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51da56-8d1a-494f-afb1-3d65ea2cb247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:33.151158 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51da56-8d1a-494f-afb1-3d65ea2cb247 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:33.241489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1358/2709] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:59:33 2022] POST /identity/v3/users => generated 300 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:59:33.245913 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fafc2f-3948-4b2d-b378-99e33cd5821e admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:33.256228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fafc2f-3948-4b2d-b378-99e33cd5821e admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:33.260901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe91b0-fc01-4da2-8b26-3b6029e27905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:33.261556 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe91b0-fc01-4da2-8b26-3b6029e27905 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:33.261841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe91b0-fc01-4da2-8b26-3b6029e27905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:33.262118 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe91b0-fc01-4da2-8b26-3b6029e27905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:33.262835 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe91b0-fc01-4da2-8b26-3b6029e27905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:33.264535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe91b0-fc01-4da2-8b26-3b6029e27905 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:33.274883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1352/2710] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:33.278788 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51da56-8d1a-494f-afb1-3d65ea2cb247 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:33.289404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51da56-8d1a-494f-afb1-3d65ea2cb247 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:33.294142 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f87158-30f2-44ff-ba4f-1f03f48d0854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:33.294802 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f87158-30f2-44ff-ba4f-1f03f48d0854 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:33.295089 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f87158-30f2-44ff-ba4f-1f03f48d0854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:33.295369 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f87158-30f2-44ff-ba4f-1f03f48d0854 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:33.296133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f87158-30f2-44ff-ba4f-1f03f48d0854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:33.297797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f87158-30f2-44ff-ba4f-1f03f48d0854 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:33.308133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1359/2711] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:33.312224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe91b0-fc01-4da2-8b26-3b6029e27905 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:33.324216 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe91b0-fc01-4da2-8b26-3b6029e27905 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:33.328939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc7fec-8709-4ddb-a40b-0f57252deb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:33.329817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc7fec-8709-4ddb-a40b-0f57252deb85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:33.330104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc7fec-8709-4ddb-a40b-0f57252deb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:33.330383 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc7fec-8709-4ddb-a40b-0f57252deb85 admin admin] PATH_INFO: `/v3/projects/4877d3610bf244e9a2f1723e671cb636/users/0236d117e89641108b65e6d294a8bbcf/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:33.345640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc7fec-8709-4ddb-a40b-0f57252deb85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4877d3610bf244e9a2f1723e671cb636, user_id=0236d117e89641108b65e6d294a8bbcf, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:33.348259 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc7fec-8709-4ddb-a40b-0f57252deb85 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:33.431763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f87158-30f2-44ff-ba4f-1f03f48d0854 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:33.433503 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f1f87158-30f2-44ff-ba4f-1f03f48d0854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:33.445875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f87158-30f2-44ff-ba4f-1f03f48d0854 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:33.450435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f53497-cef5-4984-b62a-097f87c07533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:33.451290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f53497-cef5-4984-b62a-097f87c07533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:33.451570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f53497-cef5-4984-b62a-097f87c07533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:33.451845 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f53497-cef5-4984-b62a-097f87c07533 admin admin] PATH_INFO: `/v3/users/b000549ac6164bc6976b32a17c6b383d` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:33.453044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f53497-cef5-4984-b62a-097f87c07533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b000549ac6164bc6976b32a17c6b383d)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:33.454937 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f53497-cef5-4984-b62a-097f87c07533 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:33.478438 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1353/2712] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:33 2022] PUT /identity/v3/projects/4877d3610bf244e9a2f1723e671cb636/users/0236d117e89641108b65e6d294a8bbcf/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:33.490203 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f23025-dc2f-4887-b513-aded6a9c065a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:33.490627 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f23025-dc2f-4887-b513-aded6a9c065a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:33.490917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f23025-dc2f-4887-b513-aded6a9c065a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:33.516477 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-f6f23025-dc2f-4887-b513-aded6a9c065a None None] MFA Rules not processed for user `0236d117e89641108b65e6d294a8bbcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:33.517640 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f6f23025-dc2f-4887-b513-aded6a9c065a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:33.580898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1354/2713] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:59:33.585896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f23025-dc2f-4887-b513-aded6a9c065a None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:33.622842 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-b1f53497-cef5-4984-b62a-097f87c07533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b000549ac6164bc6976b32a17c6b383d'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:33.648351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f23025-dc2f-4887-b513-aded6a9c065a None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:33.652941 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b22c3-81b7-4699-a57e-fae58dd523ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:33.653587 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b22c3-81b7-4699-a57e-fae58dd523ac admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:33.653871 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b22c3-81b7-4699-a57e-fae58dd523ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:33.654151 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b22c3-81b7-4699-a57e-fae58dd523ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:33.654834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b22c3-81b7-4699-a57e-fae58dd523ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:33.656751 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b22c3-81b7-4699-a57e-fae58dd523ac admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:33.688063 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-b1f53497-cef5-4984-b62a-097f87c07533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b000549ac6164bc6976b32a17c6b383d'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:33.688741 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-b1f53497-cef5-4984-b62a-097f87c07533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b000549ac6164bc6976b32a17c6b383d'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:33.701517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-b1f53497-cef5-4984-b62a-097f87c07533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b000549ac6164bc6976b32a17c6b383d'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:33.702169 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-b1f53497-cef5-4984-b62a-097f87c07533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b000549ac6164bc6976b32a17c6b383d'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:33.714775 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1360/2714] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:59:33 2022] DELETE /identity/v3/users/b000549ac6164bc6976b32a17c6b383d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:33.719410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1433f4-de33-427c-98d2-97003a7d8d21 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:33.719699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1433f4-de33-427c-98d2-97003a7d8d21 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:33.719975 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1433f4-de33-427c-98d2-97003a7d8d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:33.737016 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-ac1433f4-de33-427c-98d2-97003a7d8d21 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:33.738257 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ac1433f4-de33-427c-98d2-97003a7d8d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:33.756483 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:33.784175 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1355/2715] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:59:33 2022] POST /identity/v3/projects => generated 399 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:59:33.788051 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b22c3-81b7-4699-a57e-fae58dd523ac admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:33.789735 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-457b22c3-81b7-4699-a57e-fae58dd523ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:33.798999 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1361/2716] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:59:33.808678 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1433f4-de33-427c-98d2-97003a7d8d21 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:33.810018 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ac1433f4-de33-427c-98d2-97003a7d8d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:33.825984 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:33.855034 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b22c3-81b7-4699-a57e-fae58dd523ac admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:33.859811 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef596c-1e25-4a4f-8c19-e02d9a51c735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:33.860474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef596c-1e25-4a4f-8c19-e02d9a51c735 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:33.860780 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef596c-1e25-4a4f-8c19-e02d9a51c735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:33.861051 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef596c-1e25-4a4f-8c19-e02d9a51c735 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:33.861789 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef596c-1e25-4a4f-8c19-e02d9a51c735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:33.863681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef596c-1e25-4a4f-8c19-e02d9a51c735 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:33.869798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1433f4-de33-427c-98d2-97003a7d8d21 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:33.917632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82a88d-aebf-4760-bae4-8b93a602c760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:33.918284 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82a88d-aebf-4760-bae4-8b93a602c760 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:33.918574 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82a88d-aebf-4760-bae4-8b93a602c760 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:33.918826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82a88d-aebf-4760-bae4-8b93a602c760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:33.927777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82a88d-aebf-4760-bae4-8b93a602c760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:33.929260 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82a88d-aebf-4760-bae4-8b93a602c760 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:33.939439 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1362/2717] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:59:33.985517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1356/2718] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:59:33 2022] POST /identity/v3/users => generated 306 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:59:33.989510 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82a88d-aebf-4760-bae4-8b93a602c760 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:33.999500 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82a88d-aebf-4760-bae4-8b93a602c760 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:34.004190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a7a1d-e30d-435e-a68f-44de41da631b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:34.004894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a7a1d-e30d-435e-a68f-44de41da631b admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:34.005184 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a7a1d-e30d-435e-a68f-44de41da631b admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:34.005443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a7a1d-e30d-435e-a68f-44de41da631b admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:34.006694 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a7a1d-e30d-435e-a68f-44de41da631b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:34.008271 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a7a1d-e30d-435e-a68f-44de41da631b admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:34.018613 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1363/2719] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:34.023320 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef596c-1e25-4a4f-8c19-e02d9a51c735 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:34.033800 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef596c-1e25-4a4f-8c19-e02d9a51c735 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:34.038621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ecbda-1bdd-4534-b5c4-956ab239c805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:34.039441 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ecbda-1bdd-4534-b5c4-956ab239c805 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:34.039722 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ecbda-1bdd-4534-b5c4-956ab239c805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:34.039994 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ecbda-1bdd-4534-b5c4-956ab239c805 admin admin] PATH_INFO: `/v3/projects/51b6b6b83edf4f8b803a4a68a2d67f8d/users/e5b0d9e41b6d475ea4ca1843a8ca5363/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:34.054422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ecbda-1bdd-4534-b5c4-956ab239c805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b6b6b83edf4f8b803a4a68a2d67f8d, user_id=e5b0d9e41b6d475ea4ca1843a8ca5363, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:34.057113 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ecbda-1bdd-4534-b5c4-956ab239c805 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:34.148796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1357/2720] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:34 2022] PUT /identity/v3/projects/51b6b6b83edf4f8b803a4a68a2d67f8d/users/e5b0d9e41b6d475ea4ca1843a8ca5363/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:34.152666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a7a1d-e30d-435e-a68f-44de41da631b admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:34.166344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a7a1d-e30d-435e-a68f-44de41da631b admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:34.240911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29745564-b6b0-4590-96ca-79561041423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:34.241597 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29745564-b6b0-4590-96ca-79561041423b admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:34.241886 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29745564-b6b0-4590-96ca-79561041423b admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:34.242164 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29745564-b6b0-4590-96ca-79561041423b admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:34.242895 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29745564-b6b0-4590-96ca-79561041423b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:34.244767 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29745564-b6b0-4590-96ca-79561041423b admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:34.255356 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1364/2721] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:59:34.259799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ecbda-1bdd-4534-b5c4-956ab239c805 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:34.270596 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ecbda-1bdd-4534-b5c4-956ab239c805 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:34.275862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bdd2d-95f5-45da-9f5a-72bcc0e8a68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:34.276960 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bdd2d-95f5-45da-9f5a-72bcc0e8a68d admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:34.277329 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bdd2d-95f5-45da-9f5a-72bcc0e8a68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:34.277680 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bdd2d-95f5-45da-9f5a-72bcc0e8a68d admin admin] PATH_INFO: `/v3/projects/51b6b6b83edf4f8b803a4a68a2d67f8d/users/e5b0d9e41b6d475ea4ca1843a8ca5363/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:34.279818 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bdd2d-95f5-45da-9f5a-72bcc0e8a68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b6b6b83edf4f8b803a4a68a2d67f8d, user_id=e5b0d9e41b6d475ea4ca1843a8ca5363, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:34.282676 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bdd2d-95f5-45da-9f5a-72bcc0e8a68d admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:34.293458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1358/2722] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:34 2022] PUT /identity/v3/projects/51b6b6b83edf4f8b803a4a68a2d67f8d/users/e5b0d9e41b6d475ea4ca1843a8ca5363/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:34.304296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1bc90-dbe5-4a99-b1a7-d85843e45d1f None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:34.304571 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1bc90-dbe5-4a99-b1a7-d85843e45d1f None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:34.304901 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1bc90-dbe5-4a99-b1a7-d85843e45d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:34.323475 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:34.333137 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-0fd1bc90-dbe5-4a99-b1a7-d85843e45d1f None None] MFA Rules not processed for user `e5b0d9e41b6d475ea4ca1843a8ca5363`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:34.334866 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0fd1bc90-dbe5-4a99-b1a7-d85843e45d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:34.358677 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bdd2d-95f5-45da-9f5a-72bcc0e8a68d admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:34.360863 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-992bdd2d-95f5-45da-9f5a-72bcc0e8a68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:34.413659 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1365/2723] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:34 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:34.424274 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1bc90-dbe5-4a99-b1a7-d85843e45d1f None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:34.425643 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0fd1bc90-dbe5-4a99-b1a7-d85843e45d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:34.431515 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bdd2d-95f5-45da-9f5a-72bcc0e8a68d admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:34.436917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86176f-6fd2-4bd5-b3c2-dd5217acef9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:34.437920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86176f-6fd2-4bd5-b3c2-dd5217acef9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:34.438304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86176f-6fd2-4bd5-b3c2-dd5217acef9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:34.438637 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86176f-6fd2-4bd5-b3c2-dd5217acef9b admin admin] PATH_INFO: `/v3/projects/69051c67f0d744a9b99cb7da2c04d749` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:34.439958 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86176f-6fd2-4bd5-b3c2-dd5217acef9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=69051c67f0d744a9b99cb7da2c04d749)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:34.441930 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86176f-6fd2-4bd5-b3c2-dd5217acef9b admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:34.483634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1bc90-dbe5-4a99-b1a7-d85843e45d1f None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:34.487335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7a441-e596-4e62-ab64-d7436457d36a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:34.487980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7a441-e596-4e62-ab64-d7436457d36a service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:34.488258 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7a441-e596-4e62-ab64-d7436457d36a service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:34.488528 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7a441-e596-4e62-ab64-d7436457d36a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:34.498110 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7a441-e596-4e62-ab64-d7436457d36a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:34.499524 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7a441-e596-4e62-ab64-d7436457d36a service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:34.509042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1366/2724] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:34 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:59:34.577146 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3d86176f-6fd2-4bd5-b3c2-dd5217acef9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69051c67f0d744a9b99cb7da2c04d749', 'request_id': 'req-3d86176f-6fd2-4bd5-b3c2-dd5217acef9b'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:34.611675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7a441-e596-4e62-ab64-d7436457d36a service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:34.613097 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-64d7a441-e596-4e62-ab64-d7436457d36a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:34.651818 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3d86176f-6fd2-4bd5-b3c2-dd5217acef9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69051c67f0d744a9b99cb7da2c04d749', 'request_id': 'req-3d86176f-6fd2-4bd5-b3c2-dd5217acef9b'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:34.658904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3d86176f-6fd2-4bd5-b3c2-dd5217acef9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69051c67f0d744a9b99cb7da2c04d749', 'request_id': 'req-3d86176f-6fd2-4bd5-b3c2-dd5217acef9b'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:34.670291 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3d86176f-6fd2-4bd5-b3c2-dd5217acef9b admin admin] The token cache is being invalidate because project 69051c67f0d744a9b99cb7da2c04d749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:59:34.670582 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3d86176f-6fd2-4bd5-b3c2-dd5217acef9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:34.671251 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3d86176f-6fd2-4bd5-b3c2-dd5217acef9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:34.672977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1359/2725] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:59:34 2022] DELETE /identity/v3/projects/69051c67f0d744a9b99cb7da2c04d749 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:59:34.677156 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86176f-6fd2-4bd5-b3c2-dd5217acef9b admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:34.679067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3d86176f-6fd2-4bd5-b3c2-dd5217acef9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:34.695918 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7a441-e596-4e62-ab64-d7436457d36a service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:34.696704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:34.721607 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:34.744731 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86176f-6fd2-4bd5-b3c2-dd5217acef9b admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:34.749498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821abc6a-7276-44ca-a0f0-879dc56edce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:34.750393 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821abc6a-7276-44ca-a0f0-879dc56edce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:34.750679 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821abc6a-7276-44ca-a0f0-879dc56edce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:34.751027 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821abc6a-7276-44ca-a0f0-879dc56edce3 admin admin] PATH_INFO: `/v3/users/19f8c1a939aa49ceac4792899779382a` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:34.752152 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821abc6a-7276-44ca-a0f0-879dc56edce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f8c1a939aa49ceac4792899779382a)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:34.754097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821abc6a-7276-44ca-a0f0-879dc56edce3 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:34.758579 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5c632-13e7-419b-af8f-5e51566913e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:34.759238 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5c632-13e7-419b-af8f-5e51566913e6 service placement] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:34.759525 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5c632-13e7-419b-af8f-5e51566913e6 service placement] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:34.759816 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5c632-13e7-419b-af8f-5e51566913e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:34.761695 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-42c5c632-13e7-419b-af8f-5e51566913e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:34.773151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5c632-13e7-419b-af8f-5e51566913e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:34.774726 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5c632-13e7-419b-af8f-5e51566913e6 service placement] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:34.784821 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1367/2726] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:59:34.785638 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5c632-13e7-419b-af8f-5e51566913e6 service placement] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:34.786902 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-42c5c632-13e7-419b-af8f-5e51566913e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:34.843621 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5c632-13e7-419b-af8f-5e51566913e6 service placement] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:34.847328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa04453-f17a-43dd-9096-f9afe12a804e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:34.847984 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa04453-f17a-43dd-9096-f9afe12a804e service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:34.848267 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa04453-f17a-43dd-9096-f9afe12a804e service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:34.848543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa04453-f17a-43dd-9096-f9afe12a804e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:34.851009 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4fa04453-f17a-43dd-9096-f9afe12a804e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:34.908200 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa04453-f17a-43dd-9096-f9afe12a804e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:34.909662 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa04453-f17a-43dd-9096-f9afe12a804e service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:34.919464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1368/2727] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:34.947915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-821abc6a-7276-44ca-a0f0-879dc56edce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f8c1a939aa49ceac4792899779382a'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:34.948553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-821abc6a-7276-44ca-a0f0-879dc56edce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f8c1a939aa49ceac4792899779382a'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:34.949399 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-821abc6a-7276-44ca-a0f0-879dc56edce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f8c1a939aa49ceac4792899779382a'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:34.962566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-821abc6a-7276-44ca-a0f0-879dc56edce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f8c1a939aa49ceac4792899779382a'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:34.969556 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-821abc6a-7276-44ca-a0f0-879dc56edce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f8c1a939aa49ceac4792899779382a'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:35.048277 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1360/2728] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:59:34 2022] DELETE /identity/v3/users/19f8c1a939aa49ceac4792899779382a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:59:35.487530 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa04453-f17a-43dd-9096-f9afe12a804e service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:35.499011 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa04453-f17a-43dd-9096-f9afe12a804e service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:35.574492 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d9de0-92a8-40d4-922f-a3c7c44de45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:35.575383 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d9de0-92a8-40d4-922f-a3c7c44de45d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:35.576699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d9de0-92a8-40d4-922f-a3c7c44de45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:35.576699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d9de0-92a8-40d4-922f-a3c7c44de45d admin admin] PATH_INFO: `/v3/projects/d2418e4f3b364e7c91dfa071ee17a522` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:35.577223 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d9de0-92a8-40d4-922f-a3c7c44de45d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2418e4f3b364e7c91dfa071ee17a522)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:35.579129 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d9de0-92a8-40d4-922f-a3c7c44de45d admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:35.596123 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:35.709914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-d77d9de0-92a8-40d4-922f-a3c7c44de45d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2418e4f3b364e7c91dfa071ee17a522', 'request_id': 'req-d77d9de0-92a8-40d4-922f-a3c7c44de45d'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:35.715350 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-d77d9de0-92a8-40d4-922f-a3c7c44de45d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2418e4f3b364e7c91dfa071ee17a522', 'request_id': 'req-d77d9de0-92a8-40d4-922f-a3c7c44de45d'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:35.794478 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-d77d9de0-92a8-40d4-922f-a3c7c44de45d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2418e4f3b364e7c91dfa071ee17a522', 'request_id': 'req-d77d9de0-92a8-40d4-922f-a3c7c44de45d'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:35.806193 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-d77d9de0-92a8-40d4-922f-a3c7c44de45d admin admin] The token cache is being invalidate because project d2418e4f3b364e7c91dfa071ee17a522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:59:35.806482 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-d77d9de0-92a8-40d4-922f-a3c7c44de45d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:35.807102 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-d77d9de0-92a8-40d4-922f-a3c7c44de45d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:35.808644 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1369/2729] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:59:35 2022] DELETE /identity/v3/projects/d2418e4f3b364e7c91dfa071ee17a522 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:35.812556 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821abc6a-7276-44ca-a0f0-879dc56edce3 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:35.814012 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-821abc6a-7276-44ca-a0f0-879dc56edce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:35.827479 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821abc6a-7276-44ca-a0f0-879dc56edce3 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:35.883698 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1558d-3a59-4d85-84d2-6f174f0e37eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:35.884568 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1558d-3a59-4d85-84d2-6f174f0e37eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:35.884885 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1558d-3a59-4d85-84d2-6f174f0e37eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:35.885161 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1558d-3a59-4d85-84d2-6f174f0e37eb admin admin] PATH_INFO: `/v3/users/2dcb76f131e44caeb6ace944fe471ee9` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:35.886340 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1558d-3a59-4d85-84d2-6f174f0e37eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dcb76f131e44caeb6ace944fe471ee9)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:35.888262 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1558d-3a59-4d85-84d2-6f174f0e37eb admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:36.034094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:36.042506 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2ab1558d-3a59-4d85-84d2-6f174f0e37eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dcb76f131e44caeb6ace944fe471ee9'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:36.043162 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2ab1558d-3a59-4d85-84d2-6f174f0e37eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dcb76f131e44caeb6ace944fe471ee9'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:36.043776 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2ab1558d-3a59-4d85-84d2-6f174f0e37eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dcb76f131e44caeb6ace944fe471ee9'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:36.056056 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2ab1558d-3a59-4d85-84d2-6f174f0e37eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dcb76f131e44caeb6ace944fe471ee9'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:36.062909 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2ab1558d-3a59-4d85-84d2-6f174f0e37eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dcb76f131e44caeb6ace944fe471ee9'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:36.142508 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1361/2730] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:59:35 2022] DELETE /identity/v3/users/2dcb76f131e44caeb6ace944fe471ee9 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:36.558702 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d9de0-92a8-40d4-922f-a3c7c44de45d admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:36.560306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d77d9de0-92a8-40d4-922f-a3c7c44de45d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:36.576304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d9de0-92a8-40d4-922f-a3c7c44de45d admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:36.639141 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2645d-319f-4e33-b55a-6abf1ba6d54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:36.639941 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2645d-319f-4e33-b55a-6abf1ba6d54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:36.640228 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2645d-319f-4e33-b55a-6abf1ba6d54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:36.640516 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2645d-319f-4e33-b55a-6abf1ba6d54b admin admin] PATH_INFO: `/v3/projects/dfcf467af59e4d109e385e9f82b791fa` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:36.641822 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2645d-319f-4e33-b55a-6abf1ba6d54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfcf467af59e4d109e385e9f82b791fa)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:36.643674 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2645d-319f-4e33-b55a-6abf1ba6d54b admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:36.753330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-81c2645d-319f-4e33-b55a-6abf1ba6d54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfcf467af59e4d109e385e9f82b791fa', 'request_id': 'req-81c2645d-319f-4e33-b55a-6abf1ba6d54b'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:36.758912 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-81c2645d-319f-4e33-b55a-6abf1ba6d54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfcf467af59e4d109e385e9f82b791fa', 'request_id': 'req-81c2645d-319f-4e33-b55a-6abf1ba6d54b'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:36.848679 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-81c2645d-319f-4e33-b55a-6abf1ba6d54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfcf467af59e4d109e385e9f82b791fa', 'request_id': 'req-81c2645d-319f-4e33-b55a-6abf1ba6d54b'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:36.860663 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-81c2645d-319f-4e33-b55a-6abf1ba6d54b admin admin] The token cache is being invalidate because project dfcf467af59e4d109e385e9f82b791fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:59:36.860946 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-81c2645d-319f-4e33-b55a-6abf1ba6d54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:36.861569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-81c2645d-319f-4e33-b55a-6abf1ba6d54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:36.863092 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1370/2731] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:59:36 2022] DELETE /identity/v3/projects/dfcf467af59e4d109e385e9f82b791fa => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:36.868700 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d469d9-c10f-4fd9-88d4-f7487254c324 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:36.869543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d469d9-c10f-4fd9-88d4-f7487254c324 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:36.869543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d469d9-c10f-4fd9-88d4-f7487254c324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:36.886780 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-55d469d9-c10f-4fd9-88d4-f7487254c324 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:36.892263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-55d469d9-c10f-4fd9-88d4-f7487254c324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:36.946043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1362/2732] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:36.953861 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2081e3-faf1-4a1d-8f0a-3b775877f1b0 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:36.954154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2081e3-faf1-4a1d-8f0a-3b775877f1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:36.954435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2081e3-faf1-4a1d-8f0a-3b775877f1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:36.972872 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-db2081e3-faf1-4a1d-8f0a-3b775877f1b0 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:36.974085 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-db2081e3-faf1-4a1d-8f0a-3b775877f1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:36.982526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1371/2733] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:36.986685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d469d9-c10f-4fd9-88d4-f7487254c324 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:36.996851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d469d9-c10f-4fd9-88d4-f7487254c324 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:37.001319 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd2da2-aa0c-4649-bd10-dcf3e508621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:37.001955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd2da2-aa0c-4649-bd10-dcf3e508621d admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:37.002232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd2da2-aa0c-4649-bd10-dcf3e508621d admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:37.002503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd2da2-aa0c-4649-bd10-dcf3e508621d admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:37.006870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd2da2-aa0c-4649-bd10-dcf3e508621d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:59:37.006870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd2da2-aa0c-4649-bd10-dcf3e508621d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:37.006870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd2da2-aa0c-4649-bd10-dcf3e508621d admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:37.016415 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1363/2734] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:59:37.020721 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2081e3-faf1-4a1d-8f0a-3b775877f1b0 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:37.030602 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2081e3-faf1-4a1d-8f0a-3b775877f1b0 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:37.035856 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a788c-2fb8-43c0-97cd-ebc9aa278281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:37.041588 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a788c-2fb8-43c0-97cd-ebc9aa278281 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:37.041588 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a788c-2fb8-43c0-97cd-ebc9aa278281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:37.041588 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a788c-2fb8-43c0-97cd-ebc9aa278281 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:37.041588 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a788c-2fb8-43c0-97cd-ebc9aa278281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:37.041588 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a788c-2fb8-43c0-97cd-ebc9aa278281 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:37.152359 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1372/2735] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:59:37 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:37.153352 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd2da2-aa0c-4649-bd10-dcf3e508621d admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:37.166500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd2da2-aa0c-4649-bd10-dcf3e508621d admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:37.229411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c7a39-e27a-49b6-9437-599ea9e6663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:37.230090 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c7a39-e27a-49b6-9437-599ea9e6663f admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:37.230372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c7a39-e27a-49b6-9437-599ea9e6663f admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:37.230647 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c7a39-e27a-49b6-9437-599ea9e6663f admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:37.231331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c7a39-e27a-49b6-9437-599ea9e6663f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:37.233301 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c7a39-e27a-49b6-9437-599ea9e6663f admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:37.319886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1364/2736] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:59:37 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:59:37.324694 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a788c-2fb8-43c0-97cd-ebc9aa278281 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:37.331470 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:37.335293 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a788c-2fb8-43c0-97cd-ebc9aa278281 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:37.339865 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2d54e-e842-437e-b9b2-a25efb423667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:37.340530 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2d54e-e842-437e-b9b2-a25efb423667 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:37.340844 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2d54e-e842-437e-b9b2-a25efb423667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:37.341151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2d54e-e842-437e-b9b2-a25efb423667 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:37.341943 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2d54e-e842-437e-b9b2-a25efb423667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:37.343539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2d54e-e842-437e-b9b2-a25efb423667 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:37.353780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1373/2737] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:37.357712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c7a39-e27a-49b6-9437-599ea9e6663f admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:37.368056 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c7a39-e27a-49b6-9437-599ea9e6663f admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:37.373194 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3db3b-27c3-4309-b0c4-5d165f1d71a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:37.373849 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3db3b-27c3-4309-b0c4-5d165f1d71a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:37.374130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3db3b-27c3-4309-b0c4-5d165f1d71a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:37.374404 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3db3b-27c3-4309-b0c4-5d165f1d71a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:37.375122 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3db3b-27c3-4309-b0c4-5d165f1d71a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:37.376815 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3db3b-27c3-4309-b0c4-5d165f1d71a7 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:37.387465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1365/2738] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:59:37.391458 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2d54e-e842-437e-b9b2-a25efb423667 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:37.401076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2d54e-e842-437e-b9b2-a25efb423667 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:37.405631 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369fc0b-c656-449d-85bd-125d9884c12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:37.406436 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369fc0b-c656-449d-85bd-125d9884c12a admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:37.406713 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369fc0b-c656-449d-85bd-125d9884c12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:37.406981 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369fc0b-c656-449d-85bd-125d9884c12a admin admin] PATH_INFO: `/v3/projects/abd0096c37fa44f39b94b79d5583b6b6/users/388869f244804961a16174fb3498c0e2/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:37.421857 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369fc0b-c656-449d-85bd-125d9884c12a admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd0096c37fa44f39b94b79d5583b6b6, user_id=388869f244804961a16174fb3498c0e2, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:37.424475 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369fc0b-c656-449d-85bd-125d9884c12a admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:37.502723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1374/2739] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:37 2022] PUT /identity/v3/projects/abd0096c37fa44f39b94b79d5583b6b6/users/388869f244804961a16174fb3498c0e2/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:37.513182 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f7012-4c4e-4df6-974e-720f1c6de7f0 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:37.513474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f7012-4c4e-4df6-974e-720f1c6de7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:37.513760 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f7012-4c4e-4df6-974e-720f1c6de7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:37.539577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-071f7012-4c4e-4df6-974e-720f1c6de7f0 None None] MFA Rules not processed for user `388869f244804961a16174fb3498c0e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:37.540812 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-071f7012-4c4e-4df6-974e-720f1c6de7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:37.548546 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:37.604732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1366/2740] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:37.615317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369fc0b-c656-449d-85bd-125d9884c12a admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:37.617122 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e369fc0b-c656-449d-85bd-125d9884c12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:37.672913 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369fc0b-c656-449d-85bd-125d9884c12a admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:37.676703 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c88fb6-b39c-4d57-b2e6-119f962920e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:37.677344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c88fb6-b39c-4d57-b2e6-119f962920e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:37.677627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c88fb6-b39c-4d57-b2e6-119f962920e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:37.677909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c88fb6-b39c-4d57-b2e6-119f962920e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:37.686567 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c88fb6-b39c-4d57-b2e6-119f962920e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:37.687986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c88fb6-b39c-4d57-b2e6-119f962920e1 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:37.696695 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1375/2741] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:37.720863 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f7012-4c4e-4df6-974e-720f1c6de7f0 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:37.781920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f7012-4c4e-4df6-974e-720f1c6de7f0 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:37.786489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf8027-ae23-4c0f-a00e-b5216d88c4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:37.787352 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf8027-ae23-4c0f-a00e-b5216d88c4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:37.787635 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf8027-ae23-4c0f-a00e-b5216d88c4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:37.787911 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf8027-ae23-4c0f-a00e-b5216d88c4ce admin admin] PATH_INFO: `/v3/users/388869f244804961a16174fb3498c0e2` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:37.789191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf8027-ae23-4c0f-a00e-b5216d88c4ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=388869f244804961a16174fb3498c0e2)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:37.791609 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf8027-ae23-4c0f-a00e-b5216d88c4ce admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:37.980124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e9bf8027-ae23-4c0f-a00e-b5216d88c4ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388869f244804961a16174fb3498c0e2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:37.980767 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e9bf8027-ae23-4c0f-a00e-b5216d88c4ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388869f244804961a16174fb3498c0e2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:37.981397 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e9bf8027-ae23-4c0f-a00e-b5216d88c4ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388869f244804961a16174fb3498c0e2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:37.993119 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e9bf8027-ae23-4c0f-a00e-b5216d88c4ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388869f244804961a16174fb3498c0e2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:38.000175 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-e9bf8027-ae23-4c0f-a00e-b5216d88c4ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388869f244804961a16174fb3498c0e2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:38.070830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1367/2742] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:59:37 2022] DELETE /identity/v3/users/388869f244804961a16174fb3498c0e2 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:38.075271 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a10940-32ef-4963-ac2d-67630085f6b4 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:38.075563 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a10940-32ef-4963-ac2d-67630085f6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:38.075841 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a10940-32ef-4963-ac2d-67630085f6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:38.092868 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-63a10940-32ef-4963-ac2d-67630085f6b4 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:38.094053 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-63a10940-32ef-4963-ac2d-67630085f6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:38.152403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1376/2743] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:38.162186 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf8027-ae23-4c0f-a00e-b5216d88c4ce admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:38.163608 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-e9bf8027-ae23-4c0f-a00e-b5216d88c4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:38.196143 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:38.223389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf8027-ae23-4c0f-a00e-b5216d88c4ce admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:38.228206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25caeae4-6ab6-4770-aeb9-108165fe24e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:38.228901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25caeae4-6ab6-4770-aeb9-108165fe24e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:38.229188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25caeae4-6ab6-4770-aeb9-108165fe24e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:38.229469 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25caeae4-6ab6-4770-aeb9-108165fe24e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:38.240972 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25caeae4-6ab6-4770-aeb9-108165fe24e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:38.242411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25caeae4-6ab6-4770-aeb9-108165fe24e3 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:38.252963 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1368/2744] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:38.659224 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a10940-32ef-4963-ac2d-67630085f6b4 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:38.660715 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-63a10940-32ef-4963-ac2d-67630085f6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:38.675638 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a10940-32ef-4963-ac2d-67630085f6b4 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:38.681307 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052e134-436b-496c-8703-4557d0452c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:38.682172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052e134-436b-496c-8703-4557d0452c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:38.682460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052e134-436b-496c-8703-4557d0452c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:38.682735 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052e134-436b-496c-8703-4557d0452c8a admin admin] PATH_INFO: `/v3/projects/abd0096c37fa44f39b94b79d5583b6b6` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:38.684232 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052e134-436b-496c-8703-4557d0452c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd0096c37fa44f39b94b79d5583b6b6)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:38.686026 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052e134-436b-496c-8703-4557d0452c8a admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:38.794821 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-a052e134-436b-496c-8703-4557d0452c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd0096c37fa44f39b94b79d5583b6b6', 'request_id': 'req-a052e134-436b-496c-8703-4557d0452c8a'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:38.800190 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-a052e134-436b-496c-8703-4557d0452c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd0096c37fa44f39b94b79d5583b6b6', 'request_id': 'req-a052e134-436b-496c-8703-4557d0452c8a'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:38.868977 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-a052e134-436b-496c-8703-4557d0452c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd0096c37fa44f39b94b79d5583b6b6', 'request_id': 'req-a052e134-436b-496c-8703-4557d0452c8a'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:38.871216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:38.880403 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-a052e134-436b-496c-8703-4557d0452c8a admin admin] The token cache is being invalidate because project abd0096c37fa44f39b94b79d5583b6b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:59:38.880733 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-a052e134-436b-496c-8703-4557d0452c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:38.881369 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-a052e134-436b-496c-8703-4557d0452c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:38.883468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1377/2745] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:59:38 2022] DELETE /identity/v3/projects/abd0096c37fa44f39b94b79d5583b6b6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:38.888611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b915c-af23-47f4-bc94-ac301dddf159 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:38.888906 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b915c-af23-47f4-bc94-ac301dddf159 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:38.889203 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b915c-af23-47f4-bc94-ac301dddf159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:38.908870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-6d0b915c-af23-47f4-bc94-ac301dddf159 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:38.910067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-6d0b915c-af23-47f4-bc94-ac301dddf159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:38.967297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1369/2746] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:38.975927 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec1b4a-0349-4c06-99df-9e959cbd5749 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:38.976216 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec1b4a-0349-4c06-99df-9e959cbd5749 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:38.976497 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec1b4a-0349-4c06-99df-9e959cbd5749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:38.995590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-c8ec1b4a-0349-4c06-99df-9e959cbd5749 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:38.996817 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-c8ec1b4a-0349-4c06-99df-9e959cbd5749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:39.004692 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1378/2747] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:39.008651 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b915c-af23-47f4-bc94-ac301dddf159 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:39.018324 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b915c-af23-47f4-bc94-ac301dddf159 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:39.022875 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9dadd-570a-473e-b860-13e523a2bd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:39.027223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9dadd-570a-473e-b860-13e523a2bd50 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:39.027223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9dadd-570a-473e-b860-13e523a2bd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:39.027223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9dadd-570a-473e-b860-13e523a2bd50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:39.027223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9dadd-570a-473e-b860-13e523a2bd50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:59:39.027223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9dadd-570a-473e-b860-13e523a2bd50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:39.027223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9dadd-570a-473e-b860-13e523a2bd50 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:39.037934 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1370/2748] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:59:39.042714 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec1b4a-0349-4c06-99df-9e959cbd5749 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:39.055940 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec1b4a-0349-4c06-99df-9e959cbd5749 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:39.059456 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a7b3a-1ad9-41e7-b1e5-730669b61eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:39.060170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a7b3a-1ad9-41e7-b1e5-730669b61eaf admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:39.060466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a7b3a-1ad9-41e7-b1e5-730669b61eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:39.060761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a7b3a-1ad9-41e7-b1e5-730669b61eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:39.061514 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a7b3a-1ad9-41e7-b1e5-730669b61eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:39.063496 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a7b3a-1ad9-41e7-b1e5-730669b61eaf admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:39.167911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1379/2749] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:59:39 2022] POST /identity/v3/projects => generated 391 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:39.172129 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9dadd-570a-473e-b860-13e523a2bd50 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:39.182678 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9dadd-570a-473e-b860-13e523a2bd50 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:39.238099 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9e75d-094f-4c80-ba8d-0bb5b68c9dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:39.238764 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9e75d-094f-4c80-ba8d-0bb5b68c9dbb admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:39.239043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9e75d-094f-4c80-ba8d-0bb5b68c9dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:39.239316 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9e75d-094f-4c80-ba8d-0bb5b68c9dbb admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:39.239993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9e75d-094f-4c80-ba8d-0bb5b68c9dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:39.241922 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9e75d-094f-4c80-ba8d-0bb5b68c9dbb admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:39.385801 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1371/2750] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:59:39 2022] POST /identity/v3/users => generated 296 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:59:39.389782 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a7b3a-1ad9-41e7-b1e5-730669b61eaf admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:39.400369 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a7b3a-1ad9-41e7-b1e5-730669b61eaf admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:39.404830 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83398e8-ff75-4290-81ad-b20c5f8135ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:39.405485 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83398e8-ff75-4290-81ad-b20c5f8135ce admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:39.405765 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83398e8-ff75-4290-81ad-b20c5f8135ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:39.406038 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83398e8-ff75-4290-81ad-b20c5f8135ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:39.406754 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83398e8-ff75-4290-81ad-b20c5f8135ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:39.408319 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83398e8-ff75-4290-81ad-b20c5f8135ce admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:39.418998 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1380/2751] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:39.422702 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9e75d-094f-4c80-ba8d-0bb5b68c9dbb admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:39.432464 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9e75d-094f-4c80-ba8d-0bb5b68c9dbb admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:39.437094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdb418-8fbd-462a-9fe9-2970b406e9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:39.437745 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdb418-8fbd-462a-9fe9-2970b406e9bf admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:39.438030 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdb418-8fbd-462a-9fe9-2970b406e9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:39.438315 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdb418-8fbd-462a-9fe9-2970b406e9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:39.439037 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdb418-8fbd-462a-9fe9-2970b406e9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:39.440670 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdb418-8fbd-462a-9fe9-2970b406e9bf admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:39.450530 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1372/2752] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:39.454603 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83398e8-ff75-4290-81ad-b20c5f8135ce admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:39.464905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83398e8-ff75-4290-81ad-b20c5f8135ce admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:39.469368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6374a-ea03-4eea-a848-c37fb93b1859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:39.470247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6374a-ea03-4eea-a848-c37fb93b1859 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:39.470530 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6374a-ea03-4eea-a848-c37fb93b1859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:39.470807 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6374a-ea03-4eea-a848-c37fb93b1859 admin admin] PATH_INFO: `/v3/projects/75d650569d16475fb8eb0a35a3d57f9a/users/fc719e0374514ab2b2b3a1affcdedf16/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:39.486838 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6374a-ea03-4eea-a848-c37fb93b1859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d650569d16475fb8eb0a35a3d57f9a, user_id=fc719e0374514ab2b2b3a1affcdedf16, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:39.489652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6374a-ea03-4eea-a848-c37fb93b1859 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:39.582657 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1381/2753] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:39 2022] PUT /identity/v3/projects/75d650569d16475fb8eb0a35a3d57f9a/users/fc719e0374514ab2b2b3a1affcdedf16/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:59:39.594581 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aee54a-7064-47e2-9b20-58df45d0b3c5 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:39.594877 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aee54a-7064-47e2-9b20-58df45d0b3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:39.595191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aee54a-7064-47e2-9b20-58df45d0b3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:39.622911 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-08aee54a-7064-47e2-9b20-58df45d0b3c5 None None] MFA Rules not processed for user `fc719e0374514ab2b2b3a1affcdedf16`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:39.623790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-08aee54a-7064-47e2-9b20-58df45d0b3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:39.652143 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:39.697290 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1373/2754] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:59:39.708102 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6374a-ea03-4eea-a848-c37fb93b1859 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:39.709916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4ab6374a-ea03-4eea-a848-c37fb93b1859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:39.769152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6374a-ea03-4eea-a848-c37fb93b1859 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:39.772961 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fc556-7a32-4da8-955f-4dae93080ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:39.774177 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fc556-7a32-4da8-955f-4dae93080ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:39.774467 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fc556-7a32-4da8-955f-4dae93080ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:39.774746 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fc556-7a32-4da8-955f-4dae93080ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:39.783577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fc556-7a32-4da8-955f-4dae93080ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:39.785047 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fc556-7a32-4da8-955f-4dae93080ac3 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:39.794191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1382/2755] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:39.921237 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aee54a-7064-47e2-9b20-58df45d0b3c5 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:39.922880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-08aee54a-7064-47e2-9b20-58df45d0b3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:39.988106 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aee54a-7064-47e2-9b20-58df45d0b3c5 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:39.995992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0134d0-8531-4895-93cd-d53ccb30c7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:39.996988 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0134d0-8531-4895-93cd-d53ccb30c7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:39.997297 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0134d0-8531-4895-93cd-d53ccb30c7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:39.997574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0134d0-8531-4895-93cd-d53ccb30c7b1 admin admin] PATH_INFO: `/v3/users/0236d117e89641108b65e6d294a8bbcf` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:39.998764 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0134d0-8531-4895-93cd-d53ccb30c7b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0236d117e89641108b65e6d294a8bbcf)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:40.000747 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0134d0-8531-4895-93cd-d53ccb30c7b1 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:40.179809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3b0134d0-8531-4895-93cd-d53ccb30c7b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0236d117e89641108b65e6d294a8bbcf'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:40.180426 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3b0134d0-8531-4895-93cd-d53ccb30c7b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0236d117e89641108b65e6d294a8bbcf'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:40.181028 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3b0134d0-8531-4895-93cd-d53ccb30c7b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0236d117e89641108b65e6d294a8bbcf'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:40.192817 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3b0134d0-8531-4895-93cd-d53ccb30c7b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0236d117e89641108b65e6d294a8bbcf'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:40.199882 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3b0134d0-8531-4895-93cd-d53ccb30c7b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0236d117e89641108b65e6d294a8bbcf'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:40.297579 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1374/2756] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:59:39 2022] DELETE /identity/v3/users/0236d117e89641108b65e6d294a8bbcf => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:40.302056 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c502b72-3380-4a52-8b57-508cb85853c4 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:40.302343 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c502b72-3380-4a52-8b57-508cb85853c4 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:40.302619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c502b72-3380-4a52-8b57-508cb85853c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:40.319579 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-6c502b72-3380-4a52-8b57-508cb85853c4 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:40.320862 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6c502b72-3380-4a52-8b57-508cb85853c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:40.378689 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1383/2757] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:59:40.388325 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0134d0-8531-4895-93cd-d53ccb30c7b1 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:40.389827 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3b0134d0-8531-4895-93cd-d53ccb30c7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:40.442909 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:40.450194 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0134d0-8531-4895-93cd-d53ccb30c7b1 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:40.453958 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43f2c1-1967-41d3-8b99-42545948de6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:40.454633 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43f2c1-1967-41d3-8b99-42545948de6e service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:40.454913 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43f2c1-1967-41d3-8b99-42545948de6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:40.455186 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43f2c1-1967-41d3-8b99-42545948de6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:40.465265 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43f2c1-1967-41d3-8b99-42545948de6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:40.466820 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43f2c1-1967-41d3-8b99-42545948de6e service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:40.477203 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1375/2758] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:40.893278 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c502b72-3380-4a52-8b57-508cb85853c4 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:40.894685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6c502b72-3380-4a52-8b57-508cb85853c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:40.909728 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c502b72-3380-4a52-8b57-508cb85853c4 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:40.916289 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ed81f-8f6e-479f-9cf1-f066bee8959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:40.917076 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ed81f-8f6e-479f-9cf1-f066bee8959c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:40.917342 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ed81f-8f6e-479f-9cf1-f066bee8959c admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:40.917622 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ed81f-8f6e-479f-9cf1-f066bee8959c admin admin] PATH_INFO: `/v3/projects/4877d3610bf244e9a2f1723e671cb636` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:40.918890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ed81f-8f6e-479f-9cf1-f066bee8959c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4877d3610bf244e9a2f1723e671cb636)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:40.920802 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ed81f-8f6e-479f-9cf1-f066bee8959c admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:41.019231 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:41.034583 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-482ed81f-8f6e-479f-9cf1-f066bee8959c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4877d3610bf244e9a2f1723e671cb636', 'request_id': 'req-482ed81f-8f6e-479f-9cf1-f066bee8959c'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:41.040761 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-482ed81f-8f6e-479f-9cf1-f066bee8959c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4877d3610bf244e9a2f1723e671cb636', 'request_id': 'req-482ed81f-8f6e-479f-9cf1-f066bee8959c'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:41.105322 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-482ed81f-8f6e-479f-9cf1-f066bee8959c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4877d3610bf244e9a2f1723e671cb636', 'request_id': 'req-482ed81f-8f6e-479f-9cf1-f066bee8959c'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:41.116442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-482ed81f-8f6e-479f-9cf1-f066bee8959c admin admin] The token cache is being invalidate because project 4877d3610bf244e9a2f1723e671cb636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:59:41.116759 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-482ed81f-8f6e-479f-9cf1-f066bee8959c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:41.117374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-482ed81f-8f6e-479f-9cf1-f066bee8959c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:41.119040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1384/2759] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:59:40 2022] DELETE /identity/v3/projects/4877d3610bf244e9a2f1723e671cb636 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:41.123327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43f2c1-1967-41d3-8b99-42545948de6e service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:41.132759 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43f2c1-1967-41d3-8b99-42545948de6e service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:41.188574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12460688-1f9d-4b27-a641-abe9b6422f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:41.189511 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12460688-1f9d-4b27-a641-abe9b6422f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:41.189792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12460688-1f9d-4b27-a641-abe9b6422f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:41.190069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12460688-1f9d-4b27-a641-abe9b6422f50 admin admin] PATH_INFO: `/v3/users/e5b0d9e41b6d475ea4ca1843a8ca5363` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:41.191266 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12460688-1f9d-4b27-a641-abe9b6422f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5b0d9e41b6d475ea4ca1843a8ca5363)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:41.193240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12460688-1f9d-4b27-a641-abe9b6422f50 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:41.367654 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-12460688-1f9d-4b27-a641-abe9b6422f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5b0d9e41b6d475ea4ca1843a8ca5363'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:41.368230 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-12460688-1f9d-4b27-a641-abe9b6422f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5b0d9e41b6d475ea4ca1843a8ca5363'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:41.368852 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-12460688-1f9d-4b27-a641-abe9b6422f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5b0d9e41b6d475ea4ca1843a8ca5363'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:41.380811 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-12460688-1f9d-4b27-a641-abe9b6422f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5b0d9e41b6d475ea4ca1843a8ca5363'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:41.388347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-12460688-1f9d-4b27-a641-abe9b6422f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5b0d9e41b6d475ea4ca1843a8ca5363'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:41.577810 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1376/2760] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:59:41 2022] DELETE /identity/v3/users/e5b0d9e41b6d475ea4ca1843a8ca5363 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:41.951878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ed81f-8f6e-479f-9cf1-f066bee8959c admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:41.954286 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-482ed81f-8f6e-479f-9cf1-f066bee8959c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:41.970670 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ed81f-8f6e-479f-9cf1-f066bee8959c admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:42.028727 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e38d92-e219-4a74-843b-2290ced80d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:42.029586 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e38d92-e219-4a74-843b-2290ced80d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:42.029869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e38d92-e219-4a74-843b-2290ced80d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:42.030145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e38d92-e219-4a74-843b-2290ced80d68 admin admin] PATH_INFO: `/v3/projects/51b6b6b83edf4f8b803a4a68a2d67f8d` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:42.031304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e38d92-e219-4a74-843b-2290ced80d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51b6b6b83edf4f8b803a4a68a2d67f8d)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:42.033297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e38d92-e219-4a74-843b-2290ced80d68 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:42.155253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-26e38d92-e219-4a74-843b-2290ced80d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51b6b6b83edf4f8b803a4a68a2d67f8d', 'request_id': 'req-26e38d92-e219-4a74-843b-2290ced80d68'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:42.160896 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-26e38d92-e219-4a74-843b-2290ced80d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51b6b6b83edf4f8b803a4a68a2d67f8d', 'request_id': 'req-26e38d92-e219-4a74-843b-2290ced80d68'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:42.220010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-26e38d92-e219-4a74-843b-2290ced80d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51b6b6b83edf4f8b803a4a68a2d67f8d', 'request_id': 'req-26e38d92-e219-4a74-843b-2290ced80d68'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:42.231512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-26e38d92-e219-4a74-843b-2290ced80d68 admin admin] The token cache is being invalidate because project 51b6b6b83edf4f8b803a4a68a2d67f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:59:42.231834 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-26e38d92-e219-4a74-843b-2290ced80d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:42.232472 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-26e38d92-e219-4a74-843b-2290ced80d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:42.234866 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1385/2761] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:59:41 2022] DELETE /identity/v3/projects/51b6b6b83edf4f8b803a4a68a2d67f8d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:59:42.241699 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8c744-a1f7-4e30-905f-d3d2c25c225d None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:42.242179 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8c744-a1f7-4e30-905f-d3d2c25c225d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:42.242274 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8c744-a1f7-4e30-905f-d3d2c25c225d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:42.260767 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-b2f8c744-a1f7-4e30-905f-d3d2c25c225d None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:42.261961 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b2f8c744-a1f7-4e30-905f-d3d2c25c225d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:42.319115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1377/2762] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:42.328038 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184a5aa-8d71-4240-98e7-dc6896502707 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:42.328038 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184a5aa-8d71-4240-98e7-dc6896502707 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:42.328038 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184a5aa-8d71-4240-98e7-dc6896502707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:42.346621 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-e184a5aa-8d71-4240-98e7-dc6896502707 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:42.347846 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e184a5aa-8d71-4240-98e7-dc6896502707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:42.355787 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1386/2763] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:42.361187 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8c744-a1f7-4e30-905f-d3d2c25c225d None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:42.371819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8c744-a1f7-4e30-905f-d3d2c25c225d None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:42.376455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb82036-0d5f-4e35-b978-9206b396628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:42.377140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb82036-0d5f-4e35-b978-9206b396628c admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:42.377450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb82036-0d5f-4e35-b978-9206b396628c admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:42.377726 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb82036-0d5f-4e35-b978-9206b396628c admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:42.378450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb82036-0d5f-4e35-b978-9206b396628c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:59:42.378759 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb82036-0d5f-4e35-b978-9206b396628c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:42.380358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb82036-0d5f-4e35-b978-9206b396628c admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:42.382712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:42.392744 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1378/2764] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:59:42.396865 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184a5aa-8d71-4240-98e7-dc6896502707 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:42.406073 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184a5aa-8d71-4240-98e7-dc6896502707 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:42.410767 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12818f-c757-4575-8655-d4e60757bf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:42.411419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12818f-c757-4575-8655-d4e60757bf3a admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:42.411702 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12818f-c757-4575-8655-d4e60757bf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:42.411981 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12818f-c757-4575-8655-d4e60757bf3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:42.412713 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce12818f-c757-4575-8655-d4e60757bf3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:42.414792 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce12818f-c757-4575-8655-d4e60757bf3a admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:42.507427 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1387/2765] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:59:42 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:42.512130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb82036-0d5f-4e35-b978-9206b396628c admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:42.521965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb82036-0d5f-4e35-b978-9206b396628c admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:42.579505 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245306b-03d0-49e0-9a27-8145bdafc12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:42.580207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245306b-03d0-49e0-9a27-8145bdafc12a admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:42.580492 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245306b-03d0-49e0-9a27-8145bdafc12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:42.580800 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245306b-03d0-49e0-9a27-8145bdafc12a admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:42.581494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245306b-03d0-49e0-9a27-8145bdafc12a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:42.583411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245306b-03d0-49e0-9a27-8145bdafc12a admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:42.659767 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1379/2766] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:59:42 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:42.663788 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12818f-c757-4575-8655-d4e60757bf3a admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:42.674611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12818f-c757-4575-8655-d4e60757bf3a admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:42.679293 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60217ae-7082-4bf7-838e-f2f2f62119a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:42.680512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60217ae-7082-4bf7-838e-f2f2f62119a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:42.680831 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60217ae-7082-4bf7-838e-f2f2f62119a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:42.681117 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60217ae-7082-4bf7-838e-f2f2f62119a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:42.681875 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60217ae-7082-4bf7-838e-f2f2f62119a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:42.683476 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60217ae-7082-4bf7-838e-f2f2f62119a2 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:42.693671 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1388/2767] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:42.697382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245306b-03d0-49e0-9a27-8145bdafc12a admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:42.707024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245306b-03d0-49e0-9a27-8145bdafc12a admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:42.711536 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4d15e-e0e2-4794-823b-22815edb30f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:42.712178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4d15e-e0e2-4794-823b-22815edb30f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:42.712457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4d15e-e0e2-4794-823b-22815edb30f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:42.712766 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4d15e-e0e2-4794-823b-22815edb30f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:42.713476 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4d15e-e0e2-4794-823b-22815edb30f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:42.715043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4d15e-e0e2-4794-823b-22815edb30f4 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:42.724701 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1380/2768] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:42.729279 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60217ae-7082-4bf7-838e-f2f2f62119a2 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:42.738911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60217ae-7082-4bf7-838e-f2f2f62119a2 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:42.744541 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f9384-3f49-499e-bf4b-c38b533d25b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:42.745460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f9384-3f49-499e-bf4b-c38b533d25b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:42.745749 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f9384-3f49-499e-bf4b-c38b533d25b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:42.746030 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f9384-3f49-499e-bf4b-c38b533d25b5 admin admin] PATH_INFO: `/v3/projects/97b68d4b4017451bbc945fbf9199d722/users/9c36cb967d9a4df1b4b155322ccc9cda/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:42.749189 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:42.760709 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f9384-3f49-499e-bf4b-c38b533d25b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b68d4b4017451bbc945fbf9199d722, user_id=9c36cb967d9a4df1b4b155322ccc9cda, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:42.763265 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f9384-3f49-499e-bf4b-c38b533d25b5 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:42.859591 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1389/2769] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:42 2022] PUT /identity/v3/projects/97b68d4b4017451bbc945fbf9199d722/users/9c36cb967d9a4df1b4b155322ccc9cda/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:42.871822 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a000b76-4bd9-4be3-a26e-8dfcc7d77e92 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:42.872109 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a000b76-4bd9-4be3-a26e-8dfcc7d77e92 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:42.872387 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a000b76-4bd9-4be3-a26e-8dfcc7d77e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:42.898279 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-2a000b76-4bd9-4be3-a26e-8dfcc7d77e92 None None] MFA Rules not processed for user `9c36cb967d9a4df1b4b155322ccc9cda`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:42.899567 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2a000b76-4bd9-4be3-a26e-8dfcc7d77e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:42.962416 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1381/2770] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:42.973456 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f9384-3f49-499e-bf4b-c38b533d25b5 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:42.979348 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-829f9384-3f49-499e-bf4b-c38b533d25b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:43.036026 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f9384-3f49-499e-bf4b-c38b533d25b5 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:43.039714 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b95204-b2ab-4ba7-9248-b099c1f09005 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:43.040367 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b95204-b2ab-4ba7-9248-b099c1f09005 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:43.040697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b95204-b2ab-4ba7-9248-b099c1f09005 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:43.040979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b95204-b2ab-4ba7-9248-b099c1f09005 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:43.050338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b95204-b2ab-4ba7-9248-b099c1f09005 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:43.051785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b95204-b2ab-4ba7-9248-b099c1f09005 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:43.060637 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1390/2771] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:43.079205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a000b76-4bd9-4be3-a26e-8dfcc7d77e92 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:43.140841 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a000b76-4bd9-4be3-a26e-8dfcc7d77e92 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:43.145552 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498f273-e124-4bd1-8d62-f8a09c31441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:43.146422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498f273-e124-4bd1-8d62-f8a09c31441a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:43.146703 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498f273-e124-4bd1-8d62-f8a09c31441a admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:43.146979 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498f273-e124-4bd1-8d62-f8a09c31441a admin admin] PATH_INFO: `/v3/users/9c36cb967d9a4df1b4b155322ccc9cda` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:43.148164 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498f273-e124-4bd1-8d62-f8a09c31441a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c36cb967d9a4df1b4b155322ccc9cda)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:43.150721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498f273-e124-4bd1-8d62-f8a09c31441a admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:43.155137 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:43.330139 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-5498f273-e124-4bd1-8d62-f8a09c31441a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c36cb967d9a4df1b4b155322ccc9cda'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:43.330762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-5498f273-e124-4bd1-8d62-f8a09c31441a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c36cb967d9a4df1b4b155322ccc9cda'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:43.331390 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-5498f273-e124-4bd1-8d62-f8a09c31441a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c36cb967d9a4df1b4b155322ccc9cda'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:43.343869 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-5498f273-e124-4bd1-8d62-f8a09c31441a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c36cb967d9a4df1b4b155322ccc9cda'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:43.350560 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-5498f273-e124-4bd1-8d62-f8a09c31441a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c36cb967d9a4df1b4b155322ccc9cda'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:43.466035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1382/2772] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 21:59:43 2022] DELETE /identity/v3/users/9c36cb967d9a4df1b4b155322ccc9cda => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:43.470608 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076453a5-d377-424c-8181-4db8dc1875cc None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:43.472252 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076453a5-d377-424c-8181-4db8dc1875cc None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:43.472252 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076453a5-d377-424c-8181-4db8dc1875cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:43.488358 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-076453a5-d377-424c-8181-4db8dc1875cc None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:43.489600 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-076453a5-d377-424c-8181-4db8dc1875cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:43.547822 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1391/2773] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:43.558101 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498f273-e124-4bd1-8d62-f8a09c31441a admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:43.560662 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-5498f273-e124-4bd1-8d62-f8a09c31441a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:43.625264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498f273-e124-4bd1-8d62-f8a09c31441a admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:43.628846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c895660-ce6a-438e-ab39-27b578a5e072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:43.629495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c895660-ce6a-438e-ab39-27b578a5e072 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:43.629777 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c895660-ce6a-438e-ab39-27b578a5e072 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:43.630050 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c895660-ce6a-438e-ab39-27b578a5e072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:43.638846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c895660-ce6a-438e-ab39-27b578a5e072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:43.640277 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c895660-ce6a-438e-ab39-27b578a5e072 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:43.649585 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1383/2774] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:44.055866 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076453a5-d377-424c-8181-4db8dc1875cc None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:44.059938 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-076453a5-d377-424c-8181-4db8dc1875cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:44.069440 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076453a5-d377-424c-8181-4db8dc1875cc None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:44.074147 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a1749-23bb-497e-a601-474211827e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:44.075022 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a1749-23bb-497e-a601-474211827e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:44.075305 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a1749-23bb-497e-a601-474211827e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:44.075585 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a1749-23bb-497e-a601-474211827e7e admin admin] PATH_INFO: `/v3/projects/97b68d4b4017451bbc945fbf9199d722` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:44.077225 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a1749-23bb-497e-a601-474211827e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b68d4b4017451bbc945fbf9199d722)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:44.079717 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a1749-23bb-497e-a601-474211827e7e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:44.215033 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-260a1749-23bb-497e-a601-474211827e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b68d4b4017451bbc945fbf9199d722', 'request_id': 'req-260a1749-23bb-497e-a601-474211827e7e'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:44.220476 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-260a1749-23bb-497e-a601-474211827e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b68d4b4017451bbc945fbf9199d722', 'request_id': 'req-260a1749-23bb-497e-a601-474211827e7e'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:44.297690 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-260a1749-23bb-497e-a601-474211827e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b68d4b4017451bbc945fbf9199d722', 'request_id': 'req-260a1749-23bb-497e-a601-474211827e7e'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:44.308919 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-260a1749-23bb-497e-a601-474211827e7e admin admin] The token cache is being invalidate because project 97b68d4b4017451bbc945fbf9199d722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:59:44.309207 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-260a1749-23bb-497e-a601-474211827e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:44.309831 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-260a1749-23bb-497e-a601-474211827e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:59:44.311386 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1392/2775] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 21:59:44 2022] DELETE /identity/v3/projects/97b68d4b4017451bbc945fbf9199d722 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:59:44.316178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d4215-7bcd-4591-b4ff-a50b9ae1626d None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:44.318526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d4215-7bcd-4591-b4ff-a50b9ae1626d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:44.318526 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d4215-7bcd-4591-b4ff-a50b9ae1626d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:44.335115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-587d4215-7bcd-4591-b4ff-a50b9ae1626d None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:44.336952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-587d4215-7bcd-4591-b4ff-a50b9ae1626d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:44.394545 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1384/2776] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:44.402800 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e29126-36c9-4801-ba36-890a61cd1ecc None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:44.403082 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e29126-36c9-4801-ba36-890a61cd1ecc None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:44.403352 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e29126-36c9-4801-ba36-890a61cd1ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:44.421063 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-71e29126-36c9-4801-ba36-890a61cd1ecc None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:44.422243 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-71e29126-36c9-4801-ba36-890a61cd1ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:44.433762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1393/2777] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:44.437600 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d4215-7bcd-4591-b4ff-a50b9ae1626d None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:44.448267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d4215-7bcd-4591-b4ff-a50b9ae1626d None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:44.453123 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e769e72-94d4-4a87-8872-b3357fb6f79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:44.453851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e769e72-94d4-4a87-8872-b3357fb6f79d admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:44.454145 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e769e72-94d4-4a87-8872-b3357fb6f79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:44.454417 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e769e72-94d4-4a87-8872-b3357fb6f79d admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:44.455146 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e769e72-94d4-4a87-8872-b3357fb6f79d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:59:44.455460 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e769e72-94d4-4a87-8872-b3357fb6f79d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:44.457150 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e769e72-94d4-4a87-8872-b3357fb6f79d admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:44.469768 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1385/2778] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 21:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:59:44.474051 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e29126-36c9-4801-ba36-890a61cd1ecc None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:44.479712 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:44.484656 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e29126-36c9-4801-ba36-890a61cd1ecc None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:44.488138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da075987-866a-43b2-9f4a-9005e73e899d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:44.488816 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da075987-866a-43b2-9f4a-9005e73e899d admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:44.489101 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da075987-866a-43b2-9f4a-9005e73e899d admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:44.489377 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da075987-866a-43b2-9f4a-9005e73e899d admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:44.490074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da075987-866a-43b2-9f4a-9005e73e899d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:44.491959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da075987-866a-43b2-9f4a-9005e73e899d admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:44.627690 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1394/2779] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 21:59:44 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:44.631859 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e769e72-94d4-4a87-8872-b3357fb6f79d admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:44.642603 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e769e72-94d4-4a87-8872-b3357fb6f79d admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:44.651202 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:44.697138 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbedfeb-97eb-4402-a65e-a4f20115cfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:44.697803 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbedfeb-97eb-4402-a65e-a4f20115cfd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:44.698090 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbedfeb-97eb-4402-a65e-a4f20115cfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:44.698388 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbedfeb-97eb-4402-a65e-a4f20115cfd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:44.699082 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbedfeb-97eb-4402-a65e-a4f20115cfd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:44.701012 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbedfeb-97eb-4402-a65e-a4f20115cfd6 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:44.779862 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1386/2780] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 21:59:44 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:59:44.784282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da075987-866a-43b2-9f4a-9005e73e899d admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:44.794597 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da075987-866a-43b2-9f4a-9005e73e899d admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:44.799227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634c5b7-c227-41c8-9bf4-3a6fc75af734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:44.799888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634c5b7-c227-41c8-9bf4-3a6fc75af734 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:44.800170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634c5b7-c227-41c8-9bf4-3a6fc75af734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:44.800448 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634c5b7-c227-41c8-9bf4-3a6fc75af734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:44.801200 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634c5b7-c227-41c8-9bf4-3a6fc75af734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:44.802849 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634c5b7-c227-41c8-9bf4-3a6fc75af734 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:44.813167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1395/2781] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:44.817104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbedfeb-97eb-4402-a65e-a4f20115cfd6 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:44.827520 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbedfeb-97eb-4402-a65e-a4f20115cfd6 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:44.832100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e5eb4-a158-4927-a3a0-80a045f39748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:44.832790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5eb4-a158-4927-a3a0-80a045f39748 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:44.833073 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5eb4-a158-4927-a3a0-80a045f39748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:44.833371 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5eb4-a158-4927-a3a0-80a045f39748 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:44.834093 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e5eb4-a158-4927-a3a0-80a045f39748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:44.835708 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e5eb4-a158-4927-a3a0-80a045f39748 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:44.845344 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1387/2782] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 21:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:59:44.849428 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634c5b7-c227-41c8-9bf4-3a6fc75af734 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:44.859441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634c5b7-c227-41c8-9bf4-3a6fc75af734 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:44.864130 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b5de9-a232-48e5-a492-0cc49c61a9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:44.865036 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b5de9-a232-48e5-a492-0cc49c61a9d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:44.865317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b5de9-a232-48e5-a492-0cc49c61a9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:44.865591 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b5de9-a232-48e5-a492-0cc49c61a9d2 admin admin] PATH_INFO: `/v3/projects/30a9e54298074a898f6f0847ba971dcc/users/7c3dbc28756443d6aa1329f207468e35/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:44.880428 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b5de9-a232-48e5-a492-0cc49c61a9d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a9e54298074a898f6f0847ba971dcc, user_id=7c3dbc28756443d6aa1329f207468e35, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:44.883720 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b5de9-a232-48e5-a492-0cc49c61a9d2 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:44.957017 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1396/2783] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 21:59:44 2022] PUT /identity/v3/projects/30a9e54298074a898f6f0847ba971dcc/users/7c3dbc28756443d6aa1329f207468e35/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:59:44.970954 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc6ee2-9603-49bd-9b04-531e8dcb18a4 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:44.971246 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc6ee2-9603-49bd-9b04-531e8dcb18a4 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:44.971530 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc6ee2-9603-49bd-9b04-531e8dcb18a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:44.998188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-20cc6ee2-9603-49bd-9b04-531e8dcb18a4 None None] MFA Rules not processed for user `7c3dbc28756443d6aa1329f207468e35`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:59:45.000061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-20cc6ee2-9603-49bd-9b04-531e8dcb18a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:45.063190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1388/2784] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 21:59:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:59:45.074650 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b5de9-a232-48e5-a492-0cc49c61a9d2 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:59:45.077788 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-289b5de9-a232-48e5-a492-0cc49c61a9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:59:45.154551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b5de9-a232-48e5-a492-0cc49c61a9d2 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:59:45.158279 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e056d98-b6e7-4609-81ac-d4fe758a8f19 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdb2d75e4025a5d73ea713c690b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:59:45.158922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e056d98-b6e7-4609-81ac-d4fe758a8f19 service glance] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:59:45.159209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e056d98-b6e7-4609-81ac-d4fe758a8f19 service glance] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:59:45.159491 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e056d98-b6e7-4609-81ac-d4fe758a8f19 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:59:45.168209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e056d98-b6e7-4609-81ac-d4fe758a8f19 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:59:45.169655 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e056d98-b6e7-4609-81ac-d4fe758a8f19 service glance] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:59:45.178589 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1397/2785] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 21:59:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:59:55.060270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=60,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:55.174374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=57,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:00:10.757135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc6ee2-9603-49bd-9b04-531e8dcb18a4 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:00:10.758582 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-20cc6ee2-9603-49bd-9b04-531e8dcb18a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:00:10.822531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc6ee2-9603-49bd-9b04-531e8dcb18a4 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:00:10.827394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c005ff4-2178-41f8-89dc-99bec3c89664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:00:10.828351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c005ff4-2178-41f8-89dc-99bec3c89664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:00:10.828670 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c005ff4-2178-41f8-89dc-99bec3c89664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:00:10.828953 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c005ff4-2178-41f8-89dc-99bec3c89664 admin admin] PATH_INFO: `/v3/users/fc719e0374514ab2b2b3a1affcdedf16` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:00:10.830178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c005ff4-2178-41f8-89dc-99bec3c89664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc719e0374514ab2b2b3a1affcdedf16)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:00:10.832114 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c005ff4-2178-41f8-89dc-99bec3c89664 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:00:10.965099 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-0c005ff4-2178-41f8-89dc-99bec3c89664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc719e0374514ab2b2b3a1affcdedf16'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:10.965748 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-0c005ff4-2178-41f8-89dc-99bec3c89664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc719e0374514ab2b2b3a1affcdedf16'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:10.966369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-0c005ff4-2178-41f8-89dc-99bec3c89664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc719e0374514ab2b2b3a1affcdedf16'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:10.978371 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-0c005ff4-2178-41f8-89dc-99bec3c89664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc719e0374514ab2b2b3a1affcdedf16'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:10.984988 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-0c005ff4-2178-41f8-89dc-99bec3c89664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc719e0374514ab2b2b3a1affcdedf16'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:11.055302 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1389/2786] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 22:00:10 2022] DELETE /identity/v3/users/fc719e0374514ab2b2b3a1affcdedf16 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:00:11.059989 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850a7f9-8b82-4058-b36d-42cecadbc225 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:00:11.060445 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850a7f9-8b82-4058-b36d-42cecadbc225 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:00:11.060661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850a7f9-8b82-4058-b36d-42cecadbc225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:00:11.079495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-f850a7f9-8b82-4058-b36d-42cecadbc225 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:00:11.080718 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f850a7f9-8b82-4058-b36d-42cecadbc225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:00:11.141248 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1398/2787] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:00:11.150775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c005ff4-2178-41f8-89dc-99bec3c89664 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:00:11.152183 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-0c005ff4-2178-41f8-89dc-99bec3c89664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:00:11.209267 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c005ff4-2178-41f8-89dc-99bec3c89664 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:00:11.213033 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00c588-204f-4d65-9193-1435b4081c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:00:11.213699 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00c588-204f-4d65-9193-1435b4081c68 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:00:11.213977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00c588-204f-4d65-9193-1435b4081c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:00:11.214256 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00c588-204f-4d65-9193-1435b4081c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:00:11.223336 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00c588-204f-4d65-9193-1435b4081c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:00:11.224781 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00c588-204f-4d65-9193-1435b4081c68 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:00:11.234103 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1390/2788] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:00:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:00:11.605287 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850a7f9-8b82-4058-b36d-42cecadbc225 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:00:11.606743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f850a7f9-8b82-4058-b36d-42cecadbc225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:00:11.620943 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850a7f9-8b82-4058-b36d-42cecadbc225 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:00:11.625924 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25571f-a255-4f8c-a429-e26be9c60865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:00:11.626826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25571f-a255-4f8c-a429-e26be9c60865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:00:11.627109 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25571f-a255-4f8c-a429-e26be9c60865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:00:11.627385 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25571f-a255-4f8c-a429-e26be9c60865 admin admin] PATH_INFO: `/v3/projects/75d650569d16475fb8eb0a35a3d57f9a` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:00:11.628664 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25571f-a255-4f8c-a429-e26be9c60865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d650569d16475fb8eb0a35a3d57f9a)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:00:11.630584 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25571f-a255-4f8c-a429-e26be9c60865 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:00:11.727039 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-8e25571f-a255-4f8c-a429-e26be9c60865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d650569d16475fb8eb0a35a3d57f9a', 'request_id': 'req-8e25571f-a255-4f8c-a429-e26be9c60865'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:11.732332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-8e25571f-a255-4f8c-a429-e26be9c60865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d650569d16475fb8eb0a35a3d57f9a', 'request_id': 'req-8e25571f-a255-4f8c-a429-e26be9c60865'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:11.812262 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-8e25571f-a255-4f8c-a429-e26be9c60865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d650569d16475fb8eb0a35a3d57f9a', 'request_id': 'req-8e25571f-a255-4f8c-a429-e26be9c60865'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:11.823888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-8e25571f-a255-4f8c-a429-e26be9c60865 admin admin] The token cache is being invalidate because project 75d650569d16475fb8eb0a35a3d57f9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 22:00:11.824179 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-8e25571f-a255-4f8c-a429-e26be9c60865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:11.824836 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-8e25571f-a255-4f8c-a429-e26be9c60865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:11.826468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1399/2789] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 22:00:11 2022] DELETE /identity/v3/projects/75d650569d16475fb8eb0a35a3d57f9a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:00:21.229898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:00:21.820595 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:00:30.055777 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00c588-204f-4d65-9193-1435b4081c68 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:00:30.057232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3e00c588-204f-4d65-9193-1435b4081c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:00:30.071785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00c588-204f-4d65-9193-1435b4081c68 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:00:30.134175 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e0563-4537-44a9-a2de-6a7025803c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:00:30.135091 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e0563-4537-44a9-a2de-6a7025803c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:00:30.135379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e0563-4537-44a9-a2de-6a7025803c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:00:30.135661 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e0563-4537-44a9-a2de-6a7025803c22 admin admin] PATH_INFO: `/v3/users/7c3dbc28756443d6aa1329f207468e35` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:00:30.136890 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e0563-4537-44a9-a2de-6a7025803c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c3dbc28756443d6aa1329f207468e35)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:00:30.138825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e0563-4537-44a9-a2de-6a7025803c22 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:00:30.272397 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-fa7e0563-4537-44a9-a2de-6a7025803c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c3dbc28756443d6aa1329f207468e35'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:30.273063 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-fa7e0563-4537-44a9-a2de-6a7025803c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c3dbc28756443d6aa1329f207468e35'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:30.273658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-fa7e0563-4537-44a9-a2de-6a7025803c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c3dbc28756443d6aa1329f207468e35'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:30.286378 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-fa7e0563-4537-44a9-a2de-6a7025803c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c3dbc28756443d6aa1329f207468e35'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:30.293382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-fa7e0563-4537-44a9-a2de-6a7025803c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c3dbc28756443d6aa1329f207468e35'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:30.378510 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1391/2790] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 22:00:30 2022] DELETE /identity/v3/users/7c3dbc28756443d6aa1329f207468e35 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:00:30.383075 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e895fd6-c37a-414f-9547-d7dfe292c80b None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:00:30.383568 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e895fd6-c37a-414f-9547-d7dfe292c80b None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:00:30.383670 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e895fd6-c37a-414f-9547-d7dfe292c80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:00:30.404095 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-4e895fd6-c37a-414f-9547-d7dfe292c80b None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:00:30.405337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4e895fd6-c37a-414f-9547-d7dfe292c80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:00:30.463614 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1400/2791] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:00:30.473831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e0563-4537-44a9-a2de-6a7025803c22 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:00:30.475251 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-fa7e0563-4537-44a9-a2de-6a7025803c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:00:30.543590 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e0563-4537-44a9-a2de-6a7025803c22 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:00:30.547133 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ffbb7-7685-4fcc-8588-e93106088787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:00:30.547772 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ffbb7-7685-4fcc-8588-e93106088787 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:00:30.548054 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ffbb7-7685-4fcc-8588-e93106088787 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:00:30.548331 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ffbb7-7685-4fcc-8588-e93106088787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:00:30.559100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ffbb7-7685-4fcc-8588-e93106088787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:00:30.560528 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ffbb7-7685-4fcc-8588-e93106088787 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:00:30.570455 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1392/2792] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:00:30.962877 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e895fd6-c37a-414f-9547-d7dfe292c80b None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:00:30.964297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4e895fd6-c37a-414f-9547-d7dfe292c80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:00:30.976778 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e895fd6-c37a-414f-9547-d7dfe292c80b None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:00:30.981397 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c698c4a-e478-44e6-a68f-450b0e6d50ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:00:30.982269 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c698c4a-e478-44e6-a68f-450b0e6d50ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:00:30.982547 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c698c4a-e478-44e6-a68f-450b0e6d50ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:00:30.982820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c698c4a-e478-44e6-a68f-450b0e6d50ef admin admin] PATH_INFO: `/v3/projects/30a9e54298074a898f6f0847ba971dcc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:00:30.984462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c698c4a-e478-44e6-a68f-450b0e6d50ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a9e54298074a898f6f0847ba971dcc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:00:30.985974 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c698c4a-e478-44e6-a68f-450b0e6d50ef admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:00:31.117447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0c698c4a-e478-44e6-a68f-450b0e6d50ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a9e54298074a898f6f0847ba971dcc', 'request_id': 'req-0c698c4a-e478-44e6-a68f-450b0e6d50ef'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:31.123605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0c698c4a-e478-44e6-a68f-450b0e6d50ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a9e54298074a898f6f0847ba971dcc', 'request_id': 'req-0c698c4a-e478-44e6-a68f-450b0e6d50ef'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:31.204511 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0c698c4a-e478-44e6-a68f-450b0e6d50ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a9e54298074a898f6f0847ba971dcc', 'request_id': 'req-0c698c4a-e478-44e6-a68f-450b0e6d50ef'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:31.216197 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0c698c4a-e478-44e6-a68f-450b0e6d50ef admin admin] The token cache is being invalidate because project 30a9e54298074a898f6f0847ba971dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 22:00:31.216488 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0c698c4a-e478-44e6-a68f-450b0e6d50ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:31.217144 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0c698c4a-e478-44e6-a68f-450b0e6d50ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:00:31.218693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1401/2793] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 22:00:30 2022] DELETE /identity/v3/projects/30a9e54298074a898f6f0847ba971dcc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:00:40.566294 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:00:41.213062 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:02.407991 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ffbb7-7685-4fcc-8588-e93106088787 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:02.409426 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-117ffbb7-7685-4fcc-8588-e93106088787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:02.465600 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ffbb7-7685-4fcc-8588-e93106088787 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:02.512736 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058c929-c4ec-439b-9fc6-440e21ee01b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:02.513379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058c929-c4ec-439b-9fc6-440e21ee01b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:02.513658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058c929-c4ec-439b-9fc6-440e21ee01b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:02.513931 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058c929-c4ec-439b-9fc6-440e21ee01b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:02.515693 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3058c929-c4ec-439b-9fc6-440e21ee01b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:02.584032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058c929-c4ec-439b-9fc6-440e21ee01b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:02.585450 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058c929-c4ec-439b-9fc6-440e21ee01b5 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:02.597003 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1393/2794] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:01:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:01:10.881182 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c698c4a-e478-44e6-a68f-450b0e6d50ef admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:10.882641 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0c698c4a-e478-44e6-a68f-450b0e6d50ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:10.895304 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c698c4a-e478-44e6-a68f-450b0e6d50ef admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:10.898994 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2846ae-c440-4a24-8ae8-dbbd7f76397b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:10.899634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2846ae-c440-4a24-8ae8-dbbd7f76397b service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:10.899920 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2846ae-c440-4a24-8ae8-dbbd7f76397b service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:10.900202 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2846ae-c440-4a24-8ae8-dbbd7f76397b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:10.902075 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0b2846ae-c440-4a24-8ae8-dbbd7f76397b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:10.915062 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2846ae-c440-4a24-8ae8-dbbd7f76397b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:10.916479 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2846ae-c440-4a24-8ae8-dbbd7f76397b service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:10.927422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1402/2795] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:01:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 22:01:12.591975 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=74 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:20.922599 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=6 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:22.471964 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058c929-c4ec-439b-9fc6-440e21ee01b5 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:22.473537 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-3058c929-c4ec-439b-9fc6-440e21ee01b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:22.529164 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058c929-c4ec-439b-9fc6-440e21ee01b5 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:22.533440 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966caf0-c64e-447f-8510-94ac02f8d2c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:22.534079 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966caf0-c64e-447f-8510-94ac02f8d2c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:22.534358 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966caf0-c64e-447f-8510-94ac02f8d2c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:22.534628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966caf0-c64e-447f-8510-94ac02f8d2c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:22.536369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-8966caf0-c64e-447f-8510-94ac02f8d2c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:22.599507 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966caf0-c64e-447f-8510-94ac02f8d2c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:22.601006 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966caf0-c64e-447f-8510-94ac02f8d2c0 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:22.610798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1394/2796] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:01:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:01:26.127155 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2846ae-c440-4a24-8ae8-dbbd7f76397b service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:26.128809 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0b2846ae-c440-4a24-8ae8-dbbd7f76397b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:26.144493 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2846ae-c440-4a24-8ae8-dbbd7f76397b service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:26.149357 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5c68e-3dff-44a1-9353-1f515c48f4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:26.152121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5c68e-3dff-44a1-9353-1f515c48f4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:26.152121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5c68e-3dff-44a1-9353-1f515c48f4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:26.152121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5c68e-3dff-44a1-9353-1f515c48f4ac admin admin] PATH_INFO: `/v3/users/46e692bef3e3484ebac5d1563e489e03` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:26.152121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5c68e-3dff-44a1-9353-1f515c48f4ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e692bef3e3484ebac5d1563e489e03)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:26.153842 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5c68e-3dff-44a1-9353-1f515c48f4ac admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:26.327777 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0fe5c68e-3dff-44a1-9353-1f515c48f4ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e692bef3e3484ebac5d1563e489e03'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:26.399627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0fe5c68e-3dff-44a1-9353-1f515c48f4ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e692bef3e3484ebac5d1563e489e03'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:26.400245 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0fe5c68e-3dff-44a1-9353-1f515c48f4ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e692bef3e3484ebac5d1563e489e03'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:26.413390 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0fe5c68e-3dff-44a1-9353-1f515c48f4ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e692bef3e3484ebac5d1563e489e03'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:26.414030 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-0fe5c68e-3dff-44a1-9353-1f515c48f4ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e692bef3e3484ebac5d1563e489e03'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:26.426157 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1403/2797] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 22:01:26 2022] DELETE /identity/v3/users/46e692bef3e3484ebac5d1563e489e03 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:26.698497 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966caf0-c64e-447f-8510-94ac02f8d2c0 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:26.709761 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966caf0-c64e-447f-8510-94ac02f8d2c0 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:26.766810 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f86f30-40ad-4499-8564-e757318ae8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:26.768334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f86f30-40ad-4499-8564-e757318ae8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:26.768647 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f86f30-40ad-4499-8564-e757318ae8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:26.768927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f86f30-40ad-4499-8564-e757318ae8cf admin admin] PATH_INFO: `/v3/projects/4f08b4e75498402eb658938f61de1244` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:26.770151 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f86f30-40ad-4499-8564-e757318ae8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f08b4e75498402eb658938f61de1244)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:26.772058 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f86f30-40ad-4499-8564-e757318ae8cf admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:26.867951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-57f86f30-40ad-4499-8564-e757318ae8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f08b4e75498402eb658938f61de1244', 'request_id': 'req-57f86f30-40ad-4499-8564-e757318ae8cf'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:26.870682 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:26.953837 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-57f86f30-40ad-4499-8564-e757318ae8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f08b4e75498402eb658938f61de1244', 'request_id': 'req-57f86f30-40ad-4499-8564-e757318ae8cf'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:26.960084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-57f86f30-40ad-4499-8564-e757318ae8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f08b4e75498402eb658938f61de1244', 'request_id': 'req-57f86f30-40ad-4499-8564-e757318ae8cf'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:26.970542 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-57f86f30-40ad-4499-8564-e757318ae8cf admin admin] The token cache is being invalidate because project 4f08b4e75498402eb658938f61de1244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 22:01:26.970830 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-57f86f30-40ad-4499-8564-e757318ae8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:26.971463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-57f86f30-40ad-4499-8564-e757318ae8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:26.973036 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1395/2798] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 22:01:26 2022] DELETE /identity/v3/projects/4f08b4e75498402eb658938f61de1244 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:26.977878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98fa9e-639a-4eec-8b7e-441a859e3730 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:26.978173 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98fa9e-639a-4eec-8b7e-441a859e3730 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:26.978453 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98fa9e-639a-4eec-8b7e-441a859e3730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:27.033858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-3c98fa9e-639a-4eec-8b7e-441a859e3730 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:27.035043 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3c98fa9e-639a-4eec-8b7e-441a859e3730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:27.092743 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1404/2799] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:01:27.100948 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d3135-791a-4fe1-80fe-0b912f90fc0e None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:27.101245 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d3135-791a-4fe1-80fe-0b912f90fc0e None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:27.101534 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d3135-791a-4fe1-80fe-0b912f90fc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:27.119965 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-8d4d3135-791a-4fe1-80fe-0b912f90fc0e None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:27.121221 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-8d4d3135-791a-4fe1-80fe-0b912f90fc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:27.130195 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1396/2800] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:01:27.134291 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98fa9e-639a-4eec-8b7e-441a859e3730 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:27.143825 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98fa9e-639a-4eec-8b7e-441a859e3730 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:27.148352 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ae644-a517-4d39-aa52-15c3d43cd0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:27.149042 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ae644-a517-4d39-aa52-15c3d43cd0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:27.149331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ae644-a517-4d39-aa52-15c3d43cd0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:27.149611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ae644-a517-4d39-aa52-15c3d43cd0a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:27.150338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ae644-a517-4d39-aa52-15c3d43cd0a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 22:01:27.150647 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ae644-a517-4d39-aa52-15c3d43cd0a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:27.152234 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ae644-a517-4d39-aa52-15c3d43cd0a1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:27.163476 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1405/2801] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 22:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 22:01:27.167514 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d3135-791a-4fe1-80fe-0b912f90fc0e None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:27.177098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d3135-791a-4fe1-80fe-0b912f90fc0e None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:27.181740 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4163ff7-511c-4289-87dd-28e6270d0921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:27.182386 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4163ff7-511c-4289-87dd-28e6270d0921 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:27.182673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4163ff7-511c-4289-87dd-28e6270d0921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:27.182952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4163ff7-511c-4289-87dd-28e6270d0921 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:27.183646 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4163ff7-511c-4289-87dd-28e6270d0921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:27.185588 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4163ff7-511c-4289-87dd-28e6270d0921 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:27.284896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1397/2802] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 22:01:27 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:01:27.288952 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ae644-a517-4d39-aa52-15c3d43cd0a1 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:27.299426 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ae644-a517-4d39-aa52-15c3d43cd0a1 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:27.325198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:27.355914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b136b2e-749b-4745-a5e2-c3042025eec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:27.356646 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b136b2e-749b-4745-a5e2-c3042025eec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:27.356936 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b136b2e-749b-4745-a5e2-c3042025eec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:27.361536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b136b2e-749b-4745-a5e2-c3042025eec6 admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:27.361536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b136b2e-749b-4745-a5e2-c3042025eec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:27.361536 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b136b2e-749b-4745-a5e2-c3042025eec6 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:27.437118 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1406/2803] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 22:01:27 2022] POST /identity/v3/users => generated 291 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:01:27.441408 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4163ff7-511c-4289-87dd-28e6270d0921 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:27.451577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4163ff7-511c-4289-87dd-28e6270d0921 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:27.456224 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355d5b1-49e5-4b51-b8bb-1b28e7307aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:27.456948 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355d5b1-49e5-4b51-b8bb-1b28e7307aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:27.457238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355d5b1-49e5-4b51-b8bb-1b28e7307aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:27.457517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355d5b1-49e5-4b51-b8bb-1b28e7307aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:27.458246 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355d5b1-49e5-4b51-b8bb-1b28e7307aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:27.459889 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355d5b1-49e5-4b51-b8bb-1b28e7307aa1 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:27.469929 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1398/2804] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:01:27.474348 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b136b2e-749b-4745-a5e2-c3042025eec6 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:27.484462 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b136b2e-749b-4745-a5e2-c3042025eec6 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:27.489824 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ad89b-aae0-43bf-9bde-9fe25cbad9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:27.490479 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ad89b-aae0-43bf-9bde-9fe25cbad9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:27.490769 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ad89b-aae0-43bf-9bde-9fe25cbad9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:27.491049 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ad89b-aae0-43bf-9bde-9fe25cbad9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:27.491773 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ad89b-aae0-43bf-9bde-9fe25cbad9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:27.493389 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ad89b-aae0-43bf-9bde-9fe25cbad9a1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:27.503618 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1407/2805] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:01:27.507566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355d5b1-49e5-4b51-b8bb-1b28e7307aa1 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:27.517480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355d5b1-49e5-4b51-b8bb-1b28e7307aa1 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:27.522087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03618804-1b1e-4d07-aa05-4b9261868b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:27.522955 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03618804-1b1e-4d07-aa05-4b9261868b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:27.523239 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03618804-1b1e-4d07-aa05-4b9261868b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:27.523517 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03618804-1b1e-4d07-aa05-4b9261868b29 admin admin] PATH_INFO: `/v3/projects/df89b1ef55a04c2bb57f1eff05687391/users/d40aba9345f943cebb992892947b050d/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:27.538428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03618804-1b1e-4d07-aa05-4b9261868b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df89b1ef55a04c2bb57f1eff05687391, user_id=d40aba9345f943cebb992892947b050d, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:27.541058 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03618804-1b1e-4d07-aa05-4b9261868b29 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:27.617290 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1399/2806] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 22:01:27 2022] PUT /identity/v3/projects/df89b1ef55a04c2bb57f1eff05687391/users/d40aba9345f943cebb992892947b050d/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:27.627646 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1ca4e-19ab-439c-bd07-9193109c2339 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:27.627980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1ca4e-19ab-439c-bd07-9193109c2339 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:27.628244 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1ca4e-19ab-439c-bd07-9193109c2339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:27.655013 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-37e1ca4e-19ab-439c-bd07-9193109c2339 None None] MFA Rules not processed for user `d40aba9345f943cebb992892947b050d`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:27.656289 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-37e1ca4e-19ab-439c-bd07-9193109c2339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:27.721183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1408/2807] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:01:27.725654 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03618804-1b1e-4d07-aa05-4b9261868b29 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:27.787173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03618804-1b1e-4d07-aa05-4b9261868b29 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:27.791851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bd34e-418a-4cab-8da4-ca9ce0b98bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:27.792443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bd34e-418a-4cab-8da4-ca9ce0b98bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:27.792763 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bd34e-418a-4cab-8da4-ca9ce0b98bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:27.793043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bd34e-418a-4cab-8da4-ca9ce0b98bf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:27.793724 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bd34e-418a-4cab-8da4-ca9ce0b98bf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:27.795614 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bd34e-418a-4cab-8da4-ca9ce0b98bf3 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:27.892660 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1400/2808] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 22:01:27 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:01:27.896551 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1ca4e-19ab-439c-bd07-9193109c2339 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:27.906993 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1ca4e-19ab-439c-bd07-9193109c2339 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:27.962227 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c7e98-177c-4a68-9f2a-80974804ba7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:27.962887 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c7e98-177c-4a68-9f2a-80974804ba7f admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:27.963170 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c7e98-177c-4a68-9f2a-80974804ba7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:27.963447 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c7e98-177c-4a68-9f2a-80974804ba7f admin admin] PATH_INFO: `/v3/users` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:27.964134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c7e98-177c-4a68-9f2a-80974804ba7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:27.966044 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c7e98-177c-4a68-9f2a-80974804ba7f admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:28.045662 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1409/2809] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 22:01:27 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:01:28.049475 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bd34e-418a-4cab-8da4-ca9ce0b98bf3 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:28.059564 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bd34e-418a-4cab-8da4-ca9ce0b98bf3 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:28.064672 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4aa18-7e29-4497-bbfd-93fd92948691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:28.067509 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4aa18-7e29-4497-bbfd-93fd92948691 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:28.067509 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4aa18-7e29-4497-bbfd-93fd92948691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:28.067509 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4aa18-7e29-4497-bbfd-93fd92948691 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:28.067509 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4aa18-7e29-4497-bbfd-93fd92948691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:28.068121 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4aa18-7e29-4497-bbfd-93fd92948691 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:28.079334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1401/2810] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:01:28.083909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c7e98-177c-4a68-9f2a-80974804ba7f admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:28.093870 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c7e98-177c-4a68-9f2a-80974804ba7f admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:28.098418 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2dae3-1e6e-49a2-ae95-3f61f6d70572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:28.099292 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2dae3-1e6e-49a2-ae95-3f61f6d70572 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:28.099573 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2dae3-1e6e-49a2-ae95-3f61f6d70572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:28.099852 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2dae3-1e6e-49a2-ae95-3f61f6d70572 admin admin] PATH_INFO: `/v3/projects/b29d02e557b444c5b797306586dcee41/users/ca1bd50205a040b6bb4f7968fe22abc8/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:28.114150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2dae3-1e6e-49a2-ae95-3f61f6d70572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29d02e557b444c5b797306586dcee41, user_id=ca1bd50205a040b6bb4f7968fe22abc8, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:28.116835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2dae3-1e6e-49a2-ae95-3f61f6d70572 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:28.176613 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1410/2811] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 22:01:28 2022] PUT /identity/v3/projects/b29d02e557b444c5b797306586dcee41/users/ca1bd50205a040b6bb4f7968fe22abc8/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 22:01:28.180411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4aa18-7e29-4497-bbfd-93fd92948691 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:28.191041 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4aa18-7e29-4497-bbfd-93fd92948691 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:28.229778 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:28.245612 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23288ef4-2712-4f24-affc-6d63785f20e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:28.246269 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23288ef4-2712-4f24-affc-6d63785f20e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:28.246550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23288ef4-2712-4f24-affc-6d63785f20e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:28.246825 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23288ef4-2712-4f24-affc-6d63785f20e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:28.247803 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23288ef4-2712-4f24-affc-6d63785f20e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:28.249435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23288ef4-2712-4f24-affc-6d63785f20e2 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:28.259643 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1402/2812] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:01:28.263800 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2dae3-1e6e-49a2-ae95-3f61f6d70572 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:28.269868 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:28.274959 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2dae3-1e6e-49a2-ae95-3f61f6d70572 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:28.279605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c92d2-27a8-4450-88d0-ad329e503ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:28.280473 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c92d2-27a8-4450-88d0-ad329e503ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:28.280782 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c92d2-27a8-4450-88d0-ad329e503ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:28.281062 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c92d2-27a8-4450-88d0-ad329e503ab1 admin admin] PATH_INFO: `/v3/projects/b29d02e557b444c5b797306586dcee41/users/ca1bd50205a040b6bb4f7968fe22abc8/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:28.282990 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c92d2-27a8-4450-88d0-ad329e503ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29d02e557b444c5b797306586dcee41, user_id=ca1bd50205a040b6bb4f7968fe22abc8, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:28.285620 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c92d2-27a8-4450-88d0-ad329e503ab1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:28.295428 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1411/2813] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 22:01:28 2022] PUT /identity/v3/projects/b29d02e557b444c5b797306586dcee41/users/ca1bd50205a040b6bb4f7968fe22abc8/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:28.305422 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b5a57-e147-4bbf-b7e4-ec3a5617ac54 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:28.305636 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b5a57-e147-4bbf-b7e4-ec3a5617ac54 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:28.305918 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b5a57-e147-4bbf-b7e4-ec3a5617ac54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:28.332870 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-615b5a57-e147-4bbf-b7e4-ec3a5617ac54 None None] MFA Rules not processed for user `ca1bd50205a040b6bb4f7968fe22abc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:28.334144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-615b5a57-e147-4bbf-b7e4-ec3a5617ac54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:28.400684 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1403/2814] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:01:28.412820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c92d2-27a8-4450-88d0-ad329e503ab1 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:28.414479 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-0b9c92d2-27a8-4450-88d0-ad329e503ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:28.470627 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c92d2-27a8-4450-88d0-ad329e503ab1 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:28.474263 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fc705-c9f0-4e1f-b912-b892ced639e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:28.474903 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fc705-c9f0-4e1f-b912-b892ced639e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:28.475188 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fc705-c9f0-4e1f-b912-b892ced639e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:28.475469 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fc705-c9f0-4e1f-b912-b892ced639e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:28.484167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fc705-c9f0-4e1f-b912-b892ced639e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:28.486208 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fc705-c9f0-4e1f-b912-b892ced639e2 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:28.495507 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1412/2815] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:01:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:01:29.434161 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b5a57-e147-4bbf-b7e4-ec3a5617ac54 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:29.443464 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b5a57-e147-4bbf-b7e4-ec3a5617ac54 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:29.447900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f76ecc-6fca-40e8-8af7-5f806231f291 tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1bd50205a040b6bb4f7968fe22abc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b29d02e557b444c5b797306586dcee41', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:29.448545 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f76ecc-6fca-40e8-8af7-5f806231f291 tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:29.448858 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f76ecc-6fca-40e8-8af7-5f806231f291 tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:29.449132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f76ecc-6fca-40e8-8af7-5f806231f291 tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:29.449853 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f76ecc-6fca-40e8-8af7-5f806231f291 tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 22:01:29.450155 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f76ecc-6fca-40e8-8af7-5f806231f291 tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:29.451733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f76ecc-6fca-40e8-8af7-5f806231f291 tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:29.463505 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1404/2816] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 22:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 22:01:29.467544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fc705-c9f0-4e1f-b912-b892ced639e2 service cinder] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:29.476685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fc705-c9f0-4e1f-b912-b892ced639e2 service cinder] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:29.481253 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d92eb-df6a-44ee-ba6a-cf0b286406cf tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1bd50205a040b6bb4f7968fe22abc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b29d02e557b444c5b797306586dcee41', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:29.481905 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d92eb-df6a-44ee-ba6a-cf0b286406cf tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:29.482196 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d92eb-df6a-44ee-ba6a-cf0b286406cf tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:29.482479 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d92eb-df6a-44ee-ba6a-cf0b286406cf tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:29.483180 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d92eb-df6a-44ee-ba6a-cf0b286406cf tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:29.485124 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d92eb-df6a-44ee-ba6a-cf0b286406cf tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:29.593670 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1413/2817] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 22:01:29 2022] POST /identity/v3/projects => generated 354 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:01:29.597819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f76ecc-6fca-40e8-8af7-5f806231f291 tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:29.607719 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f76ecc-6fca-40e8-8af7-5f806231f291 tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:29.664602 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4199f-da98-4ab3-8217-53c9f6c4e48d tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1bd50205a040b6bb4f7968fe22abc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b29d02e557b444c5b797306586dcee41', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:29.665217 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4199f-da98-4ab3-8217-53c9f6c4e48d tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:29.665505 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4199f-da98-4ab3-8217-53c9f6c4e48d tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:29.665787 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4199f-da98-4ab3-8217-53c9f6c4e48d tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:29.666577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4199f-da98-4ab3-8217-53c9f6c4e48d tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 22:01:29.666889 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4199f-da98-4ab3-8217-53c9f6c4e48d tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:29.668528 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4199f-da98-4ab3-8217-53c9f6c4e48d tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:29.680320 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1405/2818] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 22:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 22:01:29.723452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d92eb-df6a-44ee-ba6a-cf0b286406cf tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:29.733735 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d92eb-df6a-44ee-ba6a-cf0b286406cf tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:29.738469 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d60fc-fcb6-473c-bb8c-1a7514fc440a tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1bd50205a040b6bb4f7968fe22abc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b29d02e557b444c5b797306586dcee41', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:29.739344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d60fc-fcb6-473c-bb8c-1a7514fc440a tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:29.739660 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d60fc-fcb6-473c-bb8c-1a7514fc440a tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:29.739945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d60fc-fcb6-473c-bb8c-1a7514fc440a tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] PATH_INFO: `/v3/projects/cfdcfb98ff214870a7dd247bdd69595e` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:29.741131 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d60fc-fcb6-473c-bb8c-1a7514fc440a tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cfdcfb98ff214870a7dd247bdd69595e)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:29.743179 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d60fc-fcb6-473c-bb8c-1a7514fc440a tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:29.850581 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-073d60fc-fcb6-473c-bb8c-1a7514fc440a tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfdcfb98ff214870a7dd247bdd69595e', 'request_id': 'req-073d60fc-fcb6-473c-bb8c-1a7514fc440a'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:29.855986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-073d60fc-fcb6-473c-bb8c-1a7514fc440a tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfdcfb98ff214870a7dd247bdd69595e', 'request_id': 'req-073d60fc-fcb6-473c-bb8c-1a7514fc440a'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:29.925512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-073d60fc-fcb6-473c-bb8c-1a7514fc440a tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfdcfb98ff214870a7dd247bdd69595e', 'request_id': 'req-073d60fc-fcb6-473c-bb8c-1a7514fc440a'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:29.936798 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-073d60fc-fcb6-473c-bb8c-1a7514fc440a tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] The token cache is being invalidate because project cfdcfb98ff214870a7dd247bdd69595e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 22:01:29.937093 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-073d60fc-fcb6-473c-bb8c-1a7514fc440a tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:29.937737 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-073d60fc-fcb6-473c-bb8c-1a7514fc440a tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:29.939943 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1414/2819] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 22:01:29 2022] DELETE /identity/v3/projects/cfdcfb98ff214870a7dd247bdd69595e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:30.510851 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4199f-da98-4ab3-8217-53c9f6c4e48d tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:30.512813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d5f4199f-da98-4ab3-8217-53c9f6c4e48d tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:30.560442 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=100 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:30.578500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4199f-da98-4ab3-8217-53c9f6c4e48d tempest-VolumeQuotaClassesTest-1113152063 tempest-VolumeQuotaClassesTest-1113152063-project-admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:30.635743 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e8d0c-baeb-4a01-90be-0fcc42c48f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:30.636543 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e8d0c-baeb-4a01-90be-0fcc42c48f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:30.636854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e8d0c-baeb-4a01-90be-0fcc42c48f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:30.637131 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e8d0c-baeb-4a01-90be-0fcc42c48f13 admin admin] PATH_INFO: `/v3/users/d40aba9345f943cebb992892947b050d` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:30.638387 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e8d0c-baeb-4a01-90be-0fcc42c48f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d40aba9345f943cebb992892947b050d)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:30.640312 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e8d0c-baeb-4a01-90be-0fcc42c48f13 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:30.823764 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2b3e8d0c-baeb-4a01-90be-0fcc42c48f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd40aba9345f943cebb992892947b050d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:30.824489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2b3e8d0c-baeb-4a01-90be-0fcc42c48f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd40aba9345f943cebb992892947b050d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:30.825124 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2b3e8d0c-baeb-4a01-90be-0fcc42c48f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd40aba9345f943cebb992892947b050d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:30.837626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2b3e8d0c-baeb-4a01-90be-0fcc42c48f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd40aba9345f943cebb992892947b050d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:30.844355 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-2b3e8d0c-baeb-4a01-90be-0fcc42c48f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd40aba9345f943cebb992892947b050d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:30.919013 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1406/2820] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 22:01:30 2022] DELETE /identity/v3/users/d40aba9345f943cebb992892947b050d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:30.923489 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473e939-090e-4b6b-98d8-d7f84f66ab7f None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:30.923974 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473e939-090e-4b6b-98d8-d7f84f66ab7f None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:30.924075 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473e939-090e-4b6b-98d8-d7f84f66ab7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:30.941840 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-f473e939-090e-4b6b-98d8-d7f84f66ab7f None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:30.943247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f473e939-090e-4b6b-98d8-d7f84f66ab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:30.989695 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:31.002435 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1415/2821] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:01:31.012394 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e8d0c-baeb-4a01-90be-0fcc42c48f13 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:31.013818 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-2b3e8d0c-baeb-4a01-90be-0fcc42c48f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:31.069550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e8d0c-baeb-4a01-90be-0fcc42c48f13 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:31.073183 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56899d90-bf53-4953-b36f-8bbb5d972df9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:31.073824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56899d90-bf53-4953-b36f-8bbb5d972df9 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:31.074106 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56899d90-bf53-4953-b36f-8bbb5d972df9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:31.074381 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56899d90-bf53-4953-b36f-8bbb5d972df9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:31.083756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56899d90-bf53-4953-b36f-8bbb5d972df9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:31.085210 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56899d90-bf53-4953-b36f-8bbb5d972df9 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:31.094933 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1407/2822] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:01:31.505254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473e939-090e-4b6b-98d8-d7f84f66ab7f None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:31.506756 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-f473e939-090e-4b6b-98d8-d7f84f66ab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:31.519251 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473e939-090e-4b6b-98d8-d7f84f66ab7f None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:31.524108 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4b928-8ae9-46b2-b852-aaf32b072cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:31.525151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4b928-8ae9-46b2-b852-aaf32b072cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:31.529374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4b928-8ae9-46b2-b852-aaf32b072cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:31.529374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4b928-8ae9-46b2-b852-aaf32b072cfb admin admin] PATH_INFO: `/v3/projects/df89b1ef55a04c2bb57f1eff05687391` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:31.529374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4b928-8ae9-46b2-b852-aaf32b072cfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=df89b1ef55a04c2bb57f1eff05687391)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:31.529374 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4b928-8ae9-46b2-b852-aaf32b072cfb admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:31.651926 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-2cf4b928-8ae9-46b2-b852-aaf32b072cfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df89b1ef55a04c2bb57f1eff05687391', 'request_id': 'req-2cf4b928-8ae9-46b2-b852-aaf32b072cfb'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:31.657614 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-2cf4b928-8ae9-46b2-b852-aaf32b072cfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df89b1ef55a04c2bb57f1eff05687391', 'request_id': 'req-2cf4b928-8ae9-46b2-b852-aaf32b072cfb'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:31.728714 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-2cf4b928-8ae9-46b2-b852-aaf32b072cfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df89b1ef55a04c2bb57f1eff05687391', 'request_id': 'req-2cf4b928-8ae9-46b2-b852-aaf32b072cfb'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:31.740368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-2cf4b928-8ae9-46b2-b852-aaf32b072cfb admin admin] The token cache is being invalidate because project df89b1ef55a04c2bb57f1eff05687391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 22:01:31.740884 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-2cf4b928-8ae9-46b2-b852-aaf32b072cfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:31.741477 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-2cf4b928-8ae9-46b2-b852-aaf32b072cfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:31.743086 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1416/2823] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 22:01:31 2022] DELETE /identity/v3/projects/df89b1ef55a04c2bb57f1eff05687391 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:31.747264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56899d90-bf53-4953-b36f-8bbb5d972df9 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:31.757151 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56899d90-bf53-4953-b36f-8bbb5d972df9 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:31.765774 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:31.811981 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38a96c-fe58-4967-9d09-5f670e03ae26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:31.812987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38a96c-fe58-4967-9d09-5f670e03ae26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:31.813272 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38a96c-fe58-4967-9d09-5f670e03ae26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:31.813548 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38a96c-fe58-4967-9d09-5f670e03ae26 admin admin] PATH_INFO: `/v3/users/ca1bd50205a040b6bb4f7968fe22abc8` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:31.814809 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38a96c-fe58-4967-9d09-5f670e03ae26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1bd50205a040b6bb4f7968fe22abc8)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:31.816773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38a96c-fe58-4967-9d09-5f670e03ae26 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:32.036555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dc38a96c-fe58-4967-9d09-5f670e03ae26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1bd50205a040b6bb4f7968fe22abc8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:32.037299 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dc38a96c-fe58-4967-9d09-5f670e03ae26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1bd50205a040b6bb4f7968fe22abc8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:32.037901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dc38a96c-fe58-4967-9d09-5f670e03ae26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1bd50205a040b6bb4f7968fe22abc8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:32.049376 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dc38a96c-fe58-4967-9d09-5f670e03ae26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1bd50205a040b6bb4f7968fe22abc8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:32.055967 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-dc38a96c-fe58-4967-9d09-5f670e03ae26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1bd50205a040b6bb4f7968fe22abc8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:32.151228 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1408/2824] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 22:01:31 2022] DELETE /identity/v3/users/ca1bd50205a040b6bb4f7968fe22abc8 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:32.571036 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4b928-8ae9-46b2-b852-aaf32b072cfb admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:32.576184 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-2cf4b928-8ae9-46b2-b852-aaf32b072cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:32.591009 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4b928-8ae9-46b2-b852-aaf32b072cfb admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:32.653423 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692216cd-c991-4279-bdbc-c94b36a4722f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:32.654289 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692216cd-c991-4279-bdbc-c94b36a4722f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:32.654594 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692216cd-c991-4279-bdbc-c94b36a4722f admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:32.654858 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692216cd-c991-4279-bdbc-c94b36a4722f admin admin] PATH_INFO: `/v3/projects/b29d02e557b444c5b797306586dcee41` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:32.656036 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692216cd-c991-4279-bdbc-c94b36a4722f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29d02e557b444c5b797306586dcee41)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:32.658509 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692216cd-c991-4279-bdbc-c94b36a4722f admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:32.757750 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-692216cd-c991-4279-bdbc-c94b36a4722f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29d02e557b444c5b797306586dcee41', 'request_id': 'req-692216cd-c991-4279-bdbc-c94b36a4722f'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:32.763138 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-692216cd-c991-4279-bdbc-c94b36a4722f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29d02e557b444c5b797306586dcee41', 'request_id': 'req-692216cd-c991-4279-bdbc-c94b36a4722f'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:32.825864 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-692216cd-c991-4279-bdbc-c94b36a4722f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29d02e557b444c5b797306586dcee41', 'request_id': 'req-692216cd-c991-4279-bdbc-c94b36a4722f'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:32.840161 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-692216cd-c991-4279-bdbc-c94b36a4722f admin admin] The token cache is being invalidate because project b29d02e557b444c5b797306586dcee41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 22:01:32.840442 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-692216cd-c991-4279-bdbc-c94b36a4722f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:32.841127 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-692216cd-c991-4279-bdbc-c94b36a4722f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:32.842649 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1417/2825] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 22:01:32 2022] DELETE /identity/v3/projects/b29d02e557b444c5b797306586dcee41 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:32.848305 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7d2bd-fd02-4dc5-a514-dda988dfba13 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:32.848802 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7d2bd-fd02-4dc5-a514-dda988dfba13 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:32.848893 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7d2bd-fd02-4dc5-a514-dda988dfba13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:32.867369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-44b7d2bd-fd02-4dc5-a514-dda988dfba13 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:32.868550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-44b7d2bd-fd02-4dc5-a514-dda988dfba13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:32.926325 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1409/2826] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:01:32.935270 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe59ff-240f-42b3-acf6-993e6c5560a6 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:32.935561 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe59ff-240f-42b3-acf6-993e6c5560a6 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:32.935871 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe59ff-240f-42b3-acf6-993e6c5560a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:32.948822 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:32.954792 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-39fe59ff-240f-42b3-acf6-993e6c5560a6 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:32.955986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-39fe59ff-240f-42b3-acf6-993e6c5560a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:32.963744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1418/2827] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:01:32.967756 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7d2bd-fd02-4dc5-a514-dda988dfba13 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:32.977158 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7d2bd-fd02-4dc5-a514-dda988dfba13 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:32.982069 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e91b38-c859-42ea-894c-4d7720018eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:32.982717 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e91b38-c859-42ea-894c-4d7720018eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:32.982998 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e91b38-c859-42ea-894c-4d7720018eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:32.983276 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e91b38-c859-42ea-894c-4d7720018eb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:32.984026 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e91b38-c859-42ea-894c-4d7720018eb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 22:01:32.984332 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e91b38-c859-42ea-894c-4d7720018eb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:32.986490 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e91b38-c859-42ea-894c-4d7720018eb5 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:32.998304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1410/2828] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 22:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 22:01:33.002963 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe59ff-240f-42b3-acf6-993e6c5560a6 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:33.011963 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe59ff-240f-42b3-acf6-993e6c5560a6 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:33.016667 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c209b4e-26a5-47f5-a257-9104c7bc0361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:33.017357 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c209b4e-26a5-47f5-a257-9104c7bc0361 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:33.017646 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c209b4e-26a5-47f5-a257-9104c7bc0361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:33.017929 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c209b4e-26a5-47f5-a257-9104c7bc0361 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:33.018652 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c209b4e-26a5-47f5-a257-9104c7bc0361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:33.020527 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c209b4e-26a5-47f5-a257-9104c7bc0361 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:33.096233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1419/2829] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 22:01:33 2022] POST /identity/v3/projects => generated 393 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:01:33.100273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e91b38-c859-42ea-894c-4d7720018eb5 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:33.109959 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e91b38-c859-42ea-894c-4d7720018eb5 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:33.127458 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:33.165006 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bded647-f3a8-49c9-85f2-0b150e273a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:33.165663 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bded647-f3a8-49c9-85f2-0b150e273a91 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:33.165938 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bded647-f3a8-49c9-85f2-0b150e273a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:33.166260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bded647-f3a8-49c9-85f2-0b150e273a91 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:33.166970 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bded647-f3a8-49c9-85f2-0b150e273a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:33.168864 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bded647-f3a8-49c9-85f2-0b150e273a91 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:33.266351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1411/2830] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 22:01:33 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:01:33.270430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c209b4e-26a5-47f5-a257-9104c7bc0361 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:33.280515 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c209b4e-26a5-47f5-a257-9104c7bc0361 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:33.285883 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff296634-00e9-4dd1-a2e6-90877fae7174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:33.286539 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff296634-00e9-4dd1-a2e6-90877fae7174 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:33.286818 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff296634-00e9-4dd1-a2e6-90877fae7174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:33.287093 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff296634-00e9-4dd1-a2e6-90877fae7174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:33.287821 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff296634-00e9-4dd1-a2e6-90877fae7174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:33.289493 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff296634-00e9-4dd1-a2e6-90877fae7174 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:33.300242 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1420/2831] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 22:01:33.304014 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bded647-f3a8-49c9-85f2-0b150e273a91 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:33.314315 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bded647-f3a8-49c9-85f2-0b150e273a91 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:33.319035 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732744c-1e6c-48c7-9e94-db1b7420d168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:33.319696 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732744c-1e6c-48c7-9e94-db1b7420d168 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:33.319980 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732744c-1e6c-48c7-9e94-db1b7420d168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:33.320259 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732744c-1e6c-48c7-9e94-db1b7420d168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:33.321029 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732744c-1e6c-48c7-9e94-db1b7420d168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:33.322623 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732744c-1e6c-48c7-9e94-db1b7420d168 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:33.332408 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1412/2832] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:01:33.336278 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff296634-00e9-4dd1-a2e6-90877fae7174 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:33.346845 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff296634-00e9-4dd1-a2e6-90877fae7174 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:33.351313 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167381d-fe82-4c1e-ab0f-ec4987ba64cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:33.352172 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167381d-fe82-4c1e-ab0f-ec4987ba64cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:33.352449 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167381d-fe82-4c1e-ab0f-ec4987ba64cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:33.352748 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167381d-fe82-4c1e-ab0f-ec4987ba64cd admin admin] PATH_INFO: `/v3/projects/3a9ec58c59994e68a2ddb43a00b6c0ae/users/b53176fef823412aaf3d87a9945dd23c/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:33.367400 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167381d-fe82-4c1e-ab0f-ec4987ba64cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9ec58c59994e68a2ddb43a00b6c0ae, user_id=b53176fef823412aaf3d87a9945dd23c, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:33.370039 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167381d-fe82-4c1e-ab0f-ec4987ba64cd admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:33.428495 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1421/2833] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 22:01:33 2022] PUT /identity/v3/projects/3a9ec58c59994e68a2ddb43a00b6c0ae/users/b53176fef823412aaf3d87a9945dd23c/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:33.438834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f1ed4-64f1-46d8-aebd-4faac35ee215 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:33.439623 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f1ed4-64f1-46d8-aebd-4faac35ee215 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:33.439901 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f1ed4-64f1-46d8-aebd-4faac35ee215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:33.465806 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-da0f1ed4-64f1-46d8-aebd-4faac35ee215 None None] MFA Rules not processed for user `b53176fef823412aaf3d87a9945dd23c`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:33.466994 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-da0f1ed4-64f1-46d8-aebd-4faac35ee215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:33.528994 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1413/2834] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:01:33.533430 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167381d-fe82-4c1e-ab0f-ec4987ba64cd admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:33.594096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167381d-fe82-4c1e-ab0f-ec4987ba64cd admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:33.599049 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d5a8d-ed8d-47b0-92aa-1424e7738566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:33.599642 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d5a8d-ed8d-47b0-92aa-1424e7738566 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:33.599928 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d5a8d-ed8d-47b0-92aa-1424e7738566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:33.600208 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d5a8d-ed8d-47b0-92aa-1424e7738566 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:33.600949 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d5a8d-ed8d-47b0-92aa-1424e7738566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:33.602865 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d5a8d-ed8d-47b0-92aa-1424e7738566 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:33.709662 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1422/2835] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 22:01:33 2022] POST /identity/v3/projects => generated 391 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:01:33.713714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f1ed4-64f1-46d8-aebd-4faac35ee215 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:33.724238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f1ed4-64f1-46d8-aebd-4faac35ee215 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:33.778499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd90d4-a20e-4d1f-8d8b-3ba8a2935461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:33.779159 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd90d4-a20e-4d1f-8d8b-3ba8a2935461 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:33.779440 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd90d4-a20e-4d1f-8d8b-3ba8a2935461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:33.779714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd90d4-a20e-4d1f-8d8b-3ba8a2935461 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:33.780388 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd90d4-a20e-4d1f-8d8b-3ba8a2935461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:33.782323 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd90d4-a20e-4d1f-8d8b-3ba8a2935461 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:33.871417 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1414/2836] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 22:01:33 2022] POST /identity/v3/users => generated 302 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:01:33.875586 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d5a8d-ed8d-47b0-92aa-1424e7738566 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:33.886481 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d5a8d-ed8d-47b0-92aa-1424e7738566 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:33.891023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c72b2-6d6a-44e6-aadb-313a966240a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:33.891678 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c72b2-6d6a-44e6-aadb-313a966240a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:33.891956 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c72b2-6d6a-44e6-aadb-313a966240a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:33.892229 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c72b2-6d6a-44e6-aadb-313a966240a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:33.892979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c72b2-6d6a-44e6-aadb-313a966240a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:33.894552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c72b2-6d6a-44e6-aadb-313a966240a8 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:33.904835 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1423/2837] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:01:33.908740 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd90d4-a20e-4d1f-8d8b-3ba8a2935461 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:33.918804 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd90d4-a20e-4d1f-8d8b-3ba8a2935461 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:33.923889 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffacc99-c20d-4cf9-a922-a9463dffa69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:33.924783 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffacc99-c20d-4cf9-a922-a9463dffa69c admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:33.925062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffacc99-c20d-4cf9-a922-a9463dffa69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:33.925334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffacc99-c20d-4cf9-a922-a9463dffa69c admin admin] PATH_INFO: `/v3/projects/b055594e29d649baabfbdcfc83403c2b/users/bdde2e29ba9648aa845a3c05b9e1adbf/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:33.940140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffacc99-c20d-4cf9-a922-a9463dffa69c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b055594e29d649baabfbdcfc83403c2b, user_id=bdde2e29ba9648aa845a3c05b9e1adbf, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:33.942786 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffacc99-c20d-4cf9-a922-a9463dffa69c admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:33.944930 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:34.008816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1415/2838] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 22:01:33 2022] PUT /identity/v3/projects/b055594e29d649baabfbdcfc83403c2b/users/bdde2e29ba9648aa845a3c05b9e1adbf/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:34.012820 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c72b2-6d6a-44e6-aadb-313a966240a8 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:34.022632 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c72b2-6d6a-44e6-aadb-313a966240a8 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:34.077884 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29906305-1e54-497e-927b-8e56cfe5ac50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:34.078552 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29906305-1e54-497e-927b-8e56cfe5ac50 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:34.078840 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29906305-1e54-497e-927b-8e56cfe5ac50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:34.079121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29906305-1e54-497e-927b-8e56cfe5ac50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:34.079901 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29906305-1e54-497e-927b-8e56cfe5ac50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:34.081533 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29906305-1e54-497e-927b-8e56cfe5ac50 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:34.091214 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1424/2839] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:01:34.095979 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffacc99-c20d-4cf9-a922-a9463dffa69c admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:34.106168 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffacc99-c20d-4cf9-a922-a9463dffa69c admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:34.110704 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d613515-285d-46bc-a7e7-b63eb705b86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:34.112243 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d613515-285d-46bc-a7e7-b63eb705b86d admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:34.112529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d613515-285d-46bc-a7e7-b63eb705b86d admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:34.112858 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d613515-285d-46bc-a7e7-b63eb705b86d admin admin] PATH_INFO: `/v3/projects/b055594e29d649baabfbdcfc83403c2b/users/bdde2e29ba9648aa845a3c05b9e1adbf/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:34.114801 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d613515-285d-46bc-a7e7-b63eb705b86d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b055594e29d649baabfbdcfc83403c2b, user_id=bdde2e29ba9648aa845a3c05b9e1adbf, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:34.117480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d613515-285d-46bc-a7e7-b63eb705b86d admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:34.127617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1416/2840] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 22:01:34 2022] PUT /identity/v3/projects/b055594e29d649baabfbdcfc83403c2b/users/bdde2e29ba9648aa845a3c05b9e1adbf/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:34.138349 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d0695-a9b2-4617-a088-1ae4ecb2e28e None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:34.138634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d0695-a9b2-4617-a088-1ae4ecb2e28e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:34.138911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d0695-a9b2-4617-a088-1ae4ecb2e28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:34.165167 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:34.166241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-070d0695-a9b2-4617-a088-1ae4ecb2e28e None None] MFA Rules not processed for user `bdde2e29ba9648aa845a3c05b9e1adbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:34.167544 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-070d0695-a9b2-4617-a088-1ae4ecb2e28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:34.236505 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1425/2841] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:01:34.247443 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d613515-285d-46bc-a7e7-b63eb705b86d admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:34.250316 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-5d613515-285d-46bc-a7e7-b63eb705b86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:34.307896 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d613515-285d-46bc-a7e7-b63eb705b86d admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:34.311563 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb36fef-5532-4e1c-95f6-e82024b6b5c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:34.312207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb36fef-5532-4e1c-95f6-e82024b6b5c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:34.312492 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb36fef-5532-4e1c-95f6-e82024b6b5c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:34.312824 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb36fef-5532-4e1c-95f6-e82024b6b5c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:34.321746 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb36fef-5532-4e1c-95f6-e82024b6b5c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:34.323178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb36fef-5532-4e1c-95f6-e82024b6b5c1 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:34.333135 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1417/2842] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:01:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:01:34.377752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d0695-a9b2-4617-a088-1ae4ecb2e28e None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:34.379075 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-070d0695-a9b2-4617-a088-1ae4ecb2e28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:34.390844 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d0695-a9b2-4617-a088-1ae4ecb2e28e None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:34.394996 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91522b-fc67-4d35-aca6-5514d2520c1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:34.395638 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91522b-fc67-4d35-aca6-5514d2520c1b service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:34.395922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91522b-fc67-4d35-aca6-5514d2520c1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:34.396266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91522b-fc67-4d35-aca6-5514d2520c1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:34.450386 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91522b-fc67-4d35-aca6-5514d2520c1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:34.451805 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91522b-fc67-4d35-aca6-5514d2520c1b service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:34.461058 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1426/2843] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:01:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:01:39.213573 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb36fef-5532-4e1c-95f6-e82024b6b5c1 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:39.273342 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb36fef-5532-4e1c-95f6-e82024b6b5c1 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:39.278070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5202ca-8b6f-4a61-8eee-d089f7f2c944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:39.278978 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5202ca-8b6f-4a61-8eee-d089f7f2c944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:39.279257 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5202ca-8b6f-4a61-8eee-d089f7f2c944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:39.279529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5202ca-8b6f-4a61-8eee-d089f7f2c944 admin admin] PATH_INFO: `/v3/users/b53176fef823412aaf3d87a9945dd23c` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:39.280715 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5202ca-8b6f-4a61-8eee-d089f7f2c944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b53176fef823412aaf3d87a9945dd23c)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:39.282614 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5202ca-8b6f-4a61-8eee-d089f7f2c944 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:39.446658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-8a5202ca-8b6f-4a61-8eee-d089f7f2c944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b53176fef823412aaf3d87a9945dd23c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:39.447311 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-8a5202ca-8b6f-4a61-8eee-d089f7f2c944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b53176fef823412aaf3d87a9945dd23c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:39.447924 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-8a5202ca-8b6f-4a61-8eee-d089f7f2c944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b53176fef823412aaf3d87a9945dd23c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:39.460130 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-8a5202ca-8b6f-4a61-8eee-d089f7f2c944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b53176fef823412aaf3d87a9945dd23c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:39.467051 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-8a5202ca-8b6f-4a61-8eee-d089f7f2c944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b53176fef823412aaf3d87a9945dd23c'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:39.531334 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1418/2844] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 22:01:39 2022] DELETE /identity/v3/users/b53176fef823412aaf3d87a9945dd23c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:39.536480 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04cd20-6424-400d-b4f4-10b158362035 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:39.536985 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04cd20-6424-400d-b4f4-10b158362035 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:39.537080 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04cd20-6424-400d-b4f4-10b158362035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:39.556256 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-4e04cd20-6424-400d-b4f4-10b158362035 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:39.557568 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4e04cd20-6424-400d-b4f4-10b158362035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:39.616634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1427/2845] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 22:01:39.626584 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5202ca-8b6f-4a61-8eee-d089f7f2c944 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:39.627992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-8a5202ca-8b6f-4a61-8eee-d089f7f2c944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:39.633920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:39.685792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5202ca-8b6f-4a61-8eee-d089f7f2c944 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:39.690044 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b710c70-cc53-4bc7-9449-b75d96219f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:39.690775 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b710c70-cc53-4bc7-9449-b75d96219f2c service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:39.691061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b710c70-cc53-4bc7-9449-b75d96219f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:39.691338 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b710c70-cc53-4bc7-9449-b75d96219f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:39.700892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b710c70-cc53-4bc7-9449-b75d96219f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:39.707242 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b710c70-cc53-4bc7-9449-b75d96219f2c service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:39.712238 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1419/2846] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:01:40.093225 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04cd20-6424-400d-b4f4-10b158362035 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:40.094679 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4e04cd20-6424-400d-b4f4-10b158362035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:40.106851 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04cd20-6424-400d-b4f4-10b158362035 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:40.111438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea1c8d-3609-438b-b530-87a7fe571202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:40.112331 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea1c8d-3609-438b-b530-87a7fe571202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:40.112651 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea1c8d-3609-438b-b530-87a7fe571202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:40.112934 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea1c8d-3609-438b-b530-87a7fe571202 admin admin] PATH_INFO: `/v3/projects/3a9ec58c59994e68a2ddb43a00b6c0ae` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:40.114113 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea1c8d-3609-438b-b530-87a7fe571202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a9ec58c59994e68a2ddb43a00b6c0ae)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:40.115995 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea1c8d-3609-438b-b530-87a7fe571202 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:40.188351 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:40.200234 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3eea1c8d-3609-438b-b530-87a7fe571202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a9ec58c59994e68a2ddb43a00b6c0ae', 'request_id': 'req-3eea1c8d-3609-438b-b530-87a7fe571202'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:40.205451 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3eea1c8d-3609-438b-b530-87a7fe571202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a9ec58c59994e68a2ddb43a00b6c0ae', 'request_id': 'req-3eea1c8d-3609-438b-b530-87a7fe571202'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:40.274394 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3eea1c8d-3609-438b-b530-87a7fe571202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a9ec58c59994e68a2ddb43a00b6c0ae', 'request_id': 'req-3eea1c8d-3609-438b-b530-87a7fe571202'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:40.285508 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3eea1c8d-3609-438b-b530-87a7fe571202 admin admin] The token cache is being invalidate because project 3a9ec58c59994e68a2ddb43a00b6c0ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 22:01:40.285794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3eea1c8d-3609-438b-b530-87a7fe571202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:40.286409 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3eea1c8d-3609-438b-b530-87a7fe571202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:40.287957 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1428/2847] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 22:01:40 2022] DELETE /identity/v3/projects/3a9ec58c59994e68a2ddb43a00b6c0ae => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:40.291938 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b710c70-cc53-4bc7-9449-b75d96219f2c service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:40.302194 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b710c70-cc53-4bc7-9449-b75d96219f2c service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:40.356378 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18daed-085e-4d58-b069-17253ed625a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:40.357275 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18daed-085e-4d58-b069-17253ed625a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:40.357559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18daed-085e-4d58-b069-17253ed625a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:40.357839 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18daed-085e-4d58-b069-17253ed625a7 admin admin] PATH_INFO: `/v3/users/bdde2e29ba9648aa845a3c05b9e1adbf` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:40.359017 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18daed-085e-4d58-b069-17253ed625a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdde2e29ba9648aa845a3c05b9e1adbf)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:40.360971 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18daed-085e-4d58-b069-17253ed625a7 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:40.536091 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1d18daed-085e-4d58-b069-17253ed625a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdde2e29ba9648aa845a3c05b9e1adbf'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:40.536698 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1d18daed-085e-4d58-b069-17253ed625a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdde2e29ba9648aa845a3c05b9e1adbf'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:40.537330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1d18daed-085e-4d58-b069-17253ed625a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdde2e29ba9648aa845a3c05b9e1adbf'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:40.548868 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1d18daed-085e-4d58-b069-17253ed625a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdde2e29ba9648aa845a3c05b9e1adbf'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:40.557699 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1d18daed-085e-4d58-b069-17253ed625a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdde2e29ba9648aa845a3c05b9e1adbf'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:40.649417 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1420/2848] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 22:01:40 2022] DELETE /identity/v3/users/bdde2e29ba9648aa845a3c05b9e1adbf => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:41.053727 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea1c8d-3609-438b-b530-87a7fe571202 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:41.055233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3eea1c8d-3609-438b-b530-87a7fe571202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:41.069219 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea1c8d-3609-438b-b530-87a7fe571202 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:41.126568 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87511fdf-0b4d-4f81-ac12-53a22f6ee254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:41.127421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87511fdf-0b4d-4f81-ac12-53a22f6ee254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:41.127703 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87511fdf-0b4d-4f81-ac12-53a22f6ee254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:41.127976 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87511fdf-0b4d-4f81-ac12-53a22f6ee254 admin admin] PATH_INFO: `/v3/projects/b055594e29d649baabfbdcfc83403c2b` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:41.129163 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87511fdf-0b4d-4f81-ac12-53a22f6ee254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b055594e29d649baabfbdcfc83403c2b)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:41.131037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87511fdf-0b4d-4f81-ac12-53a22f6ee254 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:41.245909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-87511fdf-0b4d-4f81-ac12-53a22f6ee254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b055594e29d649baabfbdcfc83403c2b', 'request_id': 'req-87511fdf-0b4d-4f81-ac12-53a22f6ee254'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:41.251771 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-87511fdf-0b4d-4f81-ac12-53a22f6ee254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b055594e29d649baabfbdcfc83403c2b', 'request_id': 'req-87511fdf-0b4d-4f81-ac12-53a22f6ee254'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:41.337468 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-87511fdf-0b4d-4f81-ac12-53a22f6ee254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b055594e29d649baabfbdcfc83403c2b', 'request_id': 'req-87511fdf-0b4d-4f81-ac12-53a22f6ee254'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:41.349762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-87511fdf-0b4d-4f81-ac12-53a22f6ee254 admin admin] The token cache is being invalidate because project b055594e29d649baabfbdcfc83403c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 22:01:41.352555 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-87511fdf-0b4d-4f81-ac12-53a22f6ee254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:41.352555 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-87511fdf-0b4d-4f81-ac12-53a22f6ee254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:41.352555 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1429/2849] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 22:01:41 2022] DELETE /identity/v3/projects/b055594e29d649baabfbdcfc83403c2b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:41.358144 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d818672-7c6a-49b1-a6eb-65592d2fd7a5 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:41.358660 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d818672-7c6a-49b1-a6eb-65592d2fd7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:41.358773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d818672-7c6a-49b1-a6eb-65592d2fd7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:41.376720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-1d818672-7c6a-49b1-a6eb-65592d2fd7a5 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:41.377921 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1d818672-7c6a-49b1-a6eb-65592d2fd7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:41.396205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:41.435270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1421/2850] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:01:41.443247 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad48484-5aad-4e3d-9164-7526306204be None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:41.443538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad48484-5aad-4e3d-9164-7526306204be None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:41.443825 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad48484-5aad-4e3d-9164-7526306204be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:41.462482 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-3ad48484-5aad-4e3d-9164-7526306204be None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:41.463686 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3ad48484-5aad-4e3d-9164-7526306204be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:41.472545 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1430/2851] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:01:41.476874 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d818672-7c6a-49b1-a6eb-65592d2fd7a5 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:41.486279 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d818672-7c6a-49b1-a6eb-65592d2fd7a5 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:41.491950 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07e7ac-3a8d-4709-b935-6d34be881f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:41.492619 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07e7ac-3a8d-4709-b935-6d34be881f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:41.492907 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07e7ac-3a8d-4709-b935-6d34be881f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:41.493182 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07e7ac-3a8d-4709-b935-6d34be881f33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:41.493900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07e7ac-3a8d-4709-b935-6d34be881f33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 22:01:41.494205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07e7ac-3a8d-4709-b935-6d34be881f33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:41.495790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07e7ac-3a8d-4709-b935-6d34be881f33 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:41.507227 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1422/2852] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 22:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 22:01:41.511284 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad48484-5aad-4e3d-9164-7526306204be None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:41.520305 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad48484-5aad-4e3d-9164-7526306204be None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:41.525023 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86195023-a509-4cb0-82c8-ac9199c7e684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:41.525683 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86195023-a509-4cb0-82c8-ac9199c7e684 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:41.525973 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86195023-a509-4cb0-82c8-ac9199c7e684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:41.526257 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86195023-a509-4cb0-82c8-ac9199c7e684 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:41.526979 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86195023-a509-4cb0-82c8-ac9199c7e684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:41.529020 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86195023-a509-4cb0-82c8-ac9199c7e684 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:41.614142 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1431/2853] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 22:01:41 2022] POST /identity/v3/projects => generated 409 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:01:41.618201 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07e7ac-3a8d-4709-b935-6d34be881f33 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:41.628341 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07e7ac-3a8d-4709-b935-6d34be881f33 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:41.684161 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1b96d-f337-412b-9fea-bf0b3d641e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:41.684863 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1b96d-f337-412b-9fea-bf0b3d641e14 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:41.685140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1b96d-f337-412b-9fea-bf0b3d641e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:41.685413 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1b96d-f337-412b-9fea-bf0b3d641e14 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:41.686087 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1b96d-f337-412b-9fea-bf0b3d641e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:41.688006 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1b96d-f337-412b-9fea-bf0b3d641e14 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:41.794212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1423/2854] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 22:01:41 2022] POST /identity/v3/users => generated 305 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:01:41.798471 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86195023-a509-4cb0-82c8-ac9199c7e684 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:41.809360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86195023-a509-4cb0-82c8-ac9199c7e684 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:41.814300 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482590f-a3cb-446a-b16a-8ad1f8c67678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:41.814958 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482590f-a3cb-446a-b16a-8ad1f8c67678 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:41.815249 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482590f-a3cb-446a-b16a-8ad1f8c67678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:41.815579 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482590f-a3cb-446a-b16a-8ad1f8c67678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:41.816345 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482590f-a3cb-446a-b16a-8ad1f8c67678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:41.817977 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482590f-a3cb-446a-b16a-8ad1f8c67678 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:41.828413 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1432/2855] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:01:41.832686 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1b96d-f337-412b-9fea-bf0b3d641e14 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:41.842658 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1b96d-f337-412b-9fea-bf0b3d641e14 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:41.847886 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdf7cd-1309-4d4d-8327-e6a6363c4476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:41.848531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdf7cd-1309-4d4d-8327-e6a6363c4476 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:41.848842 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdf7cd-1309-4d4d-8327-e6a6363c4476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:41.849113 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdf7cd-1309-4d4d-8327-e6a6363c4476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:41.849826 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdf7cd-1309-4d4d-8327-e6a6363c4476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:41.851400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdf7cd-1309-4d4d-8327-e6a6363c4476 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:41.861121 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1424/2856] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:01:41.864980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482590f-a3cb-446a-b16a-8ad1f8c67678 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:41.874873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482590f-a3cb-446a-b16a-8ad1f8c67678 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:41.879441 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eacf70-ed1b-49af-b574-678a88b84c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:41.880306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eacf70-ed1b-49af-b574-678a88b84c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:41.880609 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eacf70-ed1b-49af-b574-678a88b84c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:41.880893 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eacf70-ed1b-49af-b574-678a88b84c70 admin admin] PATH_INFO: `/v3/projects/5fc2b15a038b4288be0d140f28e9e5c8/users/00ec7faf35d44700bc853266bc4f1ec8/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:41.888585 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:41.895543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eacf70-ed1b-49af-b574-678a88b84c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc2b15a038b4288be0d140f28e9e5c8, user_id=00ec7faf35d44700bc853266bc4f1ec8, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:41.898200 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eacf70-ed1b-49af-b574-678a88b84c70 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:41.968940 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1433/2857] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 22:01:41 2022] PUT /identity/v3/projects/5fc2b15a038b4288be0d140f28e9e5c8/users/00ec7faf35d44700bc853266bc4f1ec8/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:41.979557 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd583f-b1d2-4625-8bd5-9357231a1d7a None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:41.979850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd583f-b1d2-4625-8bd5-9357231a1d7a None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:41.980128 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd583f-b1d2-4625-8bd5-9357231a1d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:42.005750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-1ebd583f-b1d2-4625-8bd5-9357231a1d7a None None] MFA Rules not processed for user `00ec7faf35d44700bc853266bc4f1ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:42.006946 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1ebd583f-b1d2-4625-8bd5-9357231a1d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:42.068062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1425/2858] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:41 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:01:42.072738 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eacf70-ed1b-49af-b574-678a88b84c70 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:42.133837 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eacf70-ed1b-49af-b574-678a88b84c70 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:42.138278 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afccf79-9626-4e00-932f-dbd03ce59248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:42.138952 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afccf79-9626-4e00-932f-dbd03ce59248 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:42.139231 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afccf79-9626-4e00-932f-dbd03ce59248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:42.139512 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afccf79-9626-4e00-932f-dbd03ce59248 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:42.140186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afccf79-9626-4e00-932f-dbd03ce59248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:42.142099 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afccf79-9626-4e00-932f-dbd03ce59248 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:42.232890 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1434/2859] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 22:01:42 2022] POST /identity/v3/projects => generated 407 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:01:42.236834 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd583f-b1d2-4625-8bd5-9357231a1d7a None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:42.247645 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd583f-b1d2-4625-8bd5-9357231a1d7a None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:42.264245 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:42.302084 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29399ac4-aea1-4639-ae36-207675aa43c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:42.302753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29399ac4-aea1-4639-ae36-207675aa43c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:42.303037 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29399ac4-aea1-4639-ae36-207675aa43c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:42.303313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29399ac4-aea1-4639-ae36-207675aa43c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:42.304008 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29399ac4-aea1-4639-ae36-207675aa43c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:42.305950 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29399ac4-aea1-4639-ae36-207675aa43c5 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:42.437957 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1426/2860] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 22:01:42 2022] POST /identity/v3/users => generated 310 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:01:42.442401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afccf79-9626-4e00-932f-dbd03ce59248 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:42.452878 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afccf79-9626-4e00-932f-dbd03ce59248 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:42.458407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e0603-b58d-4f96-aef2-30bdd21d4dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:42.459072 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e0603-b58d-4f96-aef2-30bdd21d4dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:42.459356 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e0603-b58d-4f96-aef2-30bdd21d4dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:42.459633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e0603-b58d-4f96-aef2-30bdd21d4dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:42.460356 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e0603-b58d-4f96-aef2-30bdd21d4dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:42.462154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e0603-b58d-4f96-aef2-30bdd21d4dcb admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:42.473233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1435/2861] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:01:42.477292 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29399ac4-aea1-4639-ae36-207675aa43c5 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:42.487134 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29399ac4-aea1-4639-ae36-207675aa43c5 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:42.492324 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce726392-6dc0-4664-bb4f-3e5345e4b5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:42.493222 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce726392-6dc0-4664-bb4f-3e5345e4b5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:42.493501 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce726392-6dc0-4664-bb4f-3e5345e4b5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:42.493799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce726392-6dc0-4664-bb4f-3e5345e4b5c6 admin admin] PATH_INFO: `/v3/projects/dc120f8546d54de2a3ea10f9ad11751a/users/c9603dcc668d49a8845bd334e490df8a/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:42.508153 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce726392-6dc0-4664-bb4f-3e5345e4b5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc120f8546d54de2a3ea10f9ad11751a, user_id=c9603dcc668d49a8845bd334e490df8a, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:42.510910 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce726392-6dc0-4664-bb4f-3e5345e4b5c6 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:42.606157 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1427/2862] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 22:01:42 2022] PUT /identity/v3/projects/dc120f8546d54de2a3ea10f9ad11751a/users/c9603dcc668d49a8845bd334e490df8a/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 22:01:42.610125 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e0603-b58d-4f96-aef2-30bdd21d4dcb admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:42.620466 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e0603-b58d-4f96-aef2-30bdd21d4dcb admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:42.676090 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee6a50-3c40-4290-a38c-e44bbe27fe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:42.676785 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee6a50-3c40-4290-a38c-e44bbe27fe08 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:42.677073 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee6a50-3c40-4290-a38c-e44bbe27fe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:42.677355 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee6a50-3c40-4290-a38c-e44bbe27fe08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:42.678072 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee6a50-3c40-4290-a38c-e44bbe27fe08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:42.679661 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee6a50-3c40-4290-a38c-e44bbe27fe08 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:42.689150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1436/2863] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:01:42.693185 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce726392-6dc0-4664-bb4f-3e5345e4b5c6 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:42.703222 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce726392-6dc0-4664-bb4f-3e5345e4b5c6 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:42.708281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2fe7b-515d-4496-bb30-9c7c764a5524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:42.709186 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2fe7b-515d-4496-bb30-9c7c764a5524 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:42.709465 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2fe7b-515d-4496-bb30-9c7c764a5524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:42.709741 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2fe7b-515d-4496-bb30-9c7c764a5524 admin admin] PATH_INFO: `/v3/projects/dc120f8546d54de2a3ea10f9ad11751a/users/c9603dcc668d49a8845bd334e490df8a/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:42.711659 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2fe7b-515d-4496-bb30-9c7c764a5524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc120f8546d54de2a3ea10f9ad11751a, user_id=c9603dcc668d49a8845bd334e490df8a, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:42.714293 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2fe7b-515d-4496-bb30-9c7c764a5524 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:42.724755 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1428/2864] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 22:01:42 2022] PUT /identity/v3/projects/dc120f8546d54de2a3ea10f9ad11751a/users/c9603dcc668d49a8845bd334e490df8a/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:42.735713 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fae5e1-7b83-4d4a-bd2a-c2ff0230c0da None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:42.736005 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fae5e1-7b83-4d4a-bd2a-c2ff0230c0da None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:42.736282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fae5e1-7b83-4d4a-bd2a-c2ff0230c0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:42.762135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-c0fae5e1-7b83-4d4a-bd2a-c2ff0230c0da None None] MFA Rules not processed for user `c9603dcc668d49a8845bd334e490df8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:42.763328 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-c0fae5e1-7b83-4d4a-bd2a-c2ff0230c0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:42.807945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:42.830774 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1437/2865] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:42 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:01:42.841814 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2fe7b-515d-4496-bb30-9c7c764a5524 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:42.843494 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a6e2fe7b-515d-4496-bb30-9c7c764a5524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:42.899646 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2fe7b-515d-4496-bb30-9c7c764a5524 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:42.903208 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a93e2-ac12-47dc-8808-00ab5d70aad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:42.903840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a93e2-ac12-47dc-8808-00ab5d70aad8 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:42.904116 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a93e2-ac12-47dc-8808-00ab5d70aad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:42.904386 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a93e2-ac12-47dc-8808-00ab5d70aad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:42.914240 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a93e2-ac12-47dc-8808-00ab5d70aad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:42.915671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a93e2-ac12-47dc-8808-00ab5d70aad8 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:42.924897 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1429/2866] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:01:42 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:01:43.286564 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fae5e1-7b83-4d4a-bd2a-c2ff0230c0da None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:43.296264 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fae5e1-7b83-4d4a-bd2a-c2ff0230c0da None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:43.302114 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f07f0-99e2-4ad2-82a5-67bb4ed0db9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:43.302114 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f07f0-99e2-4ad2-82a5-67bb4ed0db9e service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:43.302114 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f07f0-99e2-4ad2-82a5-67bb4ed0db9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:43.302114 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f07f0-99e2-4ad2-82a5-67bb4ed0db9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:43.356526 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f07f0-99e2-4ad2-82a5-67bb4ed0db9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:43.357978 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f07f0-99e2-4ad2-82a5-67bb4ed0db9e service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:43.367214 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1438/2867] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:01:43 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:01:52.920799 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=61,keystone:INSERT=5 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:53.362695 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=36 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:54.193043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a93e2-ac12-47dc-8808-00ab5d70aad8 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:54.255104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a93e2-ac12-47dc-8808-00ab5d70aad8 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:54.259795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f330b-5636-4816-894a-d445a2150f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:54.260685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f330b-5636-4816-894a-d445a2150f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:54.260993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f330b-5636-4816-894a-d445a2150f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:54.261273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f330b-5636-4816-894a-d445a2150f2c admin admin] PATH_INFO: `/v3/users/00ec7faf35d44700bc853266bc4f1ec8` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:54.262457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f330b-5636-4816-894a-d445a2150f2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=00ec7faf35d44700bc853266bc4f1ec8)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:54.264374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f330b-5636-4816-894a-d445a2150f2c admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:54.430508 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-471f330b-5636-4816-894a-d445a2150f2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00ec7faf35d44700bc853266bc4f1ec8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:54.431187 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-471f330b-5636-4816-894a-d445a2150f2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00ec7faf35d44700bc853266bc4f1ec8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:54.431802 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-471f330b-5636-4816-894a-d445a2150f2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00ec7faf35d44700bc853266bc4f1ec8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:54.443546 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-471f330b-5636-4816-894a-d445a2150f2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00ec7faf35d44700bc853266bc4f1ec8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:54.450311 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-471f330b-5636-4816-894a-d445a2150f2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00ec7faf35d44700bc853266bc4f1ec8'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:54.537377 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1430/2868] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 22:01:54 2022] DELETE /identity/v3/users/00ec7faf35d44700bc853266bc4f1ec8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:54.542519 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36679aa1-5b5d-4453-960a-b55f042d53c9 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:54.547191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36679aa1-5b5d-4453-960a-b55f042d53c9 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:54.547191 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36679aa1-5b5d-4453-960a-b55f042d53c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:54.560266 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-36679aa1-5b5d-4453-960a-b55f042d53c9 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:54.561511 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-36679aa1-5b5d-4453-960a-b55f042d53c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:54.621055 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1439/2869] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:01:54.631203 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f330b-5636-4816-894a-d445a2150f2c admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:54.632682 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-471f330b-5636-4816-894a-d445a2150f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:54.690142 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f330b-5636-4816-894a-d445a2150f2c admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:54.693779 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a1e5e-e9b7-4de5-b2fa-dd92f2442ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:54.694420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a1e5e-e9b7-4de5-b2fa-dd92f2442ddd service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:54.694705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a1e5e-e9b7-4de5-b2fa-dd92f2442ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:54.694985 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a1e5e-e9b7-4de5-b2fa-dd92f2442ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:54.703880 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a1e5e-e9b7-4de5-b2fa-dd92f2442ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:54.705346 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a1e5e-e9b7-4de5-b2fa-dd92f2442ddd service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:54.715313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1431/2870] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:01:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:01:55.116084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36679aa1-5b5d-4453-960a-b55f042d53c9 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:55.117533 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-36679aa1-5b5d-4453-960a-b55f042d53c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:55.130484 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36679aa1-5b5d-4453-960a-b55f042d53c9 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:55.135254 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f05b03-edd2-4fbf-83dd-28071dee20c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:55.137143 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f05b03-edd2-4fbf-83dd-28071dee20c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:55.138330 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f05b03-edd2-4fbf-83dd-28071dee20c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:55.139056 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f05b03-edd2-4fbf-83dd-28071dee20c7 admin admin] PATH_INFO: `/v3/projects/5fc2b15a038b4288be0d140f28e9e5c8` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:55.140822 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f05b03-edd2-4fbf-83dd-28071dee20c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc2b15a038b4288be0d140f28e9e5c8)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:55.142752 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f05b03-edd2-4fbf-83dd-28071dee20c7 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:55.234751 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-83f05b03-edd2-4fbf-83dd-28071dee20c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc2b15a038b4288be0d140f28e9e5c8', 'request_id': 'req-83f05b03-edd2-4fbf-83dd-28071dee20c7'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:55.240565 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-83f05b03-edd2-4fbf-83dd-28071dee20c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc2b15a038b4288be0d140f28e9e5c8', 'request_id': 'req-83f05b03-edd2-4fbf-83dd-28071dee20c7'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:55.314637 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-83f05b03-edd2-4fbf-83dd-28071dee20c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc2b15a038b4288be0d140f28e9e5c8', 'request_id': 'req-83f05b03-edd2-4fbf-83dd-28071dee20c7'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:55.326550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-83f05b03-edd2-4fbf-83dd-28071dee20c7 admin admin] The token cache is being invalidate because project 5fc2b15a038b4288be0d140f28e9e5c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 22:01:55.326948 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-83f05b03-edd2-4fbf-83dd-28071dee20c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:55.327571 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-83f05b03-edd2-4fbf-83dd-28071dee20c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:55.329368 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1440/2871] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 22:01:55 2022] DELETE /identity/v3/projects/5fc2b15a038b4288be0d140f28e9e5c8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:55.333243 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a1e5e-e9b7-4de5-b2fa-dd92f2442ddd service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:55.342586 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a1e5e-e9b7-4de5-b2fa-dd92f2442ddd service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:55.360090 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:55.526231 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd8b22-a269-4f05-b7e5-18ed088faf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:55.527099 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd8b22-a269-4f05-b7e5-18ed088faf48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:55.527385 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd8b22-a269-4f05-b7e5-18ed088faf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:55.527663 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd8b22-a269-4f05-b7e5-18ed088faf48 admin admin] PATH_INFO: `/v3/users/c9603dcc668d49a8845bd334e490df8a` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:55.528882 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd8b22-a269-4f05-b7e5-18ed088faf48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9603dcc668d49a8845bd334e490df8a)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:55.530779 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd8b22-a269-4f05-b7e5-18ed088faf48 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:55.712005 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-0bcd8b22-a269-4f05-b7e5-18ed088faf48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9603dcc668d49a8845bd334e490df8a'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:55.712611 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-0bcd8b22-a269-4f05-b7e5-18ed088faf48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9603dcc668d49a8845bd334e490df8a'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:55.713290 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-0bcd8b22-a269-4f05-b7e5-18ed088faf48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9603dcc668d49a8845bd334e490df8a'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:55.725720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-0bcd8b22-a269-4f05-b7e5-18ed088faf48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9603dcc668d49a8845bd334e490df8a'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:55.733407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-0bcd8b22-a269-4f05-b7e5-18ed088faf48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9603dcc668d49a8845bd334e490df8a'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:55.805673 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1432/2872] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 22:01:55 2022] DELETE /identity/v3/users/c9603dcc668d49a8845bd334e490df8a => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:56.253804 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f05b03-edd2-4fbf-83dd-28071dee20c7 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:56.255250 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-83f05b03-edd2-4fbf-83dd-28071dee20c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:56.270840 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f05b03-edd2-4fbf-83dd-28071dee20c7 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:56.327617 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1191e48-cc53-488e-be4b-144bc69956f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:56.328482 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1191e48-cc53-488e-be4b-144bc69956f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:56.328796 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1191e48-cc53-488e-be4b-144bc69956f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:56.329074 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1191e48-cc53-488e-be4b-144bc69956f0 admin admin] PATH_INFO: `/v3/projects/dc120f8546d54de2a3ea10f9ad11751a` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:56.330675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1191e48-cc53-488e-be4b-144bc69956f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc120f8546d54de2a3ea10f9ad11751a)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:56.332568 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1191e48-cc53-488e-be4b-144bc69956f0 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:56.419140 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:56.435289 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-d1191e48-cc53-488e-be4b-144bc69956f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc120f8546d54de2a3ea10f9ad11751a', 'request_id': 'req-d1191e48-cc53-488e-be4b-144bc69956f0'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:56.440780 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-d1191e48-cc53-488e-be4b-144bc69956f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc120f8546d54de2a3ea10f9ad11751a', 'request_id': 'req-d1191e48-cc53-488e-be4b-144bc69956f0'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:56.540556 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-d1191e48-cc53-488e-be4b-144bc69956f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc120f8546d54de2a3ea10f9ad11751a', 'request_id': 'req-d1191e48-cc53-488e-be4b-144bc69956f0'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:56.552239 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-d1191e48-cc53-488e-be4b-144bc69956f0 admin admin] The token cache is being invalidate because project dc120f8546d54de2a3ea10f9ad11751a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 22:01:56.552558 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-d1191e48-cc53-488e-be4b-144bc69956f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:56.553265 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-d1191e48-cc53-488e-be4b-144bc69956f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:56.555021 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1441/2873] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 22:01:56 2022] DELETE /identity/v3/projects/dc120f8546d54de2a3ea10f9ad11751a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:56.560777 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719a5f2-3c36-43c5-bcea-d2d05d621f6d None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:56.561251 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719a5f2-3c36-43c5-bcea-d2d05d621f6d None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:56.561350 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719a5f2-3c36-43c5-bcea-d2d05d621f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:56.579785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-6719a5f2-3c36-43c5-bcea-d2d05d621f6d None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:56.581049 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-6719a5f2-3c36-43c5-bcea-d2d05d621f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:56.641670 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1433/2874] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 22:01:56.649608 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0983f54-d92c-4266-80bf-26fed2ab4823 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:56.649903 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0983f54-d92c-4266-80bf-26fed2ab4823 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:56.650320 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0983f54-d92c-4266-80bf-26fed2ab4823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:56.690130 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-e0983f54-d92c-4266-80bf-26fed2ab4823 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:56.691426 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e0983f54-d92c-4266-80bf-26fed2ab4823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:56.699415 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1442/2875] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:01:56.703638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719a5f2-3c36-43c5-bcea-d2d05d621f6d None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:56.713254 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719a5f2-3c36-43c5-bcea-d2d05d621f6d None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:56.719957 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346714f0-1043-4031-b0cf-93264df8a0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:56.719957 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346714f0-1043-4031-b0cf-93264df8a0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:56.719957 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346714f0-1043-4031-b0cf-93264df8a0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:56.719957 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346714f0-1043-4031-b0cf-93264df8a0f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:56.720369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346714f0-1043-4031-b0cf-93264df8a0f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 22:01:56.720712 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346714f0-1043-4031-b0cf-93264df8a0f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:56.722295 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346714f0-1043-4031-b0cf-93264df8a0f4 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:56.734347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1434/2876] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 22:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 22:01:56.738731 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0983f54-d92c-4266-80bf-26fed2ab4823 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:56.747853 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0983f54-d92c-4266-80bf-26fed2ab4823 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:56.752936 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f6c3c-e545-425e-a92d-3b57b2bdb70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:56.753590 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f6c3c-e545-425e-a92d-3b57b2bdb70f admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:56.753874 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f6c3c-e545-425e-a92d-3b57b2bdb70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:56.754149 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f6c3c-e545-425e-a92d-3b57b2bdb70f admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:56.754836 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f6c3c-e545-425e-a92d-3b57b2bdb70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:56.756812 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f6c3c-e545-425e-a92d-3b57b2bdb70f admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:56.839344 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1443/2877] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 22:01:56 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:01:56.843396 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346714f0-1043-4031-b0cf-93264df8a0f4 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:56.853368 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346714f0-1043-4031-b0cf-93264df8a0f4 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:56.879408 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:56.909426 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b6f2e-df84-4434-8618-32a3f19fa208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:56.910129 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b6f2e-df84-4434-8618-32a3f19fa208 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:56.910440 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b6f2e-df84-4434-8618-32a3f19fa208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:56.910763 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b6f2e-df84-4434-8618-32a3f19fa208 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:56.911489 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b6f2e-df84-4434-8618-32a3f19fa208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:56.913907 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b6f2e-df84-4434-8618-32a3f19fa208 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:57.028883 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1435/2878] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 22:01:56 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:01:57.033045 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f6c3c-e545-425e-a92d-3b57b2bdb70f admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:57.043464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f6c3c-e545-425e-a92d-3b57b2bdb70f admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:57.047997 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7597d-9a28-4d77-b0bf-ce70d87bcf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:57.049443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7597d-9a28-4d77-b0bf-ce70d87bcf24 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:57.049443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7597d-9a28-4d77-b0bf-ce70d87bcf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:57.049443 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7597d-9a28-4d77-b0bf-ce70d87bcf24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:57.049955 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7597d-9a28-4d77-b0bf-ce70d87bcf24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:57.051566 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7597d-9a28-4d77-b0bf-ce70d87bcf24 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:57.061916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1444/2879] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:01:57.065728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b6f2e-df84-4434-8618-32a3f19fa208 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:57.076188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b6f2e-df84-4434-8618-32a3f19fa208 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:57.081023 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170ae57-9536-4260-b7cc-4577cd4c3e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:57.081668 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170ae57-9536-4260-b7cc-4577cd4c3e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:57.081948 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170ae57-9536-4260-b7cc-4577cd4c3e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:57.082223 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170ae57-9536-4260-b7cc-4577cd4c3e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:57.082935 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170ae57-9536-4260-b7cc-4577cd4c3e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:57.084509 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170ae57-9536-4260-b7cc-4577cd4c3e20 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:57.094777 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1436/2880] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:01:57.098518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7597d-9a28-4d77-b0bf-ce70d87bcf24 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:57.108282 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7597d-9a28-4d77-b0bf-ce70d87bcf24 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:57.112863 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f8e0f-3c50-48df-9fa7-c2d985e9e8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:57.113739 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f8e0f-3c50-48df-9fa7-c2d985e9e8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:57.114024 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f8e0f-3c50-48df-9fa7-c2d985e9e8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:57.114303 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f8e0f-3c50-48df-9fa7-c2d985e9e8bc admin admin] PATH_INFO: `/v3/projects/f60ff3921e7f4afe9eb10c8e7496d0a4/users/2eaf438e0ea0446395c71ca05b9810b2/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:57.128679 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f8e0f-3c50-48df-9fa7-c2d985e9e8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60ff3921e7f4afe9eb10c8e7496d0a4, user_id=2eaf438e0ea0446395c71ca05b9810b2, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:57.131294 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f8e0f-3c50-48df-9fa7-c2d985e9e8bc admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:57.234738 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1445/2881] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 22:01:57 2022] PUT /identity/v3/projects/f60ff3921e7f4afe9eb10c8e7496d0a4/users/2eaf438e0ea0446395c71ca05b9810b2/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 22:01:57.244942 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d61350-cbe1-4453-bf16-ba4fc54ed6a7 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:57.245227 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d61350-cbe1-4453-bf16-ba4fc54ed6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:57.245500 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d61350-cbe1-4453-bf16-ba4fc54ed6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:57.271383 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-09d61350-cbe1-4453-bf16-ba4fc54ed6a7 None None] MFA Rules not processed for user `2eaf438e0ea0446395c71ca05b9810b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:57.272574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-09d61350-cbe1-4453-bf16-ba4fc54ed6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:57.334525 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1437/2882] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:01:57.339568 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f8e0f-3c50-48df-9fa7-c2d985e9e8bc admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:57.399688 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f8e0f-3c50-48df-9fa7-c2d985e9e8bc admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:57.404846 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db05648-32e2-4c3f-b840-d2cce001b375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:57.405504 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db05648-32e2-4c3f-b840-d2cce001b375 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:57.405794 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db05648-32e2-4c3f-b840-d2cce001b375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:57.406077 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db05648-32e2-4c3f-b840-d2cce001b375 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:57.406771 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db05648-32e2-4c3f-b840-d2cce001b375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:57.408703 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db05648-32e2-4c3f-b840-d2cce001b375 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:57.507822 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1446/2883] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 22:01:57 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 22:01:57.511672 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d61350-cbe1-4453-bf16-ba4fc54ed6a7 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:57.522304 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d61350-cbe1-4453-bf16-ba4fc54ed6a7 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:57.580091 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3f7fa-1bda-44fb-a07a-d68c36000089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:57.580795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3f7fa-1bda-44fb-a07a-d68c36000089 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:57.581075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3f7fa-1bda-44fb-a07a-d68c36000089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:57.581345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3f7fa-1bda-44fb-a07a-d68c36000089 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:57.582039 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3f7fa-1bda-44fb-a07a-d68c36000089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:57.583983 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3f7fa-1bda-44fb-a07a-d68c36000089 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:57.672529 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1438/2884] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 22:01:57 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:01:57.676392 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db05648-32e2-4c3f-b840-d2cce001b375 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:57.693934 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db05648-32e2-4c3f-b840-d2cce001b375 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:57.698640 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00418544-0ae0-4a66-be53-d8389cb3e505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:57.699301 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00418544-0ae0-4a66-be53-d8389cb3e505 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:57.699589 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00418544-0ae0-4a66-be53-d8389cb3e505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:57.699869 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00418544-0ae0-4a66-be53-d8389cb3e505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:57.700670 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00418544-0ae0-4a66-be53-d8389cb3e505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:57.702210 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00418544-0ae0-4a66-be53-d8389cb3e505 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:57.712690 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1447/2885] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:01:57.717176 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3f7fa-1bda-44fb-a07a-d68c36000089 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:57.727577 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3f7fa-1bda-44fb-a07a-d68c36000089 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:57.732840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec169c42-967c-45d4-a1de-c28ead39b4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:57.733797 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec169c42-967c-45d4-a1de-c28ead39b4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:57.734075 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec169c42-967c-45d4-a1de-c28ead39b4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:57.734348 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec169c42-967c-45d4-a1de-c28ead39b4e9 admin admin] PATH_INFO: `/v3/projects/fe900ad7881b457597dbf06a26a4ba4f/users/30c721ef253842c1ab6e00856df1ef26/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:57.748854 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec169c42-967c-45d4-a1de-c28ead39b4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe900ad7881b457597dbf06a26a4ba4f, user_id=30c721ef253842c1ab6e00856df1ef26, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:57.751446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec169c42-967c-45d4-a1de-c28ead39b4e9 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:57.820401 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1439/2886] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 22:01:57 2022] PUT /identity/v3/projects/fe900ad7881b457597dbf06a26a4ba4f/users/30c721ef253842c1ab6e00856df1ef26/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:57.824747 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00418544-0ae0-4a66-be53-d8389cb3e505 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:57.834591 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00418544-0ae0-4a66-be53-d8389cb3e505 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:57.854340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:57.890263 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd712c8a-c109-41a8-8c28-7b5852e5ed2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:57.890917 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd712c8a-c109-41a8-8c28-7b5852e5ed2a admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:57.891197 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd712c8a-c109-41a8-8c28-7b5852e5ed2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:57.891469 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd712c8a-c109-41a8-8c28-7b5852e5ed2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:57.892186 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd712c8a-c109-41a8-8c28-7b5852e5ed2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:57.893822 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd712c8a-c109-41a8-8c28-7b5852e5ed2a admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:57.903829 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1448/2887] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:01:57.907900 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec169c42-967c-45d4-a1de-c28ead39b4e9 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:57.913337 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:57.918488 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec169c42-967c-45d4-a1de-c28ead39b4e9 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:57.925638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83324aad-bcaf-4dac-bfdb-d9984f6c20ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:57.925638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83324aad-bcaf-4dac-bfdb-d9984f6c20ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:57.925638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83324aad-bcaf-4dac-bfdb-d9984f6c20ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:57.925638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83324aad-bcaf-4dac-bfdb-d9984f6c20ef admin admin] PATH_INFO: `/v3/projects/fe900ad7881b457597dbf06a26a4ba4f/users/30c721ef253842c1ab6e00856df1ef26/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:57.926759 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83324aad-bcaf-4dac-bfdb-d9984f6c20ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe900ad7881b457597dbf06a26a4ba4f, user_id=30c721ef253842c1ab6e00856df1ef26, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:57.929426 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83324aad-bcaf-4dac-bfdb-d9984f6c20ef admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:57.939342 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1440/2888] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 22:01:57 2022] PUT /identity/v3/projects/fe900ad7881b457597dbf06a26a4ba4f/users/30c721ef253842c1ab6e00856df1ef26/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:57.950876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971ebec-f67b-4411-9314-97d67af75887 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:57.954383 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971ebec-f67b-4411-9314-97d67af75887 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:57.954383 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971ebec-f67b-4411-9314-97d67af75887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:57.978690 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-4971ebec-f67b-4411-9314-97d67af75887 None None] MFA Rules not processed for user `30c721ef253842c1ab6e00856df1ef26`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:57.979919 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-4971ebec-f67b-4411-9314-97d67af75887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:58.047050 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1449/2889] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:01:58.058283 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83324aad-bcaf-4dac-bfdb-d9984f6c20ef admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:58.059977 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-83324aad-bcaf-4dac-bfdb-d9984f6c20ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:58.116927 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83324aad-bcaf-4dac-bfdb-d9984f6c20ef admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:58.121430 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a98eb-42bd-4aef-a6e5-efd517d45174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:58.122067 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a98eb-42bd-4aef-a6e5-efd517d45174 service cinder] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:58.122347 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a98eb-42bd-4aef-a6e5-efd517d45174 service cinder] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:58.122621 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a98eb-42bd-4aef-a6e5-efd517d45174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:58.132303 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a98eb-42bd-4aef-a6e5-efd517d45174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:58.133762 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a98eb-42bd-4aef-a6e5-efd517d45174 service cinder] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:58.143551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1441/2890] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:01:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:01:58.296209 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971ebec-f67b-4411-9314-97d67af75887 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:58.305649 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971ebec-f67b-4411-9314-97d67af75887 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:58.309696 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d20513-6c1d-4108-91e4-272edef7ae71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:58.310332 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d20513-6c1d-4108-91e4-272edef7ae71 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:58.310612 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d20513-6c1d-4108-91e4-272edef7ae71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:58.310888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d20513-6c1d-4108-91e4-272edef7ae71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:58.365876 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d20513-6c1d-4108-91e4-272edef7ae71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:58.367354 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d20513-6c1d-4108-91e4-272edef7ae71 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:58.377316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1450/2891] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:01:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:01:58.869503 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a98eb-42bd-4aef-a6e5-efd517d45174 service cinder] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:58.928983 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a98eb-42bd-4aef-a6e5-efd517d45174 service cinder] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:58.933411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6a674-67ca-4eec-9464-1b1500ccd5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:58.934253 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6a674-67ca-4eec-9464-1b1500ccd5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:58.934531 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6a674-67ca-4eec-9464-1b1500ccd5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:58.934801 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6a674-67ca-4eec-9464-1b1500ccd5f6 admin admin] PATH_INFO: `/v3/users/2eaf438e0ea0446395c71ca05b9810b2` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:58.935952 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6a674-67ca-4eec-9464-1b1500ccd5f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eaf438e0ea0446395c71ca05b9810b2)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:58.937861 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6a674-67ca-4eec-9464-1b1500ccd5f6 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:59.079411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1bb6a674-67ca-4eec-9464-1b1500ccd5f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eaf438e0ea0446395c71ca05b9810b2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:59.079987 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1bb6a674-67ca-4eec-9464-1b1500ccd5f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eaf438e0ea0446395c71ca05b9810b2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:59.080555 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1bb6a674-67ca-4eec-9464-1b1500ccd5f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eaf438e0ea0446395c71ca05b9810b2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:59.093263 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1bb6a674-67ca-4eec-9464-1b1500ccd5f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eaf438e0ea0446395c71ca05b9810b2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:59.099990 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-1bb6a674-67ca-4eec-9464-1b1500ccd5f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eaf438e0ea0446395c71ca05b9810b2'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:59.188101 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1442/2892] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 22:01:58 2022] DELETE /identity/v3/users/2eaf438e0ea0446395c71ca05b9810b2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:59.192517 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd65e5-0db3-4f4c-8193-acb68d0940d0 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:59.192841 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd65e5-0db3-4f4c-8193-acb68d0940d0 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:59.193121 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd65e5-0db3-4f4c-8193-acb68d0940d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:59.209948 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-d0dd65e5-0db3-4f4c-8193-acb68d0940d0 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:01:59.211154 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d0dd65e5-0db3-4f4c-8193-acb68d0940d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:59.251278 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=100 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:59.269799 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1451/2893] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:01:59.280184 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6a674-67ca-4eec-9464-1b1500ccd5f6 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:59.281605 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-1bb6a674-67ca-4eec-9464-1b1500ccd5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:59.294812 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:59.337463 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6a674-67ca-4eec-9464-1b1500ccd5f6 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:59.341556 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603db54c-be5d-4cde-bfc8-e4d201da818f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:59.342205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603db54c-be5d-4cde-bfc8-e4d201da818f service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:59.342520 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603db54c-be5d-4cde-bfc8-e4d201da818f service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:59.342820 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603db54c-be5d-4cde-bfc8-e4d201da818f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:59.351752 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603db54c-be5d-4cde-bfc8-e4d201da818f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:59.353615 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603db54c-be5d-4cde-bfc8-e4d201da818f service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:59.362850 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1443/2894] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:01:59.785705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd65e5-0db3-4f4c-8193-acb68d0940d0 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:01:59.787177 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d0dd65e5-0db3-4f4c-8193-acb68d0940d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:01:59.799986 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd65e5-0db3-4f4c-8193-acb68d0940d0 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:01:59.804870 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ba6ee-36aa-40af-b90c-001d3ec59839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:01:59.805739 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ba6ee-36aa-40af-b90c-001d3ec59839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:01:59.806025 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ba6ee-36aa-40af-b90c-001d3ec59839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:01:59.806306 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ba6ee-36aa-40af-b90c-001d3ec59839 admin admin] PATH_INFO: `/v3/projects/f60ff3921e7f4afe9eb10c8e7496d0a4` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:01:59.807500 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ba6ee-36aa-40af-b90c-001d3ec59839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60ff3921e7f4afe9eb10c8e7496d0a4)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:01:59.809506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ba6ee-36aa-40af-b90c-001d3ec59839 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:01:59.923913 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-db5ba6ee-36aa-40af-b90c-001d3ec59839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60ff3921e7f4afe9eb10c8e7496d0a4', 'request_id': 'req-db5ba6ee-36aa-40af-b90c-001d3ec59839'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:59.929321 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-db5ba6ee-36aa-40af-b90c-001d3ec59839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60ff3921e7f4afe9eb10c8e7496d0a4', 'request_id': 'req-db5ba6ee-36aa-40af-b90c-001d3ec59839'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:59.980916 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-db5ba6ee-36aa-40af-b90c-001d3ec59839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60ff3921e7f4afe9eb10c8e7496d0a4', 'request_id': 'req-db5ba6ee-36aa-40af-b90c-001d3ec59839'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:59.991914 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-db5ba6ee-36aa-40af-b90c-001d3ec59839 admin admin] The token cache is being invalidate because project f60ff3921e7f4afe9eb10c8e7496d0a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 22:01:59.992210 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-db5ba6ee-36aa-40af-b90c-001d3ec59839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:59.992860 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-db5ba6ee-36aa-40af-b90c-001d3ec59839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:01:59.994396 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1452/2895] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 22:01:59 2022] DELETE /identity/v3/projects/f60ff3921e7f4afe9eb10c8e7496d0a4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:01:59.998593 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603db54c-be5d-4cde-bfc8-e4d201da818f service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:00.008484 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603db54c-be5d-4cde-bfc8-e4d201da818f service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:00.063326 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb9d5b-7751-42fd-b671-affabdb143b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:00.064185 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb9d5b-7751-42fd-b671-affabdb143b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:00.064468 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb9d5b-7751-42fd-b671-affabdb143b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:00.064769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb9d5b-7751-42fd-b671-affabdb143b6 admin admin] PATH_INFO: `/v3/users/30c721ef253842c1ab6e00856df1ef26` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:00.065936 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb9d5b-7751-42fd-b671-affabdb143b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30c721ef253842c1ab6e00856df1ef26)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:00.067838 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb9d5b-7751-42fd-b671-affabdb143b6 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:00.236024 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3fdb9d5b-7751-42fd-b671-affabdb143b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30c721ef253842c1ab6e00856df1ef26'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:00.236685 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3fdb9d5b-7751-42fd-b671-affabdb143b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30c721ef253842c1ab6e00856df1ef26'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:00.237302 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3fdb9d5b-7751-42fd-b671-affabdb143b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30c721ef253842c1ab6e00856df1ef26'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:00.249094 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3fdb9d5b-7751-42fd-b671-affabdb143b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30c721ef253842c1ab6e00856df1ef26'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:00.255750 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-3fdb9d5b-7751-42fd-b671-affabdb143b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30c721ef253842c1ab6e00856df1ef26'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:00.326288 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1444/2896] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 22:01:59 2022] DELETE /identity/v3/users/30c721ef253842c1ab6e00856df1ef26 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:02:00.731457 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ba6ee-36aa-40af-b90c-001d3ec59839 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:00.732970 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-db5ba6ee-36aa-40af-b90c-001d3ec59839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:00.750218 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ba6ee-36aa-40af-b90c-001d3ec59839 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:00.807084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe07f7-0e8a-48c7-bf23-27484c612ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:00.808236 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe07f7-0e8a-48c7-bf23-27484c612ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:00.809082 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe07f7-0e8a-48c7-bf23-27484c612ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:00.809364 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe07f7-0e8a-48c7-bf23-27484c612ff6 admin admin] PATH_INFO: `/v3/projects/fe900ad7881b457597dbf06a26a4ba4f` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:00.810555 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe07f7-0e8a-48c7-bf23-27484c612ff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe900ad7881b457597dbf06a26a4ba4f)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:00.812464 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe07f7-0e8a-48c7-bf23-27484c612ff6 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:00.941204 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3ffe07f7-0e8a-48c7-bf23-27484c612ff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe900ad7881b457597dbf06a26a4ba4f', 'request_id': 'req-3ffe07f7-0e8a-48c7-bf23-27484c612ff6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:00.946720 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3ffe07f7-0e8a-48c7-bf23-27484c612ff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe900ad7881b457597dbf06a26a4ba4f', 'request_id': 'req-3ffe07f7-0e8a-48c7-bf23-27484c612ff6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:01.026236 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3ffe07f7-0e8a-48c7-bf23-27484c612ff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe900ad7881b457597dbf06a26a4ba4f', 'request_id': 'req-3ffe07f7-0e8a-48c7-bf23-27484c612ff6'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:01.033171 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:02:01.037636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3ffe07f7-0e8a-48c7-bf23-27484c612ff6 admin admin] The token cache is being invalidate because project fe900ad7881b457597dbf06a26a4ba4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 22:02:01.037922 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3ffe07f7-0e8a-48c7-bf23-27484c612ff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:01.038546 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3ffe07f7-0e8a-48c7-bf23-27484c612ff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:01.040082 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1453/2897] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 22:02:00 2022] DELETE /identity/v3/projects/fe900ad7881b457597dbf06a26a4ba4f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:02:01.045573 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e42679-12c2-4bfb-bcc9-816b1b82dc28 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:01.046070 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e42679-12c2-4bfb-bcc9-816b1b82dc28 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:01.046177 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e42679-12c2-4bfb-bcc9-816b1b82dc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:01.068990 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-d9e42679-12c2-4bfb-bcc9-816b1b82dc28 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:02:01.068990 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-d9e42679-12c2-4bfb-bcc9-816b1b82dc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:01.094351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:02:01.124047 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1445/2898] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:02:01.131825 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f31aff-1f3c-4d02-8ed3-40b38097597a None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:01.132122 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f31aff-1f3c-4d02-8ed3-40b38097597a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:01.132396 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f31aff-1f3c-4d02-8ed3-40b38097597a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:01.150151 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-b3f31aff-1f3c-4d02-8ed3-40b38097597a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:02:01.151401 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-b3f31aff-1f3c-4d02-8ed3-40b38097597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:01.160168 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1454/2899] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:02:01.163944 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e42679-12c2-4bfb-bcc9-816b1b82dc28 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:01.174105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e42679-12c2-4bfb-bcc9-816b1b82dc28 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:01.178810 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261712b-265a-44a7-ad54-8b8e3ba19f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:01.179495 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261712b-265a-44a7-ad54-8b8e3ba19f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:01.179773 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261712b-265a-44a7-ad54-8b8e3ba19f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:01.180051 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261712b-265a-44a7-ad54-8b8e3ba19f8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:01.180808 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261712b-265a-44a7-ad54-8b8e3ba19f8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 22:02:01.181170 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261712b-265a-44a7-ad54-8b8e3ba19f8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:01.182790 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261712b-265a-44a7-ad54-8b8e3ba19f8e admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:01.194382 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1446/2900] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 22:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 22:02:01.198354 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f31aff-1f3c-4d02-8ed3-40b38097597a None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:01.208120 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f31aff-1f3c-4d02-8ed3-40b38097597a None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:01.212967 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f100e4-9fc6-4ca8-a9a6-9539bcbde3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:01.213727 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f100e4-9fc6-4ca8-a9a6-9539bcbde3bd admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:01.214012 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f100e4-9fc6-4ca8-a9a6-9539bcbde3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:01.214291 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f100e4-9fc6-4ca8-a9a6-9539bcbde3bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:01.215506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f100e4-9fc6-4ca8-a9a6-9539bcbde3bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:01.217444 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f100e4-9fc6-4ca8-a9a6-9539bcbde3bd admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:01.325415 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1455/2901] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 22:02:01 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:02:01.329414 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261712b-265a-44a7-ad54-8b8e3ba19f8e admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:01.339336 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261712b-265a-44a7-ad54-8b8e3ba19f8e admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:01.394976 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c84156-4d78-4765-80c1-3639ea67ecc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:01.395641 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c84156-4d78-4765-80c1-3639ea67ecc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:01.395928 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c84156-4d78-4765-80c1-3639ea67ecc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:01.396206 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c84156-4d78-4765-80c1-3639ea67ecc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:01.396942 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c84156-4d78-4765-80c1-3639ea67ecc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:01.398920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c84156-4d78-4765-80c1-3639ea67ecc8 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:01.477514 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1447/2902] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 22:02:01 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:02:01.482429 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f100e4-9fc6-4ca8-a9a6-9539bcbde3bd admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:01.492753 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f100e4-9fc6-4ca8-a9a6-9539bcbde3bd admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:01.497452 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512833d5-6b69-427d-8686-23f4a9fe1476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:01.498114 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512833d5-6b69-427d-8686-23f4a9fe1476 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:01.503723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512833d5-6b69-427d-8686-23f4a9fe1476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:01.503723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512833d5-6b69-427d-8686-23f4a9fe1476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:01.503723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512833d5-6b69-427d-8686-23f4a9fe1476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:01.503723 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512833d5-6b69-427d-8686-23f4a9fe1476 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:01.512164 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1456/2903] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:02:01.516030 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c84156-4d78-4765-80c1-3639ea67ecc8 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:01.525764 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c84156-4d78-4765-80c1-3639ea67ecc8 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:01.530993 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6e6f9-b226-4297-aa91-5a9e29924c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:01.531638 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6e6f9-b226-4297-aa91-5a9e29924c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:01.531917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6e6f9-b226-4297-aa91-5a9e29924c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:01.532188 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6e6f9-b226-4297-aa91-5a9e29924c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:01.532961 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6e6f9-b226-4297-aa91-5a9e29924c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:01.534522 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6e6f9-b226-4297-aa91-5a9e29924c3c admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:01.544230 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1448/2904] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:02:01.548137 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512833d5-6b69-427d-8686-23f4a9fe1476 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:01.558135 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512833d5-6b69-427d-8686-23f4a9fe1476 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:01.563053 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e284cee-7bbb-45d3-84a1-b9d463a99b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:01.563945 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e284cee-7bbb-45d3-84a1-b9d463a99b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:01.564229 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e284cee-7bbb-45d3-84a1-b9d463a99b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:01.564506 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e284cee-7bbb-45d3-84a1-b9d463a99b71 admin admin] PATH_INFO: `/v3/projects/fead73e522d847c3bba6457cababc7e4/users/bbaa5af8246c443ca2eb54b20233c09d/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:01.579894 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e284cee-7bbb-45d3-84a1-b9d463a99b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fead73e522d847c3bba6457cababc7e4, user_id=bbaa5af8246c443ca2eb54b20233c09d, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:01.582619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e284cee-7bbb-45d3-84a1-b9d463a99b71 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:01.643931 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1457/2905] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 22:02:01 2022] PUT /identity/v3/projects/fead73e522d847c3bba6457cababc7e4/users/bbaa5af8246c443ca2eb54b20233c09d/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:02:01.655789 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490ad55-9158-4e96-8acc-baf9d51969f1 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:01.656086 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490ad55-9158-4e96-8acc-baf9d51969f1 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:01.656364 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490ad55-9158-4e96-8acc-baf9d51969f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:01.681721 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-f490ad55-9158-4e96-8acc-baf9d51969f1 None None] MFA Rules not processed for user `bbaa5af8246c443ca2eb54b20233c09d`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:02:01.682917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-f490ad55-9158-4e96-8acc-baf9d51969f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:01.744212 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1449/2906] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:02:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:02:01.755393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e284cee-7bbb-45d3-84a1-b9d463a99b71 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:01.757088 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-8e284cee-7bbb-45d3-84a1-b9d463a99b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:01.812561 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e284cee-7bbb-45d3-84a1-b9d463a99b71 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:01.816385 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa712f6-6613-4171-8f5e-0514a3b1dae7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:01.817053 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa712f6-6613-4171-8f5e-0514a3b1dae7 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:01.817337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa712f6-6613-4171-8f5e-0514a3b1dae7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:01.817619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa712f6-6613-4171-8f5e-0514a3b1dae7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:01.826411 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa712f6-6613-4171-8f5e-0514a3b1dae7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:01.827826 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa712f6-6613-4171-8f5e-0514a3b1dae7 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:01.836393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1458/2907] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:02:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:02:11.741378 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:02:11.832446 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:02:29.659792 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490ad55-9158-4e96-8acc-baf9d51969f1 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:29.721505 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490ad55-9158-4e96-8acc-baf9d51969f1 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:29.726057 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea7982-205c-4655-acd9-d18acb9a23d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:29.726925 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea7982-205c-4655-acd9-d18acb9a23d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:29.727207 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea7982-205c-4655-acd9-d18acb9a23d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:29.727514 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea7982-205c-4655-acd9-d18acb9a23d0 admin admin] PATH_INFO: `/v3/users/bbaa5af8246c443ca2eb54b20233c09d` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:29.728753 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea7982-205c-4655-acd9-d18acb9a23d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbaa5af8246c443ca2eb54b20233c09d)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:29.730780 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea7982-205c-4655-acd9-d18acb9a23d0 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:29.879971 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-05ea7982-205c-4655-acd9-d18acb9a23d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbaa5af8246c443ca2eb54b20233c09d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:29.880556 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-05ea7982-205c-4655-acd9-d18acb9a23d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbaa5af8246c443ca2eb54b20233c09d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:29.881816 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-05ea7982-205c-4655-acd9-d18acb9a23d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbaa5af8246c443ca2eb54b20233c09d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:29.893269 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-05ea7982-205c-4655-acd9-d18acb9a23d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbaa5af8246c443ca2eb54b20233c09d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:29.899867 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-05ea7982-205c-4655-acd9-d18acb9a23d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbaa5af8246c443ca2eb54b20233c09d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:29.983370 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1450/2908] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 22:02:29 2022] DELETE /identity/v3/users/bbaa5af8246c443ca2eb54b20233c09d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:02:29.987962 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f22b4f-21ca-4472-85cb-bfab9a4d1214 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:29.993204 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f22b4f-21ca-4472-85cb-bfab9a4d1214 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:29.993204 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f22b4f-21ca-4472-85cb-bfab9a4d1214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:30.007106 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-d4f22b4f-21ca-4472-85cb-bfab9a4d1214 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:02:30.008317 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d4f22b4f-21ca-4472-85cb-bfab9a4d1214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:30.064739 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1459/2909] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:02:30.074827 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea7982-205c-4655-acd9-d18acb9a23d0 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:30.076209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-05ea7982-205c-4655-acd9-d18acb9a23d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:30.131846 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea7982-205c-4655-acd9-d18acb9a23d0 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:30.135355 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d8d74-7ea2-4182-accf-c69a9b00947a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:30.135985 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d8d74-7ea2-4182-accf-c69a9b00947a service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:30.136264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d8d74-7ea2-4182-accf-c69a9b00947a service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:30.136535 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d8d74-7ea2-4182-accf-c69a9b00947a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:30.145203 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d8d74-7ea2-4182-accf-c69a9b00947a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:30.146609 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d8d74-7ea2-4182-accf-c69a9b00947a service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:30.155723 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1451/2910] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:02:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:02:30.533760 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f22b4f-21ca-4472-85cb-bfab9a4d1214 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:30.535233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d4f22b4f-21ca-4472-85cb-bfab9a4d1214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:30.550491 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f22b4f-21ca-4472-85cb-bfab9a4d1214 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:30.556882 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda03a5-e7f7-46d3-8ce0-cfbe03b1d190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:30.560215 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda03a5-e7f7-46d3-8ce0-cfbe03b1d190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:30.560215 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda03a5-e7f7-46d3-8ce0-cfbe03b1d190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:30.560215 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda03a5-e7f7-46d3-8ce0-cfbe03b1d190 admin admin] PATH_INFO: `/v3/projects/fead73e522d847c3bba6457cababc7e4` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:30.560215 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda03a5-e7f7-46d3-8ce0-cfbe03b1d190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fead73e522d847c3bba6457cababc7e4)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:30.561974 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda03a5-e7f7-46d3-8ce0-cfbe03b1d190 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:30.687059 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3cda03a5-e7f7-46d3-8ce0-cfbe03b1d190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fead73e522d847c3bba6457cababc7e4', 'request_id': 'req-3cda03a5-e7f7-46d3-8ce0-cfbe03b1d190'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:30.692422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3cda03a5-e7f7-46d3-8ce0-cfbe03b1d190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fead73e522d847c3bba6457cababc7e4', 'request_id': 'req-3cda03a5-e7f7-46d3-8ce0-cfbe03b1d190'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:30.777707 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3cda03a5-e7f7-46d3-8ce0-cfbe03b1d190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fead73e522d847c3bba6457cababc7e4', 'request_id': 'req-3cda03a5-e7f7-46d3-8ce0-cfbe03b1d190'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:30.790499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3cda03a5-e7f7-46d3-8ce0-cfbe03b1d190 admin admin] The token cache is being invalidate because project fead73e522d847c3bba6457cababc7e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 22:02:30.790909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3cda03a5-e7f7-46d3-8ce0-cfbe03b1d190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:30.791696 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-3cda03a5-e7f7-46d3-8ce0-cfbe03b1d190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:30.793521 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1460/2911] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 22:02:30 2022] DELETE /identity/v3/projects/fead73e522d847c3bba6457cababc7e4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:02:30.798795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5160db-0966-419c-9e48-ebf66b2648ce None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:30.799277 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5160db-0966-419c-9e48-ebf66b2648ce None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:30.799379 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5160db-0966-419c-9e48-ebf66b2648ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:30.816819 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-ed5160db-0966-419c-9e48-ebf66b2648ce None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:02:30.818040 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ed5160db-0966-419c-9e48-ebf66b2648ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:30.834671 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:02:30.875558 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1452/2912] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:02:30.884134 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab503e-b9af-4963-bb55-b9724313c7db None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:30.884428 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab503e-b9af-4963-bb55-b9724313c7db None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:30.884750 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab503e-b9af-4963-bb55-b9724313c7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:30.903361 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-dfab503e-b9af-4963-bb55-b9724313c7db None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:02:30.904616 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-dfab503e-b9af-4963-bb55-b9724313c7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:30.912790 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1461/2913] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:02:30.916866 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5160db-0966-419c-9e48-ebf66b2648ce None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:30.926391 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5160db-0966-419c-9e48-ebf66b2648ce None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:30.931600 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024450e-7986-49aa-9638-e91110a084d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:30.932244 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024450e-7986-49aa-9638-e91110a084d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:30.932519 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024450e-7986-49aa-9638-e91110a084d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:30.932831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024450e-7986-49aa-9638-e91110a084d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:30.933544 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024450e-7986-49aa-9638-e91110a084d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 22:02:30.933842 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024450e-7986-49aa-9638-e91110a084d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:30.935420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024450e-7986-49aa-9638-e91110a084d3 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:30.947342 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1453/2914] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 22:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 22:02:30.951527 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab503e-b9af-4963-bb55-b9724313c7db None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:30.961112 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab503e-b9af-4963-bb55-b9724313c7db None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:30.965711 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a180f69-5d79-49c1-b86d-56573d746ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:30.966357 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a180f69-5d79-49c1-b86d-56573d746ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:30.966639 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a180f69-5d79-49c1-b86d-56573d746ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:30.966911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a180f69-5d79-49c1-b86d-56573d746ed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:30.967634 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a180f69-5d79-49c1-b86d-56573d746ed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:30.969569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a180f69-5d79-49c1-b86d-56573d746ed1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:31.058949 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1462/2915] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 22:02:30 2022] POST /identity/v3/projects => generated 399 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:02:31.063080 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024450e-7986-49aa-9638-e91110a084d3 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:31.073190 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024450e-7986-49aa-9638-e91110a084d3 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:31.127400 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc5f4c-0e67-4cdf-86b4-ec0e288ce3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:31.128091 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc5f4c-0e67-4cdf-86b4-ec0e288ce3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:31.128374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc5f4c-0e67-4cdf-86b4-ec0e288ce3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:31.128690 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc5f4c-0e67-4cdf-86b4-ec0e288ce3d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:31.129404 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc5f4c-0e67-4cdf-86b4-ec0e288ce3d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:31.131905 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc5f4c-0e67-4cdf-86b4-ec0e288ce3d5 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:31.206351 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1454/2916] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 22:02:31 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:02:31.211081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a180f69-5d79-49c1-b86d-56573d746ed1 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:31.221438 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a180f69-5d79-49c1-b86d-56573d746ed1 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:31.226010 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1746eb9-df76-4b9a-8e8d-9c7f84c750a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:31.226670 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1746eb9-df76-4b9a-8e8d-9c7f84c750a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:31.226955 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1746eb9-df76-4b9a-8e8d-9c7f84c750a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:31.227235 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1746eb9-df76-4b9a-8e8d-9c7f84c750a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:31.227953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1746eb9-df76-4b9a-8e8d-9c7f84c750a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:31.229569 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1746eb9-df76-4b9a-8e8d-9c7f84c750a7 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:31.239750 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1463/2917] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:02:31.244159 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc5f4c-0e67-4cdf-86b4-ec0e288ce3d5 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:31.254992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc5f4c-0e67-4cdf-86b4-ec0e288ce3d5 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:31.260314 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27001ef1-60f3-4f01-bb82-ccb01bb92cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:31.261003 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27001ef1-60f3-4f01-bb82-ccb01bb92cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:31.261293 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27001ef1-60f3-4f01-bb82-ccb01bb92cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:31.261574 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27001ef1-60f3-4f01-bb82-ccb01bb92cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:31.262296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27001ef1-60f3-4f01-bb82-ccb01bb92cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:31.263892 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27001ef1-60f3-4f01-bb82-ccb01bb92cd9 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:31.273720 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1455/2918] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:02:31.277672 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1746eb9-df76-4b9a-8e8d-9c7f84c750a7 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:31.287460 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1746eb9-df76-4b9a-8e8d-9c7f84c750a7 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:31.293376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edabe0-aa51-4cec-88d9-4197e63df779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:31.293376 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edabe0-aa51-4cec-88d9-4197e63df779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:31.293615 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edabe0-aa51-4cec-88d9-4197e63df779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:31.293705 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edabe0-aa51-4cec-88d9-4197e63df779 admin admin] PATH_INFO: `/v3/projects/14839f35db4e4d78ac7a54e78b9612a7/users/2453da2b4c6240a2bbf37f945483399f/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:31.308600 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edabe0-aa51-4cec-88d9-4197e63df779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14839f35db4e4d78ac7a54e78b9612a7, user_id=2453da2b4c6240a2bbf37f945483399f, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:31.311267 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edabe0-aa51-4cec-88d9-4197e63df779 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:31.392484 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1464/2919] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 22:02:31 2022] PUT /identity/v3/projects/14839f35db4e4d78ac7a54e78b9612a7/users/2453da2b4c6240a2bbf37f945483399f/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:02:31.403327 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cd4c7-7592-4d35-a35e-44b8e603e295 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:31.403618 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cd4c7-7592-4d35-a35e-44b8e603e295 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:31.403898 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cd4c7-7592-4d35-a35e-44b8e603e295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:31.430264 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-ae6cd4c7-7592-4d35-a35e-44b8e603e295 None None] MFA Rules not processed for user `2453da2b4c6240a2bbf37f945483399f`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:02:31.431459 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-ae6cd4c7-7592-4d35-a35e-44b8e603e295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:31.492098 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1456/2920] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:02:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:02:31.503367 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edabe0-aa51-4cec-88d9-4197e63df779 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:31.505081 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-55edabe0-aa51-4cec-88d9-4197e63df779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:31.528198 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:02:31.573591 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edabe0-aa51-4cec-88d9-4197e63df779 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:31.577324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9aba40-a8d0-4ffe-af8d-e33db8a77a70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628bac94f0c54ac7a14ff19287efd8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:31.577977 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9aba40-a8d0-4ffe-af8d-e33db8a77a70 service cinder] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:31.578263 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9aba40-a8d0-4ffe-af8d-e33db8a77a70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:31.578538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9aba40-a8d0-4ffe-af8d-e33db8a77a70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:31.587158 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9aba40-a8d0-4ffe-af8d-e33db8a77a70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:31.588605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9aba40-a8d0-4ffe-af8d-e33db8a77a70 service cinder] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:31.597768 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1465/2921] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:02:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:02:41.436313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cd4c7-7592-4d35-a35e-44b8e603e295 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:41.455016 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:02:41.497152 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cd4c7-7592-4d35-a35e-44b8e603e295 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:41.502181 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee20bc-d5e1-426e-bc30-c88d13a11028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:41.503043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee20bc-d5e1-426e-bc30-c88d13a11028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:41.503324 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee20bc-d5e1-426e-bc30-c88d13a11028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:41.503599 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee20bc-d5e1-426e-bc30-c88d13a11028 admin admin] PATH_INFO: `/v3/users/2453da2b4c6240a2bbf37f945483399f` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:41.504805 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee20bc-d5e1-426e-bc30-c88d13a11028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2453da2b4c6240a2bbf37f945483399f)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:41.506831 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee20bc-d5e1-426e-bc30-c88d13a11028 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:41.622291 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=22 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:02:41.704148 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-edee20bc-d5e1-426e-bc30-c88d13a11028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2453da2b4c6240a2bbf37f945483399f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:41.704798 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-edee20bc-d5e1-426e-bc30-c88d13a11028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2453da2b4c6240a2bbf37f945483399f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:41.705449 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-edee20bc-d5e1-426e-bc30-c88d13a11028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2453da2b4c6240a2bbf37f945483399f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:41.717043 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-edee20bc-d5e1-426e-bc30-c88d13a11028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2453da2b4c6240a2bbf37f945483399f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:41.723698 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-edee20bc-d5e1-426e-bc30-c88d13a11028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2453da2b4c6240a2bbf37f945483399f'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:41.794683 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1457/2922] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 22:02:41 2022] DELETE /identity/v3/users/2453da2b4c6240a2bbf37f945483399f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:02:41.799130 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45163144-b980-4329-a633-5e8eeb41882a None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:41.799419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45163144-b980-4329-a633-5e8eeb41882a None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:41.799699 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45163144-b980-4329-a633-5e8eeb41882a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:41.817499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-45163144-b980-4329-a633-5e8eeb41882a None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:02:41.818698 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-45163144-b980-4329-a633-5e8eeb41882a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:41.875187 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1466/2923] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:02:41.885333 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee20bc-d5e1-426e-bc30-c88d13a11028 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:41.886759 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-edee20bc-d5e1-426e-bc30-c88d13a11028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:41.941492 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee20bc-d5e1-426e-bc30-c88d13a11028 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:41.945062 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb65e1-dadc-4228-a2a7-9242a882a6c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:41.945700 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb65e1-dadc-4228-a2a7-9242a882a6c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:41.945983 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb65e1-dadc-4228-a2a7-9242a882a6c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:41.946256 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb65e1-dadc-4228-a2a7-9242a882a6c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:41.955661 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb65e1-dadc-4228-a2a7-9242a882a6c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:41.957038 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb65e1-dadc-4228-a2a7-9242a882a6c6 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:41.966178 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1458/2924] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:02:42.348184 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45163144-b980-4329-a633-5e8eeb41882a None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:42.357499 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-45163144-b980-4329-a633-5e8eeb41882a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:42.370419 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45163144-b980-4329-a633-5e8eeb41882a None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:42.376152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20926811-d6b2-4918-bf4e-a851080955e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:42.377078 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20926811-d6b2-4918-bf4e-a851080955e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:42.377364 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20926811-d6b2-4918-bf4e-a851080955e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:42.377643 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20926811-d6b2-4918-bf4e-a851080955e1 admin admin] PATH_INFO: `/v3/projects/14839f35db4e4d78ac7a54e78b9612a7` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:42.378845 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20926811-d6b2-4918-bf4e-a851080955e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14839f35db4e4d78ac7a54e78b9612a7)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:42.380873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20926811-d6b2-4918-bf4e-a851080955e1 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:42.507083 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-20926811-d6b2-4918-bf4e-a851080955e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14839f35db4e4d78ac7a54e78b9612a7', 'request_id': 'req-20926811-d6b2-4918-bf4e-a851080955e1'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:42.512670 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-20926811-d6b2-4918-bf4e-a851080955e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14839f35db4e4d78ac7a54e78b9612a7', 'request_id': 'req-20926811-d6b2-4918-bf4e-a851080955e1'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:42.584096 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-20926811-d6b2-4918-bf4e-a851080955e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14839f35db4e4d78ac7a54e78b9612a7', 'request_id': 'req-20926811-d6b2-4918-bf4e-a851080955e1'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:42.596337 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-20926811-d6b2-4918-bf4e-a851080955e1 admin admin] The token cache is being invalidate because project 14839f35db4e4d78ac7a54e78b9612a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 22:02:42.596857 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-20926811-d6b2-4918-bf4e-a851080955e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:42.597501 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-20926811-d6b2-4918-bf4e-a851080955e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:02:42.599082 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1467/2925] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 22:02:42 2022] DELETE /identity/v3/projects/14839f35db4e4d78ac7a54e78b9612a7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:02:42.604681 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d0adf-54c8-40f7-8b6f-b1d91e1f9c17 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:42.605173 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d0adf-54c8-40f7-8b6f-b1d91e1f9c17 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:42.605286 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d0adf-54c8-40f7-8b6f-b1d91e1f9c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:42.622653 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-532d0adf-54c8-40f7-8b6f-b1d91e1f9c17 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:02:42.623833 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-532d0adf-54c8-40f7-8b6f-b1d91e1f9c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:42.656372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:02:42.681156 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1459/2926] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:02:42.688915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ce88d-ef33-4c19-8255-e2fe38c800ef None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:42.689404 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ce88d-ef33-4c19-8255-e2fe38c800ef None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:42.689516 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ce88d-ef33-4c19-8255-e2fe38c800ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:42.709429 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-b70ce88d-ef33-4c19-8255-e2fe38c800ef None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:02:42.710678 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-b70ce88d-ef33-4c19-8255-e2fe38c800ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:42.719948 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1468/2927] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:02:42.724374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d0adf-54c8-40f7-8b6f-b1d91e1f9c17 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:42.735733 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d0adf-54c8-40f7-8b6f-b1d91e1f9c17 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:42.740420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5109f-528b-4e15-9e93-218bad8eae4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:42.741125 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5109f-528b-4e15-9e93-218bad8eae4a admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:42.741411 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5109f-528b-4e15-9e93-218bad8eae4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:42.741688 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5109f-528b-4e15-9e93-218bad8eae4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:42.742428 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5109f-528b-4e15-9e93-218bad8eae4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 22:02:42.742734 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5109f-528b-4e15-9e93-218bad8eae4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:42.744390 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5109f-528b-4e15-9e93-218bad8eae4a admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:42.758071 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1460/2928] 10.222.0.66 () {58 vars in 1152 bytes} [Thu May 26 22:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 22:02:42.762384 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ce88d-ef33-4c19-8255-e2fe38c800ef None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:42.771824 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ce88d-ef33-4c19-8255-e2fe38c800ef None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:42.777175 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e816c03-90b2-4d8b-a999-9e557a40018f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:42.777841 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e816c03-90b2-4d8b-a999-9e557a40018f admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:42.778122 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e816c03-90b2-4d8b-a999-9e557a40018f admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:42.778397 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e816c03-90b2-4d8b-a999-9e557a40018f admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:42.779098 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e816c03-90b2-4d8b-a999-9e557a40018f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:42.781040 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e816c03-90b2-4d8b-a999-9e557a40018f admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:42.874524 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1469/2929] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 22:02:42 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:02:42.878420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5109f-528b-4e15-9e93-218bad8eae4a admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:42.889045 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5109f-528b-4e15-9e93-218bad8eae4a admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:42.943796 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ceae7-395a-4ac0-8bc7-c091b9b6597f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:42.944457 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ceae7-395a-4ac0-8bc7-c091b9b6597f admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:42.944779 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ceae7-395a-4ac0-8bc7-c091b9b6597f admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:42.945061 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ceae7-395a-4ac0-8bc7-c091b9b6597f admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:42.945749 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ceae7-395a-4ac0-8bc7-c091b9b6597f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:42.948159 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ceae7-395a-4ac0-8bc7-c091b9b6597f admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:43.061426 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1461/2930] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 22:02:42 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:02:43.065557 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e816c03-90b2-4d8b-a999-9e557a40018f admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:43.076340 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e816c03-90b2-4d8b-a999-9e557a40018f admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:43.080859 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890222d-9fde-41d7-8fd5-6cf641792e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:43.081533 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890222d-9fde-41d7-8fd5-6cf641792e36 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:43.081816 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890222d-9fde-41d7-8fd5-6cf641792e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:43.082091 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890222d-9fde-41d7-8fd5-6cf641792e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:43.082856 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890222d-9fde-41d7-8fd5-6cf641792e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:43.084418 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890222d-9fde-41d7-8fd5-6cf641792e36 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:43.095241 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1470/2931] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:02:43.099154 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ceae7-395a-4ac0-8bc7-c091b9b6597f admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:43.108795 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ceae7-395a-4ac0-8bc7-c091b9b6597f admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:43.113442 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbe418-1a85-4785-9af9-bdee58905722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:43.117628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbe418-1a85-4785-9af9-bdee58905722 admin admin] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:43.117628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbe418-1a85-4785-9af9-bdee58905722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:43.117628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbe418-1a85-4785-9af9-bdee58905722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:43.117628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbe418-1a85-4785-9af9-bdee58905722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:43.117628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbe418-1a85-4785-9af9-bdee58905722 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:43.127262 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1462/2932] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 22:02:43.131261 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890222d-9fde-41d7-8fd5-6cf641792e36 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:43.141621 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890222d-9fde-41d7-8fd5-6cf641792e36 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:43.146273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90395f49-5839-4cf6-9e0e-0d143e44a588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:43.147145 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90395f49-5839-4cf6-9e0e-0d143e44a588 admin admin] REQUEST_METHOD: `PUT` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:43.147428 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90395f49-5839-4cf6-9e0e-0d143e44a588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:43.147706 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90395f49-5839-4cf6-9e0e-0d143e44a588 admin admin] PATH_INFO: `/v3/projects/af865b094acf48e497362e4e6b45ea67/users/6d7359adc4b24e299a2581241255174d/roles/7cbf3c401d60412fbcae272fb8d191cc` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:43.162562 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90395f49-5839-4cf6-9e0e-0d143e44a588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af865b094acf48e497362e4e6b45ea67, user_id=6d7359adc4b24e299a2581241255174d, role_id=7cbf3c401d60412fbcae272fb8d191cc)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:43.165290 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90395f49-5839-4cf6-9e0e-0d143e44a588 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:43.229152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1471/2933] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 22:02:43 2022] PUT /identity/v3/projects/af865b094acf48e497362e4e6b45ea67/users/6d7359adc4b24e299a2581241255174d/roles/7cbf3c401d60412fbcae272fb8d191cc => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:02:43.234078 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dd0ea-4ae4-43ce-88cb-bb22410e0f34 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:43.234376 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dd0ea-4ae4-43ce-88cb-bb22410e0f34 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:43.234656 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dd0ea-4ae4-43ce-88cb-bb22410e0f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:43.252646 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-272dd0ea-4ae4-43ce-88cb-bb22410e0f34 None None] MFA Rules not processed for user `360bd68e46a04911b5f7e4be275448d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:02:43.253840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-272dd0ea-4ae4-43ce-88cb-bb22410e0f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:43.310441 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1463/2934] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:02:43.320236 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90395f49-5839-4cf6-9e0e-0d143e44a588 admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:43.321934 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-90395f49-5839-4cf6-9e0e-0d143e44a588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:43.344421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:02:43.378944 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90395f49-5839-4cf6-9e0e-0d143e44a588 admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:43.382550 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36892c-7f69-46a7-b4ed-075d37a50d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:43.383192 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36892c-7f69-46a7-b4ed-075d37a50d35 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:43.383478 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36892c-7f69-46a7-b4ed-075d37a50d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:43.383757 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36892c-7f69-46a7-b4ed-075d37a50d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:43.392679 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36892c-7f69-46a7-b4ed-075d37a50d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:43.394105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36892c-7f69-46a7-b4ed-075d37a50d35 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:43.404641 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1472/2935] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:02:48.345754 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed36bb-a1c9-4b04-8170-cf386c30eb15 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:48.346218 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed36bb-a1c9-4b04-8170-cf386c30eb15 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:48.346330 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed36bb-a1c9-4b04-8170-cf386c30eb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:48.378424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-55ed36bb-a1c9-4b04-8170-cf386c30eb15 None None] MFA Rules not processed for user `6d7359adc4b24e299a2581241255174d`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:02:48.379557 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-55ed36bb-a1c9-4b04-8170-cf386c30eb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:48.417931 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:02:48.453275 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1464/2936] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:02:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:02:48.457980 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36892c-7f69-46a7-b4ed-075d37a50d35 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:48.473898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36892c-7f69-46a7-b4ed-075d37a50d35 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:48.473898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93590d12-7fdc-4240-8bb1-d05102cb407c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:48.473898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93590d12-7fdc-4240-8bb1-d05102cb407c admin admin] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:48.473898 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93590d12-7fdc-4240-8bb1-d05102cb407c admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:48.474381 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93590d12-7fdc-4240-8bb1-d05102cb407c admin admin] PATH_INFO: `/v3/projects` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:48.474909 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93590d12-7fdc-4240-8bb1-d05102cb407c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:48.476839 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93590d12-7fdc-4240-8bb1-d05102cb407c admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:48.558108 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1473/2937] 10.222.0.66 () {60 vars in 1152 bytes} [Thu May 26 22:02:48 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:02:48.562170 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed36bb-a1c9-4b04-8170-cf386c30eb15 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:48.574139 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed36bb-a1c9-4b04-8170-cf386c30eb15 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:48.634274 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a215d6e-63ae-4085-b843-741bdb160e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:48.635005 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a215d6e-63ae-4085-b843-741bdb160e22 admin admin] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:48.635298 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a215d6e-63ae-4085-b843-741bdb160e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:48.635572 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a215d6e-63ae-4085-b843-741bdb160e22 admin admin] PATH_INFO: `/v3/users` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:48.636269 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a215d6e-63ae-4085-b843-741bdb160e22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:48.638349 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a215d6e-63ae-4085-b843-741bdb160e22 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:48.761920 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1465/2938] 10.222.0.66 () {60 vars in 1143 bytes} [Thu May 26 22:02:48 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 22:02:48.765888 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93590d12-7fdc-4240-8bb1-d05102cb407c admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:48.776827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93590d12-7fdc-4240-8bb1-d05102cb407c admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:48.781390 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdb41b-fbbf-4103-a167-645929fc746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:48.782052 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdb41b-fbbf-4103-a167-645929fc746e admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:48.782342 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdb41b-fbbf-4103-a167-645929fc746e admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:48.782622 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdb41b-fbbf-4103-a167-645929fc746e admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:48.783407 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bdb41b-fbbf-4103-a167-645929fc746e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:48.785314 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bdb41b-fbbf-4103-a167-645929fc746e admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:48.801183 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1474/2939] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:02:48.805424 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a215d6e-63ae-4085-b843-741bdb160e22 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:48.816397 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a215d6e-63ae-4085-b843-741bdb160e22 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:48.821369 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec3783-985f-4f6f-928f-1ceca06e9542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:48.822840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec3783-985f-4f6f-928f-1ceca06e9542 admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:48.823117 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec3783-985f-4f6f-928f-1ceca06e9542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:48.823396 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec3783-985f-4f6f-928f-1ceca06e9542 admin admin] PATH_INFO: `/v3/projects/8717e8d8bf4447e9932bf9b8384a1cc4/users/982b2f4cf3eb4d33b48d79e16fbf53be/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:48.839393 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec3783-985f-4f6f-928f-1ceca06e9542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8717e8d8bf4447e9932bf9b8384a1cc4, user_id=982b2f4cf3eb4d33b48d79e16fbf53be, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:48.842101 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec3783-985f-4f6f-928f-1ceca06e9542 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:48.916436 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1466/2940] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 22:02:48 2022] PUT /identity/v3/projects/8717e8d8bf4447e9932bf9b8384a1cc4/users/982b2f4cf3eb4d33b48d79e16fbf53be/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 22:02:48.920360 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdb41b-fbbf-4103-a167-645929fc746e admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:48.930605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdb41b-fbbf-4103-a167-645929fc746e admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:48.990570 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f9270-5020-4557-8500-1e42bd376ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:48.991421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f9270-5020-4557-8500-1e42bd376ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:48.991778 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f9270-5020-4557-8500-1e42bd376ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:48.992069 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f9270-5020-4557-8500-1e42bd376ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:48.992827 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f9270-5020-4557-8500-1e42bd376ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:48.994999 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f9270-5020-4557-8500-1e42bd376ec2 admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:49.005697 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1475/2941] 10.222.0.66 () {58 vars in 1121 bytes} [Thu May 26 22:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 22:02:49.009840 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec3783-985f-4f6f-928f-1ceca06e9542 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:49.020478 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec3783-985f-4f6f-928f-1ceca06e9542 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:49.025141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc8df8-ce80-4d66-a36f-70cbd59ef83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:49.026032 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc8df8-ce80-4d66-a36f-70cbd59ef83f admin admin] REQUEST_METHOD: `PUT` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:49.026313 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc8df8-ce80-4d66-a36f-70cbd59ef83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:49.026587 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc8df8-ce80-4d66-a36f-70cbd59ef83f admin admin] PATH_INFO: `/v3/projects/8717e8d8bf4447e9932bf9b8384a1cc4/users/982b2f4cf3eb4d33b48d79e16fbf53be/roles/2e83f1fc8fb3416f956854dacd0843c1` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:49.028607 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc8df8-ce80-4d66-a36f-70cbd59ef83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8717e8d8bf4447e9932bf9b8384a1cc4, user_id=982b2f4cf3eb4d33b48d79e16fbf53be, role_id=2e83f1fc8fb3416f956854dacd0843c1)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:49.031260 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc8df8-ce80-4d66-a36f-70cbd59ef83f admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:49.042770 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1467/2942] 10.222.0.66 () {60 vars in 1482 bytes} [Thu May 26 22:02:49 2022] PUT /identity/v3/projects/8717e8d8bf4447e9932bf9b8384a1cc4/users/982b2f4cf3eb4d33b48d79e16fbf53be/roles/2e83f1fc8fb3416f956854dacd0843c1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 22:02:54.471915 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87cb39-1dac-4627-898a-a6c229a21f7e None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:54.472509 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87cb39-1dac-4627-898a-a6c229a21f7e None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:54.472509 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87cb39-1dac-4627-898a-a6c229a21f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:54.499836 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-3a87cb39-1dac-4627-898a-a6c229a21f7e None None] MFA Rules not processed for user `982b2f4cf3eb4d33b48d79e16fbf53be`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:02:54.501194 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-3a87cb39-1dac-4627-898a-a6c229a21f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:54.586424 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1476/2943] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:02:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:02:54.599189 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc8df8-ce80-4d66-a36f-70cbd59ef83f admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:02:54.601296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-19bc8df8-ce80-4d66-a36f-70cbd59ef83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:54.688048 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc8df8-ce80-4d66-a36f-70cbd59ef83f admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:02:54.695490 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08850ccd-f3e3-4b65-a8cf-e34fa5409956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:02:54.701088 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08850ccd-f3e3-4b65-a8cf-e34fa5409956 service nova] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:54.701088 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08850ccd-f3e3-4b65-a8cf-e34fa5409956 service nova] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:54.701088 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08850ccd-f3e3-4b65-a8cf-e34fa5409956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:54.722052 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:02:54.753490 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08850ccd-f3e3-4b65-a8cf-e34fa5409956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:02:54.755105 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08850ccd-f3e3-4b65-a8cf-e34fa5409956 service nova] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:02:54.764813 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1468/2944] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:02:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:02:57.285977 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd6d57-02de-4a75-8964-a6115bb385b4 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:02:57.286474 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd6d57-02de-4a75-8964-a6115bb385b4 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:02:57.286577 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd6d57-02de-4a75-8964-a6115bb385b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:02:57.303613 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-ddcd6d57-02de-4a75-8964-a6115bb385b4 None None] MFA Rules not processed for user `6d7359adc4b24e299a2581241255174d`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:02:57.304841 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ddcd6d57-02de-4a75-8964-a6115bb385b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:02:57.311981 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1477/2945] 10.222.0.66 () {58 vars in 957 bytes} [Thu May 26 22:02:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:03:04.902368 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=16 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:03:07.298437 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:03:22.566133 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08850ccd-f3e3-4b65-a8cf-e34fa5409956 service nova] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:03:22.567545 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-08850ccd-f3e3-4b65-a8cf-e34fa5409956 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:03:22.623728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08850ccd-f3e3-4b65-a8cf-e34fa5409956 service nova] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:03:22.628197 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af869d6f-523c-4010-851f-412989d81c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:03:22.628869 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af869d6f-523c-4010-851f-412989d81c42 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:03:22.629151 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af869d6f-523c-4010-851f-412989d81c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:03:22.629426 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af869d6f-523c-4010-851f-412989d81c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:03:22.631205 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-af869d6f-523c-4010-851f-412989d81c42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:03:22.640765 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af869d6f-523c-4010-851f-412989d81c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:03:22.642209 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af869d6f-523c-4010-851f-412989d81c42 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:03:22.650172 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1469/2946] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:03:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:03:24.330378 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd6d57-02de-4a75-8964-a6115bb385b4 None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:03:24.331784 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-ddcd6d57-02de-4a75-8964-a6115bb385b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:03:24.400655 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd6d57-02de-4a75-8964-a6115bb385b4 None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:03:24.405736 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24a7a5-0ff4-4f4e-8576-4d2c3faa081e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:03:24.406393 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24a7a5-0ff4-4f4e-8576-4d2c3faa081e service placement] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:03:24.406675 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24a7a5-0ff4-4f4e-8576-4d2c3faa081e service placement] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:03:24.406953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24a7a5-0ff4-4f4e-8576-4d2c3faa081e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:03:24.408767 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-9d24a7a5-0ff4-4f4e-8576-4d2c3faa081e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:03:24.421133 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24a7a5-0ff4-4f4e-8576-4d2c3faa081e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:03:24.422727 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24a7a5-0ff4-4f4e-8576-4d2c3faa081e service placement] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:03:24.433744 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1478/2947] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:03:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:03:30.637686 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af869d6f-523c-4010-851f-412989d81c42 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:03:30.647420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af869d6f-523c-4010-851f-412989d81c42 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:03:30.651420 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb54e2-853b-422e-9bec-bbfa5031214d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:03:30.652104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb54e2-853b-422e-9bec-bbfa5031214d service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:03:30.652391 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb54e2-853b-422e-9bec-bbfa5031214d service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:03:30.652705 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb54e2-853b-422e-9bec-bbfa5031214d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:03:30.654616 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-0bfb54e2-853b-422e-9bec-bbfa5031214d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:03:30.665628 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb54e2-853b-422e-9bec-bbfa5031214d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:03:30.673769 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb54e2-853b-422e-9bec-bbfa5031214d service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:03:30.675115 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1470/2948] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:03:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:03:34.429413 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=32 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:03:40.671446 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=32 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:03:42.470611 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24a7a5-0ff4-4f4e-8576-4d2c3faa081e service placement] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:03:42.483366 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24a7a5-0ff4-4f4e-8576-4d2c3faa081e service placement] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:03:42.488789 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feaa310-11a5-47c5-9400-f7d8a19b27b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:03:42.489429 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feaa310-11a5-47c5-9400-f7d8a19b27b6 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:03:42.490316 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feaa310-11a5-47c5-9400-f7d8a19b27b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:03:42.490598 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feaa310-11a5-47c5-9400-f7d8a19b27b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:03:42.492371 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-7feaa310-11a5-47c5-9400-f7d8a19b27b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:03:42.504456 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feaa310-11a5-47c5-9400-f7d8a19b27b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:03:42.508472 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feaa310-11a5-47c5-9400-f7d8a19b27b6 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:03:42.516418 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1479/2949] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:03:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:03:45.585427 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb54e2-853b-422e-9bec-bbfa5031214d service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:03:45.594140 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb54e2-853b-422e-9bec-bbfa5031214d service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:03:45.598001 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afb399-1994-46c1-addc-d7e0585d27cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:03:45.598644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afb399-1994-46c1-addc-d7e0585d27cb service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:03:45.598931 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afb399-1994-46c1-addc-d7e0585d27cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:03:45.599248 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afb399-1994-46c1-addc-d7e0585d27cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:03:45.608906 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afb399-1994-46c1-addc-d7e0585d27cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:03:45.610435 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afb399-1994-46c1-addc-d7e0585d27cb service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:03:45.619785 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1471/2950] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:03:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:03:47.718421 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feaa310-11a5-47c5-9400-f7d8a19b27b6 service nova] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:03:47.719937 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-7feaa310-11a5-47c5-9400-f7d8a19b27b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:03:47.733633 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feaa310-11a5-47c5-9400-f7d8a19b27b6 service nova] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:03:47.739084 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1176cd4-385d-4200-b67e-14f42ef317f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:03:47.739755 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1176cd4-385d-4200-b67e-14f42ef317f6 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:03:47.740037 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1176cd4-385d-4200-b67e-14f42ef317f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:03:47.740312 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1176cd4-385d-4200-b67e-14f42ef317f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:03:47.742071 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-d1176cd4-385d-4200-b67e-14f42ef317f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:03:47.754505 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1176cd4-385d-4200-b67e-14f42ef317f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:03:47.756629 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1176cd4-385d-4200-b67e-14f42ef317f6 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:03:47.767233 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1480/2951] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:03:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:03:55.615553 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=6 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:03:57.762676 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=12 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:04:41.634498 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afb399-1994-46c1-addc-d7e0585d27cb service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:04:41.635915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-a5afb399-1994-46c1-addc-d7e0585d27cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:04:41.698407 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afb399-1994-46c1-addc-d7e0585d27cb service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:04:41.703556 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab770f4-7d18-4f4b-a886-034853be30f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:04:41.704191 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab770f4-7d18-4f4b-a886-034853be30f0 service placement] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:04:41.704480 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab770f4-7d18-4f4b-a886-034853be30f0 service placement] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:04:41.704793 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab770f4-7d18-4f4b-a886-034853be30f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:04:41.706551 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-0ab770f4-7d18-4f4b-a886-034853be30f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:04:41.718367 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab770f4-7d18-4f4b-a886-034853be30f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:04:41.720235 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab770f4-7d18-4f4b-a886-034853be30f0 service placement] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:04:41.730579 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1472/2952] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:04:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:04:51.725742 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=28 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:06:03.288960 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1176cd4-385d-4200-b67e-14f42ef317f6 service nova] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:06:03.308356 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1176cd4-385d-4200-b67e-14f42ef317f6 service nova] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:06:03.311942 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b182037-1fd0-4edb-b7f5-adfd494420d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:06:03.312573 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b182037-1fd0-4edb-b7f5-adfd494420d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:06:03.312879 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b182037-1fd0-4edb-b7f5-adfd494420d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:06:03.313152 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b182037-1fd0-4edb-b7f5-adfd494420d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:06:03.314873 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-6b182037-1fd0-4edb-b7f5-adfd494420d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:06:03.328335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b182037-1fd0-4edb-b7f5-adfd494420d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:06:03.329952 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b182037-1fd0-4edb-b7f5-adfd494420d4 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:06:03.341476 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1481/2953] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:06:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 22:06:11.499166 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab770f4-7d18-4f4b-a886-034853be30f0 service placement] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:06:11.509097 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab770f4-7d18-4f4b-a886-034853be30f0 service placement] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:06:11.512662 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881757d-414c-4c1f-ab28-71ae0c42d57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:06:11.513296 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881757d-414c-4c1f-ab28-71ae0c42d57b service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:06:11.513576 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881757d-414c-4c1f-ab28-71ae0c42d57b service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:06:11.513847 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881757d-414c-4c1f-ab28-71ae0c42d57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:06:11.515571 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-6881757d-414c-4c1f-ab28-71ae0c42d57b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:06:11.529100 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881757d-414c-4c1f-ab28-71ae0c42d57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:06:11.530509 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881757d-414c-4c1f-ab28-71ae0c42d57b service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:06:11.541121 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1473/2954] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:06:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:06:13.336666 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=11 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:06:16.676338 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b182037-1fd0-4edb-b7f5-adfd494420d4 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:06:16.684954 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b182037-1fd0-4edb-b7f5-adfd494420d4 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:06:16.688523 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0471f47-7504-43d9-ab93-094914f6dfcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:06:16.689193 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0471f47-7504-43d9-ab93-094914f6dfcb service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:06:16.689498 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0471f47-7504-43d9-ab93-094914f6dfcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:06:16.689762 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0471f47-7504-43d9-ab93-094914f6dfcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:06:16.691543 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-c0471f47-7504-43d9-ab93-094914f6dfcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:06:16.701386 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0471f47-7504-43d9-ab93-094914f6dfcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:06:16.702797 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0471f47-7504-43d9-ab93-094914f6dfcb service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:06:16.711410 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1482/2955] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:06:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:06:17.094502 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89bdc8-5ffc-44f7-87ce-4b5748f11157 None None] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:06:17.095083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89bdc8-5ffc-44f7-87ce-4b5748f11157 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:06:17.095083 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89bdc8-5ffc-44f7-87ce-4b5748f11157 None None] PATH_INFO: `/` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:06:17.096430 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1474/2956] 10.222.0.66 () {54 vars in 921 bytes} [Thu May 26 22:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 22:06:17.102700 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feb7c1-8ecf-41aa-8857-1be49b826e64 None None] REQUEST_METHOD: `POST` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:06:17.103249 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feb7c1-8ecf-41aa-8857-1be49b826e64 None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:06:17.103605 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feb7c1-8ecf-41aa-8857-1be49b826e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:06:17.154910 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.auth.core [None req-07feb7c1-8ecf-41aa-8857-1be49b826e64 None None] MFA Rules not processed for user `98ec4e37c2714729afec6ad805ed775a`. Rule list: `[]` (Enabled: `True`). {{(pid=80747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:06:17.156296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-07feb7c1-8ecf-41aa-8857-1be49b826e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:06:17.163146 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1483/2957] 10.222.0.66 () {58 vars in 1018 bytes} [Thu May 26 22:06:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:06:17.176732 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89bdc8-5ffc-44f7-87ce-4b5748f11157 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:06:17.188163 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89bdc8-5ffc-44f7-87ce-4b5748f11157 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:06:17.191758 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b502aa-1d36-48a2-8261-f0d1c04b7e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:06:17.192389 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b502aa-1d36-48a2-8261-f0d1c04b7e90 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:06:17.192710 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b502aa-1d36-48a2-8261-f0d1c04b7e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:06:17.192992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b502aa-1d36-48a2-8261-f0d1c04b7e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:06:17.200559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b502aa-1d36-48a2-8261-f0d1c04b7e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:06:17.202004 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b502aa-1d36-48a2-8261-f0d1c04b7e90 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:06:17.209689 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1475/2958] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:06:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:06:17.291763 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87915877-12ec-4eff-8e60-e5688596220c None None] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:06:17.292048 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87915877-12ec-4eff-8e60-e5688596220c None None] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:06:17.292325 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87915877-12ec-4eff-8e60-e5688596220c None None] PATH_INFO: `/` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:06:17.293738 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1484/2959] 10.222.0.66 () {54 vars in 921 bytes} [Thu May 26 22:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 22:06:17.298650 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1c66d-6562-4d74-9af5-99eae5ac62f3 None None] REQUEST_METHOD: `POST` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:06:17.298939 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1c66d-6562-4d74-9af5-99eae5ac62f3 None None] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:06:17.299215 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1c66d-6562-4d74-9af5-99eae5ac62f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:06:17.336858 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.auth.core [None req-b8d1c66d-6562-4d74-9af5-99eae5ac62f3 None None] MFA Rules not processed for user `df008eed25464be387741ee7a1e5ce80`. Rule list: `[]` (Enabled: `True`). {{(pid=80748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 22:06:17.338072 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-b8d1c66d-6562-4d74-9af5-99eae5ac62f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:06:17.347281 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1476/2960] 10.222.0.66 () {58 vars in 1018 bytes} [Thu May 26 22:06:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 22:06:17.358249 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87915877-12ec-4eff-8e60-e5688596220c None None] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:06:17.369268 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87915877-12ec-4eff-8e60-e5688596220c None None] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:06:17.372899 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9ee51-bbfb-4ff2-82f6-3ea04293ec11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:06:17.373538 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9ee51-bbfb-4ff2-82f6-3ea04293ec11 service neutron] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:06:17.373823 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9ee51-bbfb-4ff2-82f6-3ea04293ec11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:06:17.374105 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9ee51-bbfb-4ff2-82f6-3ea04293ec11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:06:17.384297 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9ee51-bbfb-4ff2-82f6-3ea04293ec11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:06:17.385758 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9ee51-bbfb-4ff2-82f6-3ea04293ec11 service neutron] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:06:17.396211 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1485/2961] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:06:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:06:27.334059 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=21 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:06:27.391646 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=25 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:07:59.385532 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1c66d-6562-4d74-9af5-99eae5ac62f3 None None] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:07:59.395452 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1c66d-6562-4d74-9af5-99eae5ac62f3 None None] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:07:59.398981 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d5dfe-386d-4ff9-8cca-56b02edd0cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:07:59.399618 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d5dfe-386d-4ff9-8cca-56b02edd0cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:07:59.399904 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d5dfe-386d-4ff9-8cca-56b02edd0cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:07:59.400181 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d5dfe-386d-4ff9-8cca-56b02edd0cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:07:59.408992 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d5dfe-386d-4ff9-8cca-56b02edd0cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:07:59.410410 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d5dfe-386d-4ff9-8cca-56b02edd0cd2 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:07:59.419011 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1477/2962] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:07:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:08:02.854275 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9ee51-bbfb-4ff2-82f6-3ea04293ec11 service neutron] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:08:02.866194 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9ee51-bbfb-4ff2-82f6-3ea04293ec11 service neutron] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:08:02.871685 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ee997-0bd7-4d1e-af5e-0a6401d0af68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df008eed25464be387741ee7a1e5ce80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:08:02.872324 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ee997-0bd7-4d1e-af5e-0a6401d0af68 service nova] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:08:02.872636 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ee997-0bd7-4d1e-af5e-0a6401d0af68 service nova] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:08:02.872951 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ee997-0bd7-4d1e-af5e-0a6401d0af68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:08:02.874693 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-9b2ee997-0bd7-4d1e-af5e-0a6401d0af68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:08:02.887296 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ee997-0bd7-4d1e-af5e-0a6401d0af68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:08:02.892662 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ee997-0bd7-4d1e-af5e-0a6401d0af68 service nova] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:08:02.899402 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1486/2963] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:08:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:08:05.557617 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d5dfe-386d-4ff9-8cca-56b02edd0cd2 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:08:05.566995 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d5dfe-386d-4ff9-8cca-56b02edd0cd2 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:08:05.570644 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c2b8b-32b8-4738-b534-e18136f27b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ec4e37c2714729afec6ad805ed775a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:08:05.571295 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c2b8b-32b8-4738-b534-e18136f27b44 service neutron] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:08:05.571578 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c2b8b-32b8-4738-b534-e18136f27b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:08:05.571858 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c2b8b-32b8-4738-b534-e18136f27b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:08:05.631652 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c2b8b-32b8-4738-b534-e18136f27b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:08:05.633132 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c2b8b-32b8-4738-b534-e18136f27b44 service neutron] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:08:05.642559 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1478/2964] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:08:08.997991 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ee997-0bd7-4d1e-af5e-0a6401d0af68 service nova] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:08:09.009534 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ee997-0bd7-4d1e-af5e-0a6401d0af68 service nova] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:08:09.023619 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f899a1-b840-4a71-807b-8140b2973d19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:08:09.024315 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f899a1-b840-4a71-807b-8140b2973d19 service placement] REQUEST_METHOD: `GET` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:08:09.024625 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f899a1-b840-4a71-807b-8140b2973d19 service placement] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:08:09.024911 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f899a1-b840-4a71-807b-8140b2973d19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:08:09.026698 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-32f899a1-b840-4a71-807b-8140b2973d19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:08:09.039230 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f899a1-b840-4a71-807b-8140b2973d19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:08:09.040851 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f899a1-b840-4a71-807b-8140b2973d19 service placement] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:08:09.050735 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1487/2965] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:08:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:08:12.506474 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c2b8b-32b8-4738-b534-e18136f27b44 service neutron] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:08:12.535179 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c2b8b-32b8-4738-b534-e18136f27b44 service neutron] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:08:12.539739 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9fcba-9a20-4946-9622-0ca99f72d825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:08:12.540626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9fcba-9a20-4946-9622-0ca99f72d825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:08:12.540916 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9fcba-9a20-4946-9622-0ca99f72d825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:08:12.541196 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9fcba-9a20-4946-9622-0ca99f72d825 admin admin] PATH_INFO: `/v3/users/6d7359adc4b24e299a2581241255174d` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:08:12.542372 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9fcba-9a20-4946-9622-0ca99f72d825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d7359adc4b24e299a2581241255174d)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:08:12.544273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9fcba-9a20-4946-9622-0ca99f72d825 admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:08:12.715917 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-26d9fcba-9a20-4946-9622-0ca99f72d825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d7359adc4b24e299a2581241255174d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:12.716612 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-26d9fcba-9a20-4946-9622-0ca99f72d825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d7359adc4b24e299a2581241255174d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:12.717232 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-26d9fcba-9a20-4946-9622-0ca99f72d825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d7359adc4b24e299a2581241255174d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:12.730169 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-26d9fcba-9a20-4946-9622-0ca99f72d825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d7359adc4b24e299a2581241255174d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:12.736104 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-26d9fcba-9a20-4946-9622-0ca99f72d825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d7359adc4b24e299a2581241255174d'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:12.804374 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1479/2966] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 22:08:12 2022] DELETE /identity/v3/users/6d7359adc4b24e299a2581241255174d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:08:13.041273 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f899a1-b840-4a71-807b-8140b2973d19 service placement] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:08:13.051864 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f899a1-b840-4a71-807b-8140b2973d19 service placement] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:08:13.107903 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80274ae-0a94-4f06-93c4-e78ec5692eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:08:13.108786 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80274ae-0a94-4f06-93c4-e78ec5692eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:08:13.109065 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80274ae-0a94-4f06-93c4-e78ec5692eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:08:13.109335 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80274ae-0a94-4f06-93c4-e78ec5692eca admin admin] PATH_INFO: `/v3/projects/af865b094acf48e497362e4e6b45ea67` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:08:13.110496 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80274ae-0a94-4f06-93c4-e78ec5692eca admin admin] RBAC: Authorizing `identity:delete_project(project_id=af865b094acf48e497362e4e6b45ea67)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:08:13.112372 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80274ae-0a94-4f06-93c4-e78ec5692eca admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:08:13.209006 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-e80274ae-0a94-4f06-93c4-e78ec5692eca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af865b094acf48e497362e4e6b45ea67', 'request_id': 'req-e80274ae-0a94-4f06-93c4-e78ec5692eca'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:13.214505 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-e80274ae-0a94-4f06-93c4-e78ec5692eca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af865b094acf48e497362e4e6b45ea67', 'request_id': 'req-e80274ae-0a94-4f06-93c4-e78ec5692eca'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:13.290573 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-e80274ae-0a94-4f06-93c4-e78ec5692eca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af865b094acf48e497362e4e6b45ea67', 'request_id': 'req-e80274ae-0a94-4f06-93c4-e78ec5692eca'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:13.313436 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-e80274ae-0a94-4f06-93c4-e78ec5692eca admin admin] The token cache is being invalidate because project af865b094acf48e497362e4e6b45ea67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 22:08:13.316645 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-e80274ae-0a94-4f06-93c4-e78ec5692eca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:13.316645 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-e80274ae-0a94-4f06-93c4-e78ec5692eca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:13.316645 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1488/2967] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 22:08:13 2022] DELETE /identity/v3/projects/af865b094acf48e497362e4e6b45ea67 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:08:13.320714 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9fcba-9a20-4946-9622-0ca99f72d825 admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:08:13.322141 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-26d9fcba-9a20-4946-9622-0ca99f72d825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:08:13.335270 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9fcba-9a20-4946-9622-0ca99f72d825 admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:08:13.367316 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:08:13.389554 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2122877-c243-4a1b-b6c4-4c86be90417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:08:13.390448 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2122877-c243-4a1b-b6c4-4c86be90417c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:08:13.390728 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2122877-c243-4a1b-b6c4-4c86be90417c admin admin] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:08:13.391004 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2122877-c243-4a1b-b6c4-4c86be90417c admin admin] PATH_INFO: `/v3/users/982b2f4cf3eb4d33b48d79e16fbf53be` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:08:13.392180 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2122877-c243-4a1b-b6c4-4c86be90417c admin admin] RBAC: Authorizing `identity:delete_user(user_id=982b2f4cf3eb4d33b48d79e16fbf53be)` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:08:13.394680 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2122877-c243-4a1b-b6c4-4c86be90417c admin admin] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:08:13.556488 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c2122877-c243-4a1b-b6c4-4c86be90417c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982b2f4cf3eb4d33b48d79e16fbf53be'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:13.557174 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c2122877-c243-4a1b-b6c4-4c86be90417c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982b2f4cf3eb4d33b48d79e16fbf53be'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:13.557687 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c2122877-c243-4a1b-b6c4-4c86be90417c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982b2f4cf3eb4d33b48d79e16fbf53be'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:13.569915 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c2122877-c243-4a1b-b6c4-4c86be90417c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982b2f4cf3eb4d33b48d79e16fbf53be'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:13.577550 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.notifications [None req-c2122877-c243-4a1b-b6c4-4c86be90417c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982b2f4cf3eb4d33b48d79e16fbf53be'} {{(pid=80748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:13.678951 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1480/2968] 10.222.0.66 () {58 vars in 1223 bytes} [Thu May 26 22:08:13 2022] DELETE /identity/v3/users/982b2f4cf3eb4d33b48d79e16fbf53be => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:08:14.161150 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80274ae-0a94-4f06-93c4-e78ec5692eca admin admin] Authenticating user token {{(pid=80747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:08:14.162672 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.fernet_utils [None req-e80274ae-0a94-4f06-93c4-e78ec5692eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:08:14.183520 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80274ae-0a94-4f06-93c4-e78ec5692eca admin admin] Validating token access rules against request {{(pid=80747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:08:14.237422 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:08:14.246132 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c937140-2293-4bf3-b56b-01aaa54ff2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bd68e46a04911b5f7e4be275448d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b6a47aff4f04a489b501a19f68711d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:08:14.247224 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c937140-2293-4bf3-b56b-01aaa54ff2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:08:14.247518 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c937140-2293-4bf3-b56b-01aaa54ff2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:08:14.247796 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c937140-2293-4bf3-b56b-01aaa54ff2aa admin admin] PATH_INFO: `/v3/projects/8717e8d8bf4447e9932bf9b8384a1cc4` {{(pid=80747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:08:14.249030 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c937140-2293-4bf3-b56b-01aaa54ff2aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8717e8d8bf4447e9932bf9b8384a1cc4)` {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:08:14.250953 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c937140-2293-4bf3-b56b-01aaa54ff2aa admin admin] RBAC: Authorization granted {{(pid=80747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:08:14.381000 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-8c937140-2293-4bf3-b56b-01aaa54ff2aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8717e8d8bf4447e9932bf9b8384a1cc4', 'request_id': 'req-8c937140-2293-4bf3-b56b-01aaa54ff2aa'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:14.386104 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-8c937140-2293-4bf3-b56b-01aaa54ff2aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8717e8d8bf4447e9932bf9b8384a1cc4', 'request_id': 'req-8c937140-2293-4bf3-b56b-01aaa54ff2aa'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:14.450735 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-8c937140-2293-4bf3-b56b-01aaa54ff2aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8717e8d8bf4447e9932bf9b8384a1cc4', 'request_id': 'req-8c937140-2293-4bf3-b56b-01aaa54ff2aa'} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:14.461804 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-8c937140-2293-4bf3-b56b-01aaa54ff2aa admin admin] The token cache is being invalidate because project 8717e8d8bf4447e9932bf9b8384a1cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 22:08:14.465624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-8c937140-2293-4bf3-b56b-01aaa54ff2aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:14.465624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG keystone.notifications [None req-8c937140-2293-4bf3-b56b-01aaa54ff2aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 22:08:14.465624 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: [pid: 80747|app: 0|req: 1489/2969] 10.222.0.66 () {58 vars in 1232 bytes} [Thu May 26 22:08:14 2022] DELETE /identity/v3/projects/8717e8d8bf4447e9932bf9b8384a1cc4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 22:08:23.675235 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=36,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:08:24.516694 dv-cinder-828807-3-iscsi devstack@keystone.service[80747]: DEBUG dbcounter [-] [80747] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:09:43.594342 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2122877-c243-4a1b-b6c4-4c86be90417c admin admin] Authenticating user token {{(pid=80748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 22:09:43.596345 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-c2122877-c243-4a1b-b6c4-4c86be90417c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:09:43.684566 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2122877-c243-4a1b-b6c4-4c86be90417c admin admin] Validating token access rules against request {{(pid=80748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 22:09:43.741285 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65495b75-17c2-4771-a9f9-9def27025ce6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d68ccb9b89843078c40b13f79a72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3db24bf0708446e9b05197fafeb00e4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 22:09:43.741935 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65495b75-17c2-4771-a9f9-9def27025ce6 service placement] REQUEST_METHOD: `GET` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 22:09:43.742221 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65495b75-17c2-4771-a9f9-9def27025ce6 service placement] SCRIPT_NAME: `/identity` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 22:09:43.742499 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65495b75-17c2-4771-a9f9-9def27025ce6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 22:09:43.744273 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.fernet_utils [None req-65495b75-17c2-4771-a9f9-9def27025ce6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 22:09:43.756016 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65495b75-17c2-4771-a9f9-9def27025ce6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 22:09:43.757626 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65495b75-17c2-4771-a9f9-9def27025ce6 service placement] RBAC: Authorization granted {{(pid=80748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 22:09:43.767317 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: [pid: 80748|app: 0|req: 1481/2970] 10.222.0.66 () {60 vars in 1365 bytes} [Thu May 26 22:09:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 22:09:53.763158 dv-cinder-828807-3-iscsi devstack@keystone.service[80748]: DEBUG dbcounter [-] [80748] Writing DB stats keystone:SELECT=67 {{(pid=80748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}